-- Logs begin at Mon 2022-09-26 05:02:39 UTC, end at Mon 2022-09-26 06:08:31 UTC. -- Sep 26 05:28:36.649589 dv-cinder-836083-14-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 26 05:28:36.657497 dv-cinder-836083-14-smb devstack@keystone.service[81668]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 26 05:28:36.659696 dv-cinder-836083-14-smb devstack@keystone.service[81668]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 26 05:28:36 2022] *** Sep 26 05:28:36.659696 dv-cinder-836083-14-smb devstack@keystone.service[81668]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 26 05:28:36.659696 dv-cinder-836083-14-smb devstack@keystone.service[81668]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 26 05:28:36.659696 dv-cinder-836083-14-smb devstack@keystone.service[81668]: nodename: dv-cinder-836083-14-smb Sep 26 05:28:36.659696 dv-cinder-836083-14-smb devstack@keystone.service[81668]: machine: x86_64 Sep 26 05:28:36.659696 dv-cinder-836083-14-smb devstack@keystone.service[81668]: clock source: unix Sep 26 05:28:36.659696 dv-cinder-836083-14-smb devstack@keystone.service[81668]: pcre jit disabled Sep 26 05:28:36.659696 dv-cinder-836083-14-smb devstack@keystone.service[81668]: detected number of CPU cores: 4 Sep 26 05:28:36.659696 dv-cinder-836083-14-smb devstack@keystone.service[81668]: current working directory: / Sep 26 05:28:36.659696 dv-cinder-836083-14-smb devstack@keystone.service[81668]: detected binary path: /usr/bin/uwsgi-core Sep 26 05:28:36.659696 dv-cinder-836083-14-smb devstack@keystone.service[81668]: your processes number limit is 47680 Sep 26 05:28:36.659696 dv-cinder-836083-14-smb devstack@keystone.service[81668]: your memory page size is 4096 bytes Sep 26 05:28:36.659696 dv-cinder-836083-14-smb devstack@keystone.service[81668]: detected max file descriptor number: 2048 Sep 26 05:28:36.659696 dv-cinder-836083-14-smb devstack@keystone.service[81668]: lock engine: pthread robust mutexes Sep 26 05:28:36.660962 dv-cinder-836083-14-smb devstack@keystone.service[81668]: thunder lock: enabled Sep 26 05:28:36.660962 dv-cinder-836083-14-smb devstack@keystone.service[81668]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 26 05:28:36.660962 dv-cinder-836083-14-smb devstack@keystone.service[81668]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 26 05:28:36.703779 dv-cinder-836083-14-smb devstack@keystone.service[81668]: Python main interpreter initialized at 0x557df59e99c0 Sep 26 05:28:36.703779 dv-cinder-836083-14-smb devstack@keystone.service[81668]: python threads support enabled Sep 26 05:28:36.703779 dv-cinder-836083-14-smb devstack@keystone.service[81668]: your server socket listen backlog is limited to 100 connections Sep 26 05:28:36.703779 dv-cinder-836083-14-smb devstack@keystone.service[81668]: your mercy for graceful operations on workers is 90 seconds Sep 26 05:28:36.704161 dv-cinder-836083-14-smb devstack@keystone.service[81668]: mapped 403077 bytes (393 KB) for 2 cores Sep 26 05:28:36.704714 dv-cinder-836083-14-smb devstack@keystone.service[81668]: *** Operational MODE: preforking *** Sep 26 05:28:36.704714 dv-cinder-836083-14-smb devstack@keystone.service[81668]: *** uWSGI is running in multiple interpreter mode *** Sep 26 05:28:36.704714 dv-cinder-836083-14-smb devstack@keystone.service[81668]: spawned uWSGI master process (pid: 81668) Sep 26 05:28:36.704753 dv-cinder-836083-14-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 26 05:28:36.706681 dv-cinder-836083-14-smb devstack@keystone.service[81668]: spawned uWSGI worker 1 (pid: 81682, cores: 1) Sep 26 05:28:36.706681 dv-cinder-836083-14-smb devstack@keystone.service[81668]: spawned uWSGI worker 2 (pid: 81683, cores: 1) Sep 26 05:28:36.706681 dv-cinder-836083-14-smb devstack@keystone.service[81668]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 26 05:28:41.449802 dv-cinder-836083-14-smb devstack@keystone.service[81683]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 05:28:41.449802 dv-cinder-836083-14-smb devstack@keystone.service[81683]: from cryptography.utils import int_from_bytes Sep 26 05:28:41.451047 dv-cinder-836083-14-smb devstack@keystone.service[81683]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 05:28:41.451047 dv-cinder-836083-14-smb devstack@keystone.service[81683]: from cryptography.utils import int_from_bytes Sep 26 05:28:41.451968 dv-cinder-836083-14-smb devstack@keystone.service[81682]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 05:28:41.451968 dv-cinder-836083-14-smb devstack@keystone.service[81682]: from cryptography.utils import int_from_bytes Sep 26 05:28:41.452581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 26 05:28:41.452581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: from cryptography.utils import int_from_bytes Sep 26 05:28:41.502225 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 05:28:41.502480 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 05:28:41.502559 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] command line args: [] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 05:28:41.502836 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 05:28:41.503011 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ================================================================================ {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 05:28:41.503147 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 26 05:28:41.503322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] admin_token = **** {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.503404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 26 05:28:41.503568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] command line args: [] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 26 05:28:41.503676 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] config_dir = [] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.503775 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.503906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 26 05:28:41.504010 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] config_source = [] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.504074 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ================================================================================ {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 26 05:28:41.504137 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] debug = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.504294 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.504640 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] admin_token = **** {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.504640 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] config_dir = [] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.504836 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.504836 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] config_source = [] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.505019 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.505115 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] debug = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.505233 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.505346 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.505483 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.505583 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.505583 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.505774 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.505877 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.507490 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] list_limit = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.507490 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] log_config_append = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.507769 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.507895 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.508016 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] list_limit = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.508127 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] log_dir = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.508230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] log_config_append = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.508323 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] log_file = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.508419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.508515 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.508629 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] log_dir = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.508629 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] log_file = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.508816 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.508916 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.509016 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.509100 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.509170 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.509232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.509289 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.509289 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.509396 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.509396 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.509514 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.509572 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.509628 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.509684 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.509748 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.509824 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.509883 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.509939 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.509995 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.510056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.510118 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.510190 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.510302 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.510403 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.510504 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.510608 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.510718 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.510833 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.510833 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.511005 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.66/identity {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.511005 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] publish_errors = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.511175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.66/identity {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.511246 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.511309 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] publish_errors = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.511366 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.511432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.511490 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.511563 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.511660 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.511792 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.511930 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.512037 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.512037 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.512219 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] standard_threads = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.512318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] standard_threads = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.512414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.512508 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.512602 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.512602 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.512764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.512866 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] use_journal = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.513034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.513137 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] use_json = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.513240 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] use_journal = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.513365 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] use_stderr = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.513437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] use_json = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.513500 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] use_syslog = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.513572 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] use_stderr = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.513572 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] use_syslog = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.513683 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.513740 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 26 05:28:41.513802 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.513859 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.513925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.513991 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.514088 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.514199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.514270 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.514366 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.514472 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.514587 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.514750 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.514877 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.515018 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.515131 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.515257 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.515384 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.515498 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.515611 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.515771 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.515894 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.516022 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.516139 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.516247 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.516352 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.516489 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.516605 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.516728 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.516835 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.516932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.517031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.517138 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.517246 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.517366 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.517474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.517581 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.517689 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.517806 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.517921 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.518143 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.518255 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.518362 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.518479 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.518577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.518647 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.518713 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.518771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.518990 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.519100 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.519595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.519946 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.520087 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.520221 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.520353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.520477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.520601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.520736 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.520854 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.520978 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.521106 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.521246 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.521374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.521509 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.521629 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.521762 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.521876 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.521993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.522110 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.522236 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.522345 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.522467 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.522585 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.522707 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.522832 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.522979 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.523106 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.523225 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.523342 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.523464 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.523586 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.523721 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.523951 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.524076 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.524195 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.524312 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.524427 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.524675 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.524805 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.524926 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.525041 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.525159 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.525277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.525406 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.525521 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.525640 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.525764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.525893 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.526018 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.526155 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.526278 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.526405 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.526624 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.526750 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.526879 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.527010 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.527136 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.527259 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.527385 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.527513 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.527682 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.527682 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.528031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.528198 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.528429 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.528604 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.528780 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.528933 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.529091 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.529259 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.529422 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.529591 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.529759 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.529925 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.530059 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.530239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.530469 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.530632 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.530769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.530961 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.531134 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.531256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.531418 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.531586 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.531705 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.531872 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.532017 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.532143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.532319 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.532451 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.532627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.532799 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.532927 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.533101 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.533232 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.533416 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.533591 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.533730 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.533919 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.534046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.534157 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.534285 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.534522 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.534696 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.534835 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.534963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.535146 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.535272 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.535393 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.535509 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.535653 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.535893 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.536022 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.536199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.536320 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.536437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.536582 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.536782 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.536911 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.537033 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.537152 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.537270 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.537397 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.537582 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.537713 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.537842 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.537842 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.538069 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.538202 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.538324 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.538441 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.538555 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.538663 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.538781 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.539003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.539132 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.539260 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.539377 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.539498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.539635 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.539789 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.539934 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.540053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.540222 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.540336 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.540451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.540576 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.540717 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.540847 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.540982 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.541104 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.541226 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.541342 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.541472 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.541598 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.541728 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.541857 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.541979 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.542094 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.542227 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.542347 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.542465 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.542580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.542702 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.542848 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] auth.external = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.543028 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.543174 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.543310 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.543432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.543553 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] auth.external = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.543679 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.543885 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.544029 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] auth.password = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.544181 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.544305 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] auth.token = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.544425 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.544540 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.544657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] auth.password = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.544778 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.544920 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] auth.token = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.545050 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.545185 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.545307 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.545425 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.545546 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.545678 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.545808 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.545924 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.546039 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.546039 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] credential.caching = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.546265 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.546406 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.546528 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.546528 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.546822 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.546952 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] credential.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.547083 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.547083 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.547316 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.547446 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.547574 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.547714 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.547869 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.548012 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.548138 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.548258 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.548373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.548481 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.548592 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.548725 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.548856 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.548977 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.549097 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.549217 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.549335 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.549463 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.549582 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.549706 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.549835 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.549966 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.550164 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.550306 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] federation.caching = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.550432 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.550557 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.550678 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.550787 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.550899 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.551024 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.551136 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] federation.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.551252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.551363 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.551479 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.551655 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.551793 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.551964 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.552087 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.552208 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.552334 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.552482 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.552601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.552724 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.552843 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.552955 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.553065 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.553190 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.553320 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity.caching = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.553438 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.553548 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.553656 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.553759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.553993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.554107 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.554107 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.554315 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.554432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.554560 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.554698 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.554829 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.554945 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.555079 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.555199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.555312 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.555433 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.555558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.555677 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.555893 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.556005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.556118 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.556248 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.556361 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.556469 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.556584 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.556701 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.556829 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.557060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.557240 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.557240 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.557451 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.557585 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.557703 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.557826 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.557939 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.558062 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.558185 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.558313 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.558444 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.558587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.558710 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.558710 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.558934 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.559050 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.559159 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.559287 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.559410 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.559540 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.559670 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.559821 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.559938 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.560079 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.560200 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.560313 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.560423 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.560550 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.560676 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.560818 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.560947 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.561069 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.561191 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.561313 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.561430 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.561556 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.561671 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.561794 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.561923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.562050 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.562201 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.562331 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.562453 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.562574 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.562693 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.562811 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.562934 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.563050 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.563165 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.563281 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.563399 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.563524 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.563669 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.563828 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.563953 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.564077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.564197 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.564311 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.564439 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.564550 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.564659 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.564780 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.564907 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.565039 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.565168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.565291 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.565410 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.565524 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.565633 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.565786 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.565786 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.566016 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.566144 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.566272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.566398 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.566522 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.566648 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.566754 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.566851 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.566951 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.566951 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.567150 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.567150 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.567368 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.567475 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.567583 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.567710 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.567943 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.568074 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.568194 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.568320 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.568450 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.568579 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.568704 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.568837 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.568964 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.569092 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.569217 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.569336 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.569461 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.569604 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.569733 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.569860 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.569982 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.570105 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.570234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.570378 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.570506 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.570629 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.570750 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.570859 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.570986 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.571127 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.571259 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.571383 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.571507 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.571628 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.571782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.572005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.572134 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.572259 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.572381 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.572503 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.572622 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.572749 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.572863 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.573337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.573449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.573570 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.573690 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.573825 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.573959 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.574085 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.574210 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.574335 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.574335 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.574575 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.574699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.574823 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.574946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.575069 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.575189 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.575324 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.575452 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] resource.caching = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.575574 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.575683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.575815 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.575920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.576040 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.576150 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.576262 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.576376 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.576502 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.576635 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.576771 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.576889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.577017 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] resource.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.577144 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.577260 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.577387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.577525 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.577646 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.577765 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.577892 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] role.caching = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.578112 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.578357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] role.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.578482 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.578600 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.578720 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.578847 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.578977 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.579119 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.579244 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.579367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.579485 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.579607 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.579830 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] role.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.579985 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.580113 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] role.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.580234 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.580355 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.580475 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.580603 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.580747 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.580876 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.581001 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.581122 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.581242 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.581399 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.581560 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.581678 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.581798 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.581913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.582034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.582157 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.582157 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.582384 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.582494 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.582603 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.582722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.582848 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.582992 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.583122 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.583248 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.583383 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.583494 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.583620 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.583620 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.583899 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.584030 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.584154 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.584274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.584408 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.584535 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.584662 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.584790 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.584917 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.585044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.585044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.585281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.585410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.585537 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.585667 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.585801 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.585937 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.586056 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.586180 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.586288 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.586414 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.586539 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.586676 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.586801 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.586922 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] token.caching = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.587050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.587177 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.587279 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.587406 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.587528 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.587647 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.587782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.587893 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.588018 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.588165 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.588308 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.588436 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.588560 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.588690 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.588808 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] token.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.588939 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.589066 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.589195 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.589324 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.589447 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.589572 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.589707 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.589835 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.589948 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.590131 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.590262 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.590391 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.590531 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.590652 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.590775 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.590905 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.591028 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.591141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.591256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.591380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.591494 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.connection = **** {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.591607 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.591720 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.592056 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.592171 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.592302 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.592433 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.592564 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.592690 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.592807 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.592942 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.593082 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.593206 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.593330 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.593442 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.593555 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.connection = **** {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.593668 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.593786 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.593895 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.593895 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.594104 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.594217 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.594329 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.594440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.594565 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.594704 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.594835 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.594963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.595086 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.595209 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.595328 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.595463 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.595593 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.595723 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.595876 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.595995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.596117 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.596258 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81682) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 05:28:41.596377 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.596377 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.596377 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.596377 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.596377 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.596377 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.596377 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.596377 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 26 05:28:41.596377 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81683) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 26 05:28:41.616169 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.616469 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.616608 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.616752 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.616994 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.617219 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.625280 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.625867 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.654507 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.654740 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.654885 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.655097 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.711289 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.711523 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.764153 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.764407 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.764531 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.764663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.935060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.935308 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.935458 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.935592 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.935717 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.935873 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.935999 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.936174 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.936301 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.936379 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.936444 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.936444 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.962369 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.962564 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.962693 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.962788 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.962918 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.963019 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.963131 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.963258 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.963385 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.963514 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.963639 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.963827 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.963827 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.964061 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.976047 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.976330 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.989944 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.990145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.990372 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.990476 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.990603 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.990712 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.990828 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.990904 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.991048 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.991140 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.991274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81682) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.991379 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.991456 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:41.991672 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81683) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 26 05:28:42.009002 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.009236 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 26 05:28:42.009541 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.009735 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 26 05:28:42.010008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.010153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.010285 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 26 05:28:42.010414 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.010543 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.010671 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.010801 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.010930 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 26 05:28:42.011050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.011273 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.011544 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.011833 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.020694 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.020977 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.021261 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.021542 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.021837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.022142 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.022417 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.022692 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.028763 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.029892 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.031717 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.032026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.032312 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.032590 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.032868 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.033004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.033113 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.033244 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.033374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.033518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.033651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.033781 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.033909 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.034039 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.034181 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.034316 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.034427 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.034603 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.034896 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.035167 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.035443 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.035715 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.057251 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.058764 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.058944 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.059030 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.060360 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.060647 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.063908 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.064177 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.064458 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.065465 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.065832 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.066123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.071089 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.071383 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.072690 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.073375 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.077907 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.078210 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.078492 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.078771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.079044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.079297 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.079449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.079541 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.079801 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.079927 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.080094 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.080407 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.080689 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.080952 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.081220 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.081541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.095527 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.095857 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.097324 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.097634 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.099870 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.101553 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.103127 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.103428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.104878 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.105187 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.107646 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.109441 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.110824 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.114116 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.114253 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.114414 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.114693 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.114971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.115252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.115543 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.118999 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.119479 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.119870 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.120164 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.120552 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.120947 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.131282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.131581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.131872 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.132132 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.138973 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.140527 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.142028 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.142312 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.145048 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.145333 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.145610 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.145886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.146276 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.147228 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.147675 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.147984 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.148325 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.157342 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.157634 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.157915 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.158192 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.158576 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.158740 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.158865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.159148 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.160948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.163248 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.163724 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.168552 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.168942 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.169432 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.169925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.170448 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.174495 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.177521 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.180570 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.181997 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.183439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.183721 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.184146 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.190343 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.190496 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.190656 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.190997 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.191280 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.191679 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.191960 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.192096 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.192260 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.194796 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.195185 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.195472 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.195768 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.203878 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.204231 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.204399 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.208153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.211103 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.211320 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81682) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.211620 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.211930 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.212177 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.212536 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.212742 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.213009 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.213283 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.213555 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.213832 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.214032 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.214158 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.214296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.214575 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.214889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81682) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.215465 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.216972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.217255 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.217654 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.224083 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.225551 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.228470 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.228875 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.229164 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.229442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.237245 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.237541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.237910 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.244786 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81683) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 26 05:28:42.245072 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.245350 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.245627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.245898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.246169 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.246442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.246736 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.247008 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.247288 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.247568 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.247885 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.248184 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.248474 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81683) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 26 05:28:42.248728 dv-cinder-836083-14-smb devstack@keystone.service[81682]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557df59e99c0 pid: 81682 (default app) Sep 26 05:28:42.252286 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e63146-df7b-4ba5-ac71-373d3749d2e2 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:28:42.252609 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e63146-df7b-4ba5-ac71-373d3749d2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:28:42.252944 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e63146-df7b-4ba5-ac71-373d3749d2e2 None None] PATH_INFO: `/v3` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:28:42.257047 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1/1] 10.222.0.66 () {50 vars in 791 bytes} [Mon Sep 26 05:28:42 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:28:42.282739 dv-cinder-836083-14-smb devstack@keystone.service[81683]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557df59e99c0 pid: 81683 (default app) Sep 26 05:28:49.192876 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9164c9d-aafc-47e5-8c5c-78726855d8aa None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:28:49.193922 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9164c9d-aafc-47e5-8c5c-78726855d8aa None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:28:49.193922 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9164c9d-aafc-47e5-8c5c-78726855d8aa None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:28:49.196373 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 2/2] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:28:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:28:49.209307 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd97bd1-f953-40f8-b1b8-b4b4ca319cf2 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:28:49.210430 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd97bd1-f953-40f8-b1b8-b4b4ca319cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:28:49.210430 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd97bd1-f953-40f8-b1b8-b4b4ca319cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:28:49.287042 dv-cinder-836083-14-smb devstack@keystone.service[81683]: INFO dbcounter [None req-ffd97bd1-f953-40f8-b1b8-b4b4ca319cf2 None None] Registered counter for database keystone Sep 26 05:28:49.308630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG oslo_db.sqlalchemy.engines [None req-ffd97bd1-f953-40f8-b1b8-b4b4ca319cf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81683) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:28:49.315406 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writer thread running {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:28:49.503963 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG passlib.handlers.bcrypt [None req-ffd97bd1-f953-40f8-b1b8-b4b4ca319cf2 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81683) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 26 05:28:49.504396 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG passlib.handlers.bcrypt [None req-ffd97bd1-f953-40f8-b1b8-b4b4ca319cf2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81683) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 26 05:28:49.564078 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-ffd97bd1-f953-40f8-b1b8-b4b4ca319cf2 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:28:49.565739 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ffd97bd1-f953-40f8-b1b8-b4b4ca319cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:28:49.707050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1/3] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:28:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 502 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 26 05:28:50.207801 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9164c9d-aafc-47e5-8c5c-78726855d8aa None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:28:50.278848 dv-cinder-836083-14-smb devstack@keystone.service[81682]: INFO dbcounter [None req-f9164c9d-aafc-47e5-8c5c-78726855d8aa None None] Registered counter for database keystone Sep 26 05:28:50.301896 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG oslo_db.sqlalchemy.engines [None req-f9164c9d-aafc-47e5-8c5c-78726855d8aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81682) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 26 05:28:50.309468 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writer thread running {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 26 05:28:50.431537 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9164c9d-aafc-47e5-8c5c-78726855d8aa None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:28:50.436380 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307002d4-7707-4be1-81f4-4b38a16b4ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:28:50.437022 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307002d4-7707-4be1-81f4-4b38a16b4ebc admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:28:50.437301 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307002d4-7707-4be1-81f4-4b38a16b4ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:28:50.437572 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307002d4-7707-4be1-81f4-4b38a16b4ebc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:28:50.446580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307002d4-7707-4be1-81f4-4b38a16b4ebc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:28:50.498067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: WARNING keystone.common.rbac_enforcer.enforcer [None req-307002d4-7707-4be1-81f4-4b38a16b4ebc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 26 05:28:50.498305 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307002d4-7707-4be1-81f4-4b38a16b4ebc admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:28:50.508906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 3/4] 10.222.0.66 () {58 vars in 1324 bytes} [Mon Sep 26 05:28:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 26 05:28:50.515256 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd97bd1-f953-40f8-b1b8-b4b4ca319cf2 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:28:50.530705 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd97bd1-f953-40f8-b1b8-b4b4ca319cf2 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:28:50.535540 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa0c57-6659-43a4-8ce0-17546e65ef16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:28:50.536725 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa0c57-6659-43a4-8ce0-17546e65ef16 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:28:50.537004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa0c57-6659-43a4-8ce0-17546e65ef16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:28:50.537269 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa0c57-6659-43a4-8ce0-17546e65ef16 admin admin] PATH_INFO: `/v3/projects/2c94348459484274ba0198cbad0a8ffb` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:28:50.538774 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa0c57-6659-43a4-8ce0-17546e65ef16 admin admin] RBAC: Authorizing `identity:get_project(project_id=2c94348459484274ba0198cbad0a8ffb)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:28:50.592135 dv-cinder-836083-14-smb devstack@keystone.service[81683]: WARNING keystone.common.rbac_enforcer.enforcer [None req-75fa0c57-6659-43a4-8ce0-17546e65ef16 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 26 05:28:50.592480 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa0c57-6659-43a4-8ce0-17546e65ef16 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:28:50.597393 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 2/5] 10.222.0.66 () {56 vars in 1207 bytes} [Mon Sep 26 05:28:50 2022] GET /identity/v3/projects/2c94348459484274ba0198cbad0a8ffb => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:28:52.758003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fce75-edb3-486a-b121-1f0a2669718d None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:28:52.758665 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fce75-edb3-486a-b121-1f0a2669718d None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:28:52.758665 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2fce75-edb3-486a-b121-1f0a2669718d None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:28:52.762663 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 4/6] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:28:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:28:52.769046 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d122eb4-ed72-45c0-a109-96a7f0cf0030 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:28:52.769524 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d122eb4-ed72-45c0-a109-96a7f0cf0030 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:28:52.769858 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d122eb4-ed72-45c0-a109-96a7f0cf0030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:28:52.793906 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-2d122eb4-ed72-45c0-a109-96a7f0cf0030 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:28:52.795447 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2d122eb4-ed72-45c0-a109-96a7f0cf0030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:28:52.804913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 3/7] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:28:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 26 05:28:53.095872 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2fce75-edb3-486a-b121-1f0a2669718d None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:28:53.108265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2fce75-edb3-486a-b121-1f0a2669718d None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:28:53.112604 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db83c1-81ad-4bb3-a5bb-18c6d828a355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:28:53.113220 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db83c1-81ad-4bb3-a5bb-18c6d828a355 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:28:53.113525 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db83c1-81ad-4bb3-a5bb-18c6d828a355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:28:53.113791 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db83c1-81ad-4bb3-a5bb-18c6d828a355 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:28:53.122217 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db83c1-81ad-4bb3-a5bb-18c6d828a355 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:28:53.124019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db83c1-81ad-4bb3-a5bb-18c6d828a355 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:28:53.133037 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 5/8] 10.222.0.66 () {58 vars in 1324 bytes} [Mon Sep 26 05:28:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 05:28:53.139188 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d122eb4-ed72-45c0-a109-96a7f0cf0030 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:28:53.148996 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d122eb4-ed72-45c0-a109-96a7f0cf0030 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:28:53.154334 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eab6c2-f5e3-4f51-b4cc-ded906ee0f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:28:53.154985 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eab6c2-f5e3-4f51-b4cc-ded906ee0f95 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:28:53.155261 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eab6c2-f5e3-4f51-b4cc-ded906ee0f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:28:53.155526 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eab6c2-f5e3-4f51-b4cc-ded906ee0f95 admin admin] PATH_INFO: `/v3/users/68623c0b9d92445197ab588b18e08f43` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:28:53.157007 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eab6c2-f5e3-4f51-b4cc-ded906ee0f95 admin admin] RBAC: Authorizing `identity:get_user(user_id=68623c0b9d92445197ab588b18e08f43)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:28:53.158881 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eab6c2-f5e3-4f51-b4cc-ded906ee0f95 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:28:53.160634 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 4/9] 10.222.0.66 () {56 vars in 1198 bytes} [Mon Sep 26 05:28:53 2022] GET /identity/v3/users/68623c0b9d92445197ab588b18e08f43 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:28:55.451605 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6a1c3-2a58-46d3-b753-30a6a747e505 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:28:55.452213 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6a1c3-2a58-46d3-b753-30a6a747e505 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:28:55.452554 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6a1c3-2a58-46d3-b753-30a6a747e505 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:28:55.454943 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 6/10] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:28:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:28:55.463187 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1be6f-6b61-4eb8-848a-32ab80127aab None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:28:55.463970 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1be6f-6b61-4eb8-848a-32ab80127aab None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:28:55.463970 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1be6f-6b61-4eb8-848a-32ab80127aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:28:55.483528 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-3af1be6f-6b61-4eb8-848a-32ab80127aab None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:28:55.484929 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3af1be6f-6b61-4eb8-848a-32ab80127aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:28:55.523344 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd50df-b378-4a5b-a180-784960d8e82c None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:28:55.523860 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd50df-b378-4a5b-a180-784960d8e82c None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:28:55.524347 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd50df-b378-4a5b-a180-784960d8e82c None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:28:55.526740 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 7/11] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:28:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:28:55.535086 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e64ad-304b-42c9-828a-fe5fef14e9e7 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:28:55.535454 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e64ad-304b-42c9-828a-fe5fef14e9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:28:55.535836 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e64ad-304b-42c9-828a-fe5fef14e9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:28:55.576032 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 5/12] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:28:55.581391 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG passlib.handlers.bcrypt [None req-322e64ad-304b-42c9-828a-fe5fef14e9e7 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81682) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 26 05:28:55.582038 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG passlib.handlers.bcrypt [None req-322e64ad-304b-42c9-828a-fe5fef14e9e7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81682) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 26 05:28:55.636537 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-322e64ad-304b-42c9-828a-fe5fef14e9e7 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:28:55.639168 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-322e64ad-304b-42c9-828a-fe5fef14e9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:28:55.814362 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 8/13] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:28:55.843799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1be6f-6b61-4eb8-848a-32ab80127aab None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:28:55.868936 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:28:55.952947 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1be6f-6b61-4eb8-848a-32ab80127aab None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:28:55.987829 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48364172-8c12-4f05-a815-9906d58895b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:28:55.988491 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48364172-8c12-4f05-a815-9906d58895b6 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:28:55.988884 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48364172-8c12-4f05-a815-9906d58895b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:28:55.989214 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48364172-8c12-4f05-a815-9906d58895b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:28:56.002591 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48364172-8c12-4f05-a815-9906d58895b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:28:56.012058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-48364172-8c12-4f05-a815-9906d58895b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:28:56.012058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:28:56.012058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:28:56.012058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:28:56.012058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:28:56.012058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:28:56.012058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:28:56.012058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:28:56.012058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:28:56.012058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:28:56.012058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:28:56.012058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:28:56.012058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:28:56.012058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:28:56.012058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:28:56.012058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:28:56.013607 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:28:56.013607 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:28:56.013607 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:28:56.013607 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:28:56.013607 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:28:56.013607 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:28:56.013607 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:28:56.013607 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:28:56.013607 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:28:56.013607 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:28:56.013607 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:28:56.013607 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:28:56.013607 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:28:56.013607 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:28:56.013607 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:28:56.013607 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:28:56.014577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:28:56.014577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:28:56.014577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:28:56.014577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:28:56.014577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:28:56.014577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:28:56.014577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:28:56.014577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:28:56.014577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:28:56.014577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:28:56.014577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:28:56.014577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:28:56.014577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 6/14] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:28:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:28:56.019655 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e64ad-304b-42c9-828a-fe5fef14e9e7 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:28:56.126217 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e64ad-304b-42c9-828a-fe5fef14e9e7 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:28:56.129269 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:28:56.164885 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7301a2-fd26-4f3d-865c-4faa1b3f4369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:28:56.165787 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7301a2-fd26-4f3d-865c-4faa1b3f4369 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:28:56.166064 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7301a2-fd26-4f3d-865c-4faa1b3f4369 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:28:56.166330 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7301a2-fd26-4f3d-865c-4faa1b3f4369 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:28:56.167171 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7301a2-fd26-4f3d-865c-4faa1b3f4369 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:28:56.167466 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7301a2-fd26-4f3d-865c-4faa1b3f4369 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:28:56.168964 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7301a2-fd26-4f3d-865c-4faa1b3f4369 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:28:56.181486 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 9/15] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:28:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:28:56.187625 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48364172-8c12-4f05-a815-9906d58895b6 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:28:56.274458 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:28:56.294281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48364172-8c12-4f05-a815-9906d58895b6 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:28:56.314836 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7301a2-fd26-4f3d-865c-4faa1b3f4369 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:28:56.332324 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78aa33-5ce2-4940-a02f-34a13e8fb758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:28:56.333103 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78aa33-5ce2-4940-a02f-34a13e8fb758 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:28:56.333377 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78aa33-5ce2-4940-a02f-34a13e8fb758 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:28:56.333650 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78aa33-5ce2-4940-a02f-34a13e8fb758 None admin] PATH_INFO: `/v3/users/68623c0b9d92445197ab588b18e08f43` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:28:56.334877 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78aa33-5ce2-4940-a02f-34a13e8fb758 None admin] RBAC: Authorizing `identity:get_user(user_id=68623c0b9d92445197ab588b18e08f43)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:28:56.336432 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78aa33-5ce2-4940-a02f-34a13e8fb758 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:28:56.338071 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 7/16] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:28:56 2022] GET /identity/v3/users/68623c0b9d92445197ab588b18e08f43 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:28:56.343805 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78aa33-5ce2-4940-a02f-34a13e8fb758 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:28:56.450014 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7301a2-fd26-4f3d-865c-4faa1b3f4369 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:28:56.473190 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78aa33-5ce2-4940-a02f-34a13e8fb758 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:28:56.493855 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f214c79-1694-40ce-b889-b29f1cbc2f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:28:56.494708 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f214c79-1694-40ce-b889-b29f1cbc2f3d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:28:56.494871 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f214c79-1694-40ce-b889-b29f1cbc2f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:28:56.495284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f214c79-1694-40ce-b889-b29f1cbc2f3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:28:56.514232 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c47e54-bb55-4951-ab17-21731895ef77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:28:56.514988 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c47e54-bb55-4951-ab17-21731895ef77 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:28:56.515304 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c47e54-bb55-4951-ab17-21731895ef77 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:28:56.515626 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c47e54-bb55-4951-ab17-21731895ef77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:28:56.517046 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c47e54-bb55-4951-ab17-21731895ef77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:28:56.518678 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c47e54-bb55-4951-ab17-21731895ef77 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:28:56.520656 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 8/17] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:28:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:28:56.527221 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c47e54-bb55-4951-ab17-21731895ef77 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:28:56.535687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:28:56.555389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:28:56.587622 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f214c79-1694-40ce-b889-b29f1cbc2f3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:28:56.590059 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f214c79-1694-40ce-b889-b29f1cbc2f3d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:28:56.675770 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c47e54-bb55-4951-ab17-21731895ef77 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:28:56.732122 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f4175-5791-4792-8d37-e3e7e38c7423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:28:56.733077 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f4175-5791-4792-8d37-e3e7e38c7423 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:28:56.733527 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f4175-5791-4792-8d37-e3e7e38c7423 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:28:56.733977 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f4175-5791-4792-8d37-e3e7e38c7423 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:28:56.735182 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f4175-5791-4792-8d37-e3e7e38c7423 None admin] RBAC: Adding query filter params (role.id=cf58d66369044fb09fa65a4366dc7446, scope.domain.id=default, user.id=68623c0b9d92445197ab588b18e08f43) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:28:56.735686 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f4175-5791-4792-8d37-e3e7e38c7423 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:28:56.738132 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f4175-5791-4792-8d37-e3e7e38c7423 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:28:56.747792 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 10/18] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:28:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 26 05:28:56.748290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 9/19] 10.222.0.66 () {56 vars in 1322 bytes} [Mon Sep 26 05:28:56 2022] GET /identity/v3/role_assignments?user.id=68623c0b9d92445197ab588b18e08f43&scope.domain.id=default&role.id=cf58d66369044fb09fa65a4366dc7446 => generated 233 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:28:56.752516 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f214c79-1694-40ce-b889-b29f1cbc2f3d None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:28:56.863001 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:28:56.917069 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f214c79-1694-40ce-b889-b29f1cbc2f3d None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:28:56.962146 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94014d44-c10d-4cae-a53a-8c6aeae8432e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:28:56.963269 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94014d44-c10d-4cae-a53a-8c6aeae8432e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:28:56.963669 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94014d44-c10d-4cae-a53a-8c6aeae8432e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:28:56.964076 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94014d44-c10d-4cae-a53a-8c6aeae8432e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:28:56.989072 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94014d44-c10d-4cae-a53a-8c6aeae8432e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:28:56.990771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94014d44-c10d-4cae-a53a-8c6aeae8432e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:28:57.011440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-94014d44-c10d-4cae-a53a-8c6aeae8432e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:28:57.011440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:28:57.011440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:28:57.011440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:28:57.011440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:28:57.011440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:28:57.011440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:28:57.011440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:28:57.011440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:28:57.011440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:28:57.011440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:28:57.011440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:28:57.011440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:28:57.011440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:28:57.011440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:28:57.011440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:28:57.013145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:28:57.013145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:28:57.013145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:28:57.013145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:28:57.013145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:28:57.013145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:28:57.013145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:28:57.013145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:28:57.013145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:28:57.013145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:28:57.013145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:28:57.013145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:28:57.013145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:28:57.013145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:28:57.013145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:28:57.013145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:28:57.013145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:28:57.014132 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:28:57.014132 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:28:57.014132 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:28:57.014132 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 11/20] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:28:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:28:57.021484 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f4175-5791-4792-8d37-e3e7e38c7423 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:28:57.168242 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:28:57.195457 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f4175-5791-4792-8d37-e3e7e38c7423 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:28:57.235654 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d133c-b449-4a0c-bc84-597a59a028c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:28:57.236404 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d133c-b449-4a0c-bc84-597a59a028c2 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:28:57.236741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d133c-b449-4a0c-bc84-597a59a028c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:28:57.237087 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d133c-b449-4a0c-bc84-597a59a028c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:28:57.237824 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d133c-b449-4a0c-bc84-597a59a028c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:28:57.238172 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d133c-b449-4a0c-bc84-597a59a028c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:28:57.239865 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d133c-b449-4a0c-bc84-597a59a028c2 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:28:57.259587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 10/21] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:28:59.108382 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb3fb5-19f7-453f-a41e-030b088b3db9 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:28:59.109851 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb3fb5-19f7-453f-a41e-030b088b3db9 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:28:59.110588 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb3fb5-19f7-453f-a41e-030b088b3db9 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:28:59.113403 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 12/22] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:28:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:28:59.119485 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842cab7-6c3a-4166-93af-c2b849b8dbbb None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:28:59.120194 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842cab7-6c3a-4166-93af-c2b849b8dbbb None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:28:59.120194 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842cab7-6c3a-4166-93af-c2b849b8dbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:28:59.148923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-0842cab7-6c3a-4166-93af-c2b849b8dbbb None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:28:59.150206 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0842cab7-6c3a-4166-93af-c2b849b8dbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:28:59.242739 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 11/23] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:28:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:28:59.784240 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb3fb5-19f7-453f-a41e-030b088b3db9 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:28:59.958843 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb3fb5-19f7-453f-a41e-030b088b3db9 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:00.003336 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:00.040218 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df36e3-4d69-4a8e-adcf-fbc01f7f766e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:00.041286 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df36e3-4d69-4a8e-adcf-fbc01f7f766e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:00.041752 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df36e3-4d69-4a8e-adcf-fbc01f7f766e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:00.042233 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df36e3-4d69-4a8e-adcf-fbc01f7f766e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:00.073773 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df36e3-4d69-4a8e-adcf-fbc01f7f766e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:29:00.091031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-33df36e3-4d69-4a8e-adcf-fbc01f7f766e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:29:00.091031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:00.091031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:00.091031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:00.091031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:00.091031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:00.091031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:00.091031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:00.091031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:00.091031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:00.091031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:00.091031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:00.091031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:29:00.091031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:29:00.091031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:29:00.091031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:29:00.091977 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:29:00.091977 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:29:00.091977 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:29:00.091977 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:29:00.091977 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:00.091977 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:00.091977 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:00.091977 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:00.091977 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:00.091977 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:00.091977 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:00.091977 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:00.091977 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:00.091977 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:00.091977 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:00.091977 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:00.092751 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:00.092751 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:00.092751 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:00.092751 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:00.092751 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:29:00.092751 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:29:00.092751 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:29:00.092751 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:29:00.092751 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:29:00.092751 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:29:00.092751 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:29:00.092751 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:29:00.093329 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 13/24] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:28:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:29:00.099503 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842cab7-6c3a-4166-93af-c2b849b8dbbb None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:00.225920 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:00.270646 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842cab7-6c3a-4166-93af-c2b849b8dbbb None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:00.329304 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2877f12-6955-4f58-bde8-e6cb71a5ac4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:00.329958 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2877f12-6955-4f58-bde8-e6cb71a5ac4c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:00.330243 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2877f12-6955-4f58-bde8-e6cb71a5ac4c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:00.330515 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2877f12-6955-4f58-bde8-e6cb71a5ac4c None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:00.331203 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2877f12-6955-4f58-bde8-e6cb71a5ac4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:00.331511 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2877f12-6955-4f58-bde8-e6cb71a5ac4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:00.333139 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2877f12-6955-4f58-bde8-e6cb71a5ac4c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:00.352465 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 12/25] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:29:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:00.358934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df36e3-4d69-4a8e-adcf-fbc01f7f766e None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:00.622209 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df36e3-4d69-4a8e-adcf-fbc01f7f766e None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:00.639161 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701c3f8-30a4-4ff0-8c40-fb6df4e7ebe5 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:00.639458 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701c3f8-30a4-4ff0-8c40-fb6df4e7ebe5 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:00.639919 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701c3f8-30a4-4ff0-8c40-fb6df4e7ebe5 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:00.641903 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 13/26] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:00.653996 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b271ea-036b-41ed-b419-af76fd247512 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:00.654608 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b271ea-036b-41ed-b419-af76fd247512 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:00.655072 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b271ea-036b-41ed-b419-af76fd247512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:00.689576 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8fc27-2a15-4446-98f4-6124d479fe61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:00.690356 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8fc27-2a15-4446-98f4-6124d479fe61 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:00.690637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8fc27-2a15-4446-98f4-6124d479fe61 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:00.690907 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8fc27-2a15-4446-98f4-6124d479fe61 None admin] PATH_INFO: `/v3/users/68623c0b9d92445197ab588b18e08f43` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:00.692744 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8fc27-2a15-4446-98f4-6124d479fe61 None admin] RBAC: Authorizing `identity:get_user(user_id=68623c0b9d92445197ab588b18e08f43)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:00.695909 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8fc27-2a15-4446-98f4-6124d479fe61 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:00.696075 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 14/27] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:29:00 2022] GET /identity/v3/users/68623c0b9d92445197ab588b18e08f43 => generated 247 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:00.697645 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-37b271ea-036b-41ed-b419-af76fd247512 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:00.699132 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-37b271ea-036b-41ed-b419-af76fd247512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:00.709682 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8fc27-2a15-4446-98f4-6124d479fe61 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:00.821318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:00.937673 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 14/28] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:29:00.946574 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8fc27-2a15-4446-98f4-6124d479fe61 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:01.018341 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15ecfc-b4d5-4ce6-a1c6-eb6b59a8d6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:01.019001 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15ecfc-b4d5-4ce6-a1c6-eb6b59a8d6ff None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:01.019276 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15ecfc-b4d5-4ce6-a1c6-eb6b59a8d6ff None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:01.019544 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15ecfc-b4d5-4ce6-a1c6-eb6b59a8d6ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:01.021943 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15ecfc-b4d5-4ce6-a1c6-eb6b59a8d6ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:01.023453 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15ecfc-b4d5-4ce6-a1c6-eb6b59a8d6ff None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:01.025182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 15/29] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:29:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:01.031259 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b271ea-036b-41ed-b419-af76fd247512 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:01.169046 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:01.201143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a2eee-c80b-43a9-a14d-cfd84dcc9b35 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:01.201313 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a2eee-c80b-43a9-a14d-cfd84dcc9b35 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:01.201588 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a2eee-c80b-43a9-a14d-cfd84dcc9b35 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:01.203238 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 16/30] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:01.209481 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ecdbf-89b3-44b9-8a16-e93572386be4 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:01.210075 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ecdbf-89b3-44b9-8a16-e93572386be4 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:01.210609 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ecdbf-89b3-44b9-8a16-e93572386be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:01.253051 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-051ecdbf-89b3-44b9-8a16-e93572386be4 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:01.255696 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-051ecdbf-89b3-44b9-8a16-e93572386be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:01.283410 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b271ea-036b-41ed-b419-af76fd247512 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:01.406534 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399c723-de3d-48bc-952b-e47d09f86c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:01.407689 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399c723-de3d-48bc-952b-e47d09f86c35 None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:01.408200 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399c723-de3d-48bc-952b-e47d09f86c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:01.408879 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399c723-de3d-48bc-952b-e47d09f86c35 None admin] PATH_INFO: `/v3/domains/default/users/68623c0b9d92445197ab588b18e08f43/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:01.412751 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399c723-de3d-48bc-952b-e47d09f86c35 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=68623c0b9d92445197ab588b18e08f43, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:01.415694 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d399c723-de3d-48bc-952b-e47d09f86c35 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:01.466649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 17/31] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:29:01.469261 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ecdbf-89b3-44b9-8a16-e93572386be4 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:01.588875 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:01.680921 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ecdbf-89b3-44b9-8a16-e93572386be4 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:01.701469 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 15/32] 10.222.0.66 () {58 vars in 1361 bytes} [Mon Sep 26 05:29:01 2022] PUT /identity/v3/domains/default/users/68623c0b9d92445197ab588b18e08f43/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:29:01.753778 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dca51a-4bb2-434a-a37b-a7bc3fe9ca8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:01.754463 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dca51a-4bb2-434a-a37b-a7bc3fe9ca8b None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:01.754800 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dca51a-4bb2-434a-a37b-a7bc3fe9ca8b None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:01.755076 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dca51a-4bb2-434a-a37b-a7bc3fe9ca8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:01.773419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dca51a-4bb2-434a-a37b-a7bc3fe9ca8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:01.775006 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dca51a-4bb2-434a-a37b-a7bc3fe9ca8b None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:01.795619 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9d496-a60f-48d7-8c39-fbdc5a9e173f None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:01.796605 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9d496-a60f-48d7-8c39-fbdc5a9e173f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:01.796901 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-f6dca51a-4bb2-434a-a37b-a7bc3fe9ca8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:29:01.796901 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:01.796901 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:01.796901 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:01.796901 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:01.796901 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:01.796901 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:01.796901 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:01.796901 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:01.796901 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:01.796901 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:01.796901 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:01.796901 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:29:01.796901 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:29:01.796901 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:29:01.796901 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:29:01.798472 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:01.798472 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:01.798472 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:01.798472 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:01.798472 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:01.798472 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:01.798472 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:01.798472 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:01.798472 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:01.798472 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:01.798472 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:01.798472 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:01.798472 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:01.798472 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:01.798472 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:01.798472 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:01.798472 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:29:01.800044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:29:01.800044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:29:01.800044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:29:01.800044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 18/33] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:29:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:29:01.801872 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9d496-a60f-48d7-8c39-fbdc5a9e173f None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:01.807776 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dca51a-4bb2-434a-a37b-a7bc3fe9ca8b None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:01.817253 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 16/34] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:01 2022] GET /identity => generated 270 bytes in 25 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:01.825233 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d88172-7cd8-43ac-bcdb-93c2504a6379 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:01.826084 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d88172-7cd8-43ac-bcdb-93c2504a6379 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:01.826839 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d88172-7cd8-43ac-bcdb-93c2504a6379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:01.874741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-85d88172-7cd8-43ac-bcdb-93c2504a6379 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:01.878008 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-85d88172-7cd8-43ac-bcdb-93c2504a6379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:02.038201 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:02.047008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dca51a-4bb2-434a-a37b-a7bc3fe9ca8b None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:02.091145 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 17/35] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:29:02.091783 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d88172-7cd8-43ac-bcdb-93c2504a6379 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:02.115219 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0893de-678f-49a6-85a8-f84b8d6ccf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:02.118389 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0893de-678f-49a6-85a8-f84b8d6ccf94 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:02.119097 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0893de-678f-49a6-85a8-f84b8d6ccf94 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:02.119894 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0893de-678f-49a6-85a8-f84b8d6ccf94 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:02.121306 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0893de-678f-49a6-85a8-f84b8d6ccf94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:02.122094 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0893de-678f-49a6-85a8-f84b8d6ccf94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:02.125030 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0893de-678f-49a6-85a8-f84b8d6ccf94 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:02.163100 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 19/36] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:02.169612 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0893de-678f-49a6-85a8-f84b8d6ccf94 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:02.197464 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:02.379677 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0893de-678f-49a6-85a8-f84b8d6ccf94 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:02.407876 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d88172-7cd8-43ac-bcdb-93c2504a6379 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:02.451354 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de3b24c-cccd-4185-a955-4fa1626104c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:02.452931 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3b24c-cccd-4185-a955-4fa1626104c6 None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:02.453659 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3b24c-cccd-4185-a955-4fa1626104c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:02.454347 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de3b24c-cccd-4185-a955-4fa1626104c6 None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:02.455657 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de3b24c-cccd-4185-a955-4fa1626104c6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:02.459220 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de3b24c-cccd-4185-a955-4fa1626104c6 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:02.557995 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbea3e-97b0-4ee7-956c-34ebc8f8d08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:02.558641 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbea3e-97b0-4ee7-956c-34ebc8f8d08b None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:02.558947 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbea3e-97b0-4ee7-956c-34ebc8f8d08b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:02.559380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbea3e-97b0-4ee7-956c-34ebc8f8d08b None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:02.560241 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcbea3e-97b0-4ee7-956c-34ebc8f8d08b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:02.561927 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcbea3e-97b0-4ee7-956c-34ebc8f8d08b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:02.603943 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 18/37] 10.222.0.66 () {60 vars in 1131 bytes} [Mon Sep 26 05:29:02 2022] POST /identity/v3/roles => generated 219 bytes in 512 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:02.605043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbea3e-97b0-4ee7-956c-34ebc8f8d08b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:02.727230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 20/38] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Sep 26 05:29:02 2022] POST /identity/v3/projects => generated 301 bytes in 559 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:02.830905 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbea3e-97b0-4ee7-956c-34ebc8f8d08b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:02.848739 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:02.881545 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b402c9-e85d-4676-b4fc-40e6e6027643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:02.882242 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b402c9-e85d-4676-b4fc-40e6e6027643 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:02.882532 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b402c9-e85d-4676-b4fc-40e6e6027643 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:02.882814 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b402c9-e85d-4676-b4fc-40e6e6027643 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:02.883572 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b402c9-e85d-4676-b4fc-40e6e6027643 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:02.885115 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b402c9-e85d-4676-b4fc-40e6e6027643 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:02.905848 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8baf99-b45b-46ba-90be-f1fe0b43f0e9 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:02.906507 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8baf99-b45b-46ba-90be-f1fe0b43f0e9 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:02.906981 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8baf99-b45b-46ba-90be-f1fe0b43f0e9 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:02.909066 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 21/39] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:02.914909 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 19/40] 10.222.0.66 () {60 vars in 1131 bytes} [Mon Sep 26 05:29:02 2022] POST /identity/v3/roles => generated 225 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:02.937555 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4209679-5bd4-44e0-b78d-d21a81a7e9b9 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:02.938273 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4209679-5bd4-44e0-b78d-d21a81a7e9b9 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:02.938803 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4209679-5bd4-44e0-b78d-d21a81a7e9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:02.968934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-f4209679-5bd4-44e0-b78d-d21a81a7e9b9 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:02.970948 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f4209679-5bd4-44e0-b78d-d21a81a7e9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:02.974006 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:03.025426 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44666d88-6af9-4db1-af00-2e19db219b9e None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:03.026199 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44666d88-6af9-4db1-af00-2e19db219b9e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:03.026681 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44666d88-6af9-4db1-af00-2e19db219b9e None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:03.028813 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 20/41] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:03.049910 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d1b45-417e-49fb-bebc-43472ba20f52 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:03.050541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d1b45-417e-49fb-bebc-43472ba20f52 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:03.051036 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d1b45-417e-49fb-bebc-43472ba20f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:03.083353 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-f65d1b45-417e-49fb-bebc-43472ba20f52 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:03.085268 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f65d1b45-417e-49fb-bebc-43472ba20f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:03.110094 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 22/42] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:29:03.203190 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 21/43] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:29:03.476388 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4209679-5bd4-44e0-b78d-d21a81a7e9b9 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:03.483979 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d1b45-417e-49fb-bebc-43472ba20f52 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:03.617332 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4209679-5bd4-44e0-b78d-d21a81a7e9b9 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:03.618458 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d1b45-417e-49fb-bebc-43472ba20f52 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:03.621531 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:03.673512 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55840287-868e-49a5-9899-d76020a06835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:03.674565 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55840287-868e-49a5-9899-d76020a06835 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:03.675026 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55840287-868e-49a5-9899-d76020a06835 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:03.675488 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55840287-868e-49a5-9899-d76020a06835 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:03.677342 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55840287-868e-49a5-9899-d76020a06835 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:03.677541 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92449b3e-4a15-447b-a8b0-5cc439b18a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:03.678162 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92449b3e-4a15-447b-a8b0-5cc439b18a1b None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:03.678438 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92449b3e-4a15-447b-a8b0-5cc439b18a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:03.678708 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92449b3e-4a15-447b-a8b0-5cc439b18a1b None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:03.679397 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92449b3e-4a15-447b-a8b0-5cc439b18a1b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:03.680029 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55840287-868e-49a5-9899-d76020a06835 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:03.680954 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92449b3e-4a15-447b-a8b0-5cc439b18a1b None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:03.683809 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 22/44] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:29:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:03.689043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55840287-868e-49a5-9899-d76020a06835 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:03.710319 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:03.717841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 23/45] 10.222.0.66 () {60 vars in 1131 bytes} [Mon Sep 26 05:29:03 2022] POST /identity/v3/roles => generated 223 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:03.940814 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55840287-868e-49a5-9899-d76020a06835 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:03.982075 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe91a72-ee7a-4d13-957f-4c989b64331c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:03.982886 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe91a72-ee7a-4d13-957f-4c989b64331c None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:03.983290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe91a72-ee7a-4d13-957f-4c989b64331c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:03.983683 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe91a72-ee7a-4d13-957f-4c989b64331c None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:03.984505 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe91a72-ee7a-4d13-957f-4c989b64331c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:03.986166 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe91a72-ee7a-4d13-957f-4c989b64331c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:04.026532 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 23/46] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Sep 26 05:29:03 2022] POST /identity/v3/projects => generated 312 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:04.705444 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320f625-9b4d-4e4c-80de-67fe2798d107 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:04.706188 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320f625-9b4d-4e4c-80de-67fe2798d107 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:04.706188 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320f625-9b4d-4e4c-80de-67fe2798d107 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:04.707634 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 24/47] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:04.714428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938c869-e40d-44bc-90ab-ae6b2bdbd463 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:04.715130 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938c869-e40d-44bc-90ab-ae6b2bdbd463 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:04.715659 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938c869-e40d-44bc-90ab-ae6b2bdbd463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:04.745889 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-3938c869-e40d-44bc-90ab-ae6b2bdbd463 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:04.748052 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3938c869-e40d-44bc-90ab-ae6b2bdbd463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:04.781839 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:04.872855 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 24/48] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:29:05.161631 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320f625-9b4d-4e4c-80de-67fe2798d107 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:05.293069 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320f625-9b4d-4e4c-80de-67fe2798d107 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:05.330716 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9481df-974d-433b-9d8a-ac31af3ae774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:05.331383 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9481df-974d-433b-9d8a-ac31af3ae774 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:05.331658 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9481df-974d-433b-9d8a-ac31af3ae774 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:05.331958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9481df-974d-433b-9d8a-ac31af3ae774 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:05.344623 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9481df-974d-433b-9d8a-ac31af3ae774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:29:05.349705 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-7b9481df-974d-433b-9d8a-ac31af3ae774 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:29:05.349705 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:05.349705 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:05.349705 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:05.349705 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:05.349705 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:05.349705 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:05.349705 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:05.349705 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:05.349705 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:05.349705 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:05.349705 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:05.349705 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:29:05.349705 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:29:05.349705 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:29:05.349705 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:29:05.351310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:29:05.351310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:29:05.351310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:29:05.351310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:29:05.351310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:05.351310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:05.351310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:05.351310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:05.351310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:05.351310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:05.351310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:05.351310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:05.351310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:05.351310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:05.351310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:05.351310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:05.352865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:05.352865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:05.352865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:05.352865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:05.352865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:29:05.352865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:29:05.352865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:29:05.352865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:29:05.352865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:29:05.352865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:29:05.352865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:29:05.352865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:29:05.352865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 25/49] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:29:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:29:05.360173 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938c869-e40d-44bc-90ab-ae6b2bdbd463 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:05.476723 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3938c869-e40d-44bc-90ab-ae6b2bdbd463 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:05.520123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afc1fc-9c68-48e4-bf8b-8dafe1cdf0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:05.521209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afc1fc-9c68-48e4-bf8b-8dafe1cdf0ab None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:05.521671 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afc1fc-9c68-48e4-bf8b-8dafe1cdf0ab None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:05.522143 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afc1fc-9c68-48e4-bf8b-8dafe1cdf0ab None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:05.523230 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31afc1fc-9c68-48e4-bf8b-8dafe1cdf0ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:05.523756 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31afc1fc-9c68-48e4-bf8b-8dafe1cdf0ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:05.525822 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31afc1fc-9c68-48e4-bf8b-8dafe1cdf0ab None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:05.539475 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 25/50] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:29:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:05.545536 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9481df-974d-433b-9d8a-ac31af3ae774 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:05.621898 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:05.684034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9481df-974d-433b-9d8a-ac31af3ae774 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:05.748517 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb2e5c-7fd2-4263-998b-126a0edc013e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:05.749530 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb2e5c-7fd2-4263-998b-126a0edc013e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:05.750068 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb2e5c-7fd2-4263-998b-126a0edc013e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:05.750556 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb2e5c-7fd2-4263-998b-126a0edc013e None admin] PATH_INFO: `/v3/users/68623c0b9d92445197ab588b18e08f43` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:05.752574 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb2e5c-7fd2-4263-998b-126a0edc013e None admin] RBAC: Authorizing `identity:get_user(user_id=68623c0b9d92445197ab588b18e08f43)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:05.755361 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb2e5c-7fd2-4263-998b-126a0edc013e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:05.758299 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 26/51] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:29:05 2022] GET /identity/v3/users/68623c0b9d92445197ab588b18e08f43 => generated 247 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:29:05.764953 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afc1fc-9c68-48e4-bf8b-8dafe1cdf0ab None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:05.797829 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:05.946239 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afc1fc-9c68-48e4-bf8b-8dafe1cdf0ab None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:06.009090 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071b344-2e5a-403a-a08b-40aa5817a4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:06.010074 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071b344-2e5a-403a-a08b-40aa5817a4d5 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:06.010580 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071b344-2e5a-403a-a08b-40aa5817a4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:06.011089 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071b344-2e5a-403a-a08b-40aa5817a4d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:06.013020 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c071b344-2e5a-403a-a08b-40aa5817a4d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:06.014649 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c071b344-2e5a-403a-a08b-40aa5817a4d5 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:06.016746 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 26/52] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:29:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:06.023786 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb2e5c-7fd2-4263-998b-126a0edc013e None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:06.178136 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb2e5c-7fd2-4263-998b-126a0edc013e None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:06.229993 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:06.243328 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4500ef-4944-4718-b4f4-65481c478f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:06.244082 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4500ef-4944-4718-b4f4-65481c478f16 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:06.244424 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4500ef-4944-4718-b4f4-65481c478f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:06.244771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4500ef-4944-4718-b4f4-65481c478f16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:06.245592 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4500ef-4944-4718-b4f4-65481c478f16 None admin] RBAC: Adding query filter params (role.id=cf58d66369044fb09fa65a4366dc7446, scope.domain.id=default, user.id=68623c0b9d92445197ab588b18e08f43) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:06.245960 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4500ef-4944-4718-b4f4-65481c478f16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:06.247537 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4500ef-4944-4718-b4f4-65481c478f16 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:06.259768 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 27/53] 10.222.0.66 () {56 vars in 1322 bytes} [Mon Sep 26 05:29:06 2022] GET /identity/v3/role_assignments?user.id=68623c0b9d92445197ab588b18e08f43&scope.domain.id=default&role.id=cf58d66369044fb09fa65a4366dc7446 => generated 530 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:06.466615 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dc17b-3187-4690-b89c-8062768e3476 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:06.467107 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dc17b-3187-4690-b89c-8062768e3476 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:06.467571 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dc17b-3187-4690-b89c-8062768e3476 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:06.470166 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 27/54] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:06.479329 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a340d-be97-4519-a714-958a8002f2f1 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:06.479715 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a340d-be97-4519-a714-958a8002f2f1 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:06.480172 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a340d-be97-4519-a714-958a8002f2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:06.627150 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-9a7a340d-be97-4519-a714-958a8002f2f1 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:06.628333 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-9a7a340d-be97-4519-a714-958a8002f2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:06.702813 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 28/55] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:29:06.968028 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789dc17b-3187-4690-b89c-8062768e3476 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:07.062333 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:07.082276 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789dc17b-3187-4690-b89c-8062768e3476 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:07.120747 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a875c-4277-40ca-a23b-b9776cb19993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:07.121436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a875c-4277-40ca-a23b-b9776cb19993 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:07.121693 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a875c-4277-40ca-a23b-b9776cb19993 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:07.121987 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a875c-4277-40ca-a23b-b9776cb19993 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:07.123186 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a875c-4277-40ca-a23b-b9776cb19993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:07.124724 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a875c-4277-40ca-a23b-b9776cb19993 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:07.126329 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 28/56] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:29:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:07.132461 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a340d-be97-4519-a714-958a8002f2f1 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:07.244776 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a340d-be97-4519-a714-958a8002f2f1 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:07.266565 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:07.282216 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52d2a6-29ee-488c-9b16-160b318bbc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:07.282842 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52d2a6-29ee-488c-9b16-160b318bbc6f None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:07.283117 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52d2a6-29ee-488c-9b16-160b318bbc6f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:07.283390 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52d2a6-29ee-488c-9b16-160b318bbc6f None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:07.284092 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52d2a6-29ee-488c-9b16-160b318bbc6f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:07.285560 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52d2a6-29ee-488c-9b16-160b318bbc6f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:07.314107 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 29/57] 10.222.0.66 () {60 vars in 1140 bytes} [Mon Sep 26 05:29:07 2022] POST /identity/v3/projects => generated 298 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:09.543503 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9d8c7-05b4-4f7d-a084-97fb89a8596f None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:09.544100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9d8c7-05b4-4f7d-a084-97fb89a8596f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:09.544290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9d8c7-05b4-4f7d-a084-97fb89a8596f None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:09.546010 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 29/58] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:09.552259 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908c60f-5886-4cc9-9d4a-b92838f02390 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:09.552958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908c60f-5886-4cc9-9d4a-b92838f02390 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:09.552958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908c60f-5886-4cc9-9d4a-b92838f02390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:09.572842 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-9908c60f-5886-4cc9-9d4a-b92838f02390 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:09.574060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-9908c60f-5886-4cc9-9d4a-b92838f02390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:09.650961 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 30/59] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:29:09.977834 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9d8c7-05b4-4f7d-a084-97fb89a8596f None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:10.151655 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9d8c7-05b4-4f7d-a084-97fb89a8596f None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:10.195836 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636a649-2a37-41e8-91bc-25173e97ecf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:10.196496 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636a649-2a37-41e8-91bc-25173e97ecf7 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:10.196772 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636a649-2a37-41e8-91bc-25173e97ecf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:10.197039 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636a649-2a37-41e8-91bc-25173e97ecf7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:10.198223 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636a649-2a37-41e8-91bc-25173e97ecf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:10.199767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636a649-2a37-41e8-91bc-25173e97ecf7 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:10.201766 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 30/60] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:29:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:10.208523 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908c60f-5886-4cc9-9d4a-b92838f02390 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:10.388419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908c60f-5886-4cc9-9d4a-b92838f02390 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:10.390367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:10.447235 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaa05fb-195e-40bc-9ad1-ad8c3a3fdbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:10.448324 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa05fb-195e-40bc-9ad1-ad8c3a3fdbf2 None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:10.448823 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa05fb-195e-40bc-9ad1-ad8c3a3fdbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:10.449176 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaa05fb-195e-40bc-9ad1-ad8c3a3fdbf2 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:10.449907 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa05fb-195e-40bc-9ad1-ad8c3a3fdbf2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:10.453027 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaa05fb-195e-40bc-9ad1-ad8c3a3fdbf2 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:10.492116 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 31/61] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 26 05:29:10 2022] POST /identity/v3/users => generated 275 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:14.346799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bd66f-b543-4bda-a220-3afb88f2d10d None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:14.347712 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bd66f-b543-4bda-a220-3afb88f2d10d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:14.348236 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bd66f-b543-4bda-a220-3afb88f2d10d None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:14.350173 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 31/62] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:14.356271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b2017-cec0-47d6-8d1e-79870411b48c None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:14.357175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b2017-cec0-47d6-8d1e-79870411b48c None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:14.357642 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b2017-cec0-47d6-8d1e-79870411b48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:14.381612 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-555b2017-cec0-47d6-8d1e-79870411b48c None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:14.383178 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-555b2017-cec0-47d6-8d1e-79870411b48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:14.466085 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 32/63] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:29:14.642732 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd3c5d-ba8a-4612-9be9-6e2567967fca None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:14.643337 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd3c5d-ba8a-4612-9be9-6e2567967fca None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:14.643830 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd3c5d-ba8a-4612-9be9-6e2567967fca None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:14.645693 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 32/64] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:14.651414 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764094d2-b5b5-490f-8d12-a986fca673bc None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:14.652093 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764094d2-b5b5-490f-8d12-a986fca673bc None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:14.652593 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764094d2-b5b5-490f-8d12-a986fca673bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:14.679889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-764094d2-b5b5-490f-8d12-a986fca673bc None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:14.681624 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-764094d2-b5b5-490f-8d12-a986fca673bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:14.772881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 33/65] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:29:14.824802 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd3c5d-ba8a-4612-9be9-6e2567967fca None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:14.857400 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:14.975843 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd3c5d-ba8a-4612-9be9-6e2567967fca None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:15.046433 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bd834-d2f6-4ece-87d1-0e9385f87aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:15.049626 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bd834-d2f6-4ece-87d1-0e9385f87aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:15.050079 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bd834-d2f6-4ece-87d1-0e9385f87aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:15.050513 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bd834-d2f6-4ece-87d1-0e9385f87aa5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:15.076998 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930bd834-d2f6-4ece-87d1-0e9385f87aa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:29:15.082741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-930bd834-d2f6-4ece-87d1-0e9385f87aa5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:29:15.082741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:15.082741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:15.082741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:15.082741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:15.082741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:15.082741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:15.082741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:15.082741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:15.082741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:15.082741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:15.082741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:15.082741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:29:15.082741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:29:15.082741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:29:15.082741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:29:15.083912 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:29:15.083912 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:29:15.083912 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:29:15.083912 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:29:15.083912 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:15.083912 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:15.083912 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:15.083912 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:15.083912 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:15.083912 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:15.083912 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:15.083912 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:15.083912 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:15.083912 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:15.083912 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:15.083912 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:15.084788 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:15.084788 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:15.084788 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:15.084788 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:15.084788 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:29:15.084788 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:29:15.084788 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:29:15.084788 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:29:15.084788 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:29:15.084788 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:29:15.084788 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:29:15.084788 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:29:15.086830 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 33/66] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:29:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:29:15.093107 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764094d2-b5b5-490f-8d12-a986fca673bc None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:15.096874 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bd834-d2f6-4ece-87d1-0e9385f87aa5 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:15.118127 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:15.210895 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:15.226542 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764094d2-b5b5-490f-8d12-a986fca673bc None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:15.239148 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bd834-d2f6-4ece-87d1-0e9385f87aa5 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:15.282927 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ee5ca-39c6-4246-b6ca-f6550b40719d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:15.284444 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ee5ca-39c6-4246-b6ca-f6550b40719d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:15.285095 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ee5ca-39c6-4246-b6ca-f6550b40719d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:15.285873 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ee5ca-39c6-4246-b6ca-f6550b40719d None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:15.287096 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ee5ca-39c6-4246-b6ca-f6550b40719d None admin] RBAC: Adding query filter params (name=member) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:15.287557 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ee5ca-39c6-4246-b6ca-f6550b40719d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:15.290186 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ee5ca-39c6-4246-b6ca-f6550b40719d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:15.298360 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d65379-3523-4233-9782-ece080d4147c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:15.299315 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d65379-3523-4233-9782-ece080d4147c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:15.299764 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d65379-3523-4233-9782-ece080d4147c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:15.300179 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d65379-3523-4233-9782-ece080d4147c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:15.306939 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 34/67] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 26 05:29:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:29:15.310037 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9a619-eeeb-43c7-8173-ce45160bca01 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:15.310797 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9a619-eeeb-43c7-8173-ce45160bca01 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:15.311496 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9a619-eeeb-43c7-8173-ce45160bca01 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:15.314666 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 35/68] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:15.316663 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ddba7-ac38-4b92-8054-9d7158b325a1 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:15.317106 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ddba7-ac38-4b92-8054-9d7158b325a1 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:15.317529 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31ddba7-ac38-4b92-8054-9d7158b325a1 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:15.320009 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 36/69] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:15.324770 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ddba7-ac38-4b92-8054-9d7158b325a1 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:15.331816 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d65379-3523-4233-9782-ece080d4147c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:29:15.341451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-d4d65379-3523-4233-9782-ece080d4147c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:29:15.341451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:15.341451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:15.341451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:15.341451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:15.341451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:15.341451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:15.341451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:15.341451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:15.341451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:15.341451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:15.341451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:15.341451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:29:15.341451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:29:15.341451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:29:15.341451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:29:15.343064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:29:15.343064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:29:15.343064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:29:15.343064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:29:15.343064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:15.343064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:15.343064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:15.343064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:15.343064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:15.343064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:15.343064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:15.343064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:15.343064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:15.343064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:15.343064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:15.343064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:15.344558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:15.344558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:15.344558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:15.344558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:15.344558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:29:15.344558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:29:15.344558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:29:15.344558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:29:15.344558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:29:15.344558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:29:15.344558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:29:15.344558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:29:15.344558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 34/70] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 26 05:29:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:29:15.345681 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2393156-2145-4ff1-84a1-484dd5b01fc0 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:15.345681 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2393156-2145-4ff1-84a1-484dd5b01fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:15.345681 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2393156-2145-4ff1-84a1-484dd5b01fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:15.366043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-e2393156-2145-4ff1-84a1-484dd5b01fc0 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:15.367388 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e2393156-2145-4ff1-84a1-484dd5b01fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:15.472983 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:15.503856 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 35/71] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:29:15.503856 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09876fe9-277b-4966-ac8f-daefd9bb9559 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:15.503856 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09876fe9-277b-4966-ac8f-daefd9bb9559 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:15.503856 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09876fe9-277b-4966-ac8f-daefd9bb9559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:15.518174 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31ddba7-ac38-4b92-8054-9d7158b325a1 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:15.528487 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-09876fe9-277b-4966-ac8f-daefd9bb9559 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:15.530276 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-09876fe9-277b-4966-ac8f-daefd9bb9559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:15.578037 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8859c-e01b-400a-bc72-ed08bd507087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:15.578992 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8859c-e01b-400a-bc72-ed08bd507087 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:15.579410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8859c-e01b-400a-bc72-ed08bd507087 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:15.579847 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8859c-e01b-400a-bc72-ed08bd507087 None admin] PATH_INFO: `/v3/users/79a88eb97e944d76b6e903c71c5cf94c` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:15.607851 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8859c-e01b-400a-bc72-ed08bd507087 None admin] RBAC: Authorizing `identity:get_user(user_id=79a88eb97e944d76b6e903c71c5cf94c)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:15.610715 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8859c-e01b-400a-bc72-ed08bd507087 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:15.613852 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 37/72] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:29:15 2022] GET /identity/v3/users/79a88eb97e944d76b6e903c71c5cf94c => generated 275 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:15.621442 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8859c-e01b-400a-bc72-ed08bd507087 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:15.645771 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:15.654084 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 36/73] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:29:15.662043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09876fe9-277b-4966-ac8f-daefd9bb9559 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:15.865790 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8859c-e01b-400a-bc72-ed08bd507087 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:15.896056 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09876fe9-277b-4966-ac8f-daefd9bb9559 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:15.916972 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a95a9e-5911-4532-a6bb-548affb8d766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:15.918278 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a95a9e-5911-4532-a6bb-548affb8d766 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:15.918732 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a95a9e-5911-4532-a6bb-548affb8d766 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:15.919195 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a95a9e-5911-4532-a6bb-548affb8d766 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:15.920376 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a95a9e-5911-4532-a6bb-548affb8d766 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:15.920863 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a95a9e-5911-4532-a6bb-548affb8d766 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:15.923427 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a95a9e-5911-4532-a6bb-548affb8d766 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:15.932958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:15.938114 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 38/74] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:29:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:15.940765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a95a9e-5911-4532-a6bb-548affb8d766 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:15.945317 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af7dd4-a2dd-4c62-9bb9-134ee9aa34a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:15.946329 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af7dd4-a2dd-4c62-9bb9-134ee9aa34a2 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:15.946798 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af7dd4-a2dd-4c62-9bb9-134ee9aa34a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:15.947252 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af7dd4-a2dd-4c62-9bb9-134ee9aa34a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:16.053851 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:16.057816 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af7dd4-a2dd-4c62-9bb9-134ee9aa34a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:16.061917 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af7dd4-a2dd-4c62-9bb9-134ee9aa34a2 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:16.102116 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a95a9e-5911-4532-a6bb-548affb8d766 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:16.159223 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48453b-0975-47f7-a452-5d3eb1efa511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:16.160188 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48453b-0975-47f7-a452-5d3eb1efa511 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:16.160623 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48453b-0975-47f7-a452-5d3eb1efa511 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:16.161054 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48453b-0975-47f7-a452-5d3eb1efa511 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:16.179494 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48453b-0975-47f7-a452-5d3eb1efa511 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:29:16.188160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-ab48453b-0975-47f7-a452-5d3eb1efa511 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:29:16.188160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:16.188160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:16.188160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:16.188160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:16.188160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:16.188160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:16.188160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:16.188160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:16.188160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:16.188160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:16.188160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:16.188160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:29:16.188160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:29:16.188160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:29:16.188160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:29:16.189249 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:29:16.189249 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:29:16.189249 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:29:16.189249 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:29:16.189249 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:16.189249 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:16.189249 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:16.189249 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:16.189249 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:16.189249 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:16.189249 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:16.189249 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:16.189249 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:16.189249 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:16.189249 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:16.189249 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:16.190018 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:16.190018 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:16.190018 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:16.190018 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:16.190018 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:29:16.190018 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:29:16.190018 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:29:16.190018 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:29:16.190018 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:29:16.190018 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:29:16.190018 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:29:16.190018 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:29:16.190018 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 39/75] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:29:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:29:16.194012 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9596b3-f8df-4b9e-a382-1d6e441a9dc5 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:16.194426 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9596b3-f8df-4b9e-a382-1d6e441a9dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:16.194584 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9596b3-f8df-4b9e-a382-1d6e441a9dc5 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:16.197206 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 40/76] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:16.197206 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9596b3-f8df-4b9e-a382-1d6e441a9dc5 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:16.226524 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 37/77] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:29:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:16.229168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af7dd4-a2dd-4c62-9bb9-134ee9aa34a2 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:16.274003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:16.334022 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9596b3-f8df-4b9e-a382-1d6e441a9dc5 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:16.348885 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:16.352832 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af7dd4-a2dd-4c62-9bb9-134ee9aa34a2 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:16.376192 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe0b85-a32c-4659-8880-cac8f40c37e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:16.376850 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe0b85-a32c-4659-8880-cac8f40c37e6 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:16.377128 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe0b85-a32c-4659-8880-cac8f40c37e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:16.377405 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe0b85-a32c-4659-8880-cac8f40c37e6 None admin] PATH_INFO: `/v3/users/79a88eb97e944d76b6e903c71c5cf94c` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:16.378633 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe0b85-a32c-4659-8880-cac8f40c37e6 None admin] RBAC: Authorizing `identity:get_user(user_id=79a88eb97e944d76b6e903c71c5cf94c)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:16.380186 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe0b85-a32c-4659-8880-cac8f40c37e6 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:16.382232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 41/78] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:29:16 2022] GET /identity/v3/users/79a88eb97e944d76b6e903c71c5cf94c => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:16.382730 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe0b85-a32c-4659-8880-cac8f40c37e6 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:16.397872 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9639e-e123-4995-82ad-32614b0bda0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:16.398737 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9639e-e123-4995-82ad-32614b0bda0b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:16.398966 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9639e-e123-4995-82ad-32614b0bda0b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:16.399416 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9639e-e123-4995-82ad-32614b0bda0b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:16.412591 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9639e-e123-4995-82ad-32614b0bda0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:29:16.418699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-44f9639e-e123-4995-82ad-32614b0bda0b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:29:16.418699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:16.418699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:16.418699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:16.418699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:16.418699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:16.418699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:16.418699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:16.418699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:16.418699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:16.418699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:16.418699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:16.418699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:29:16.418699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:29:16.418699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:29:16.418699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:29:16.422769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:29:16.422769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:29:16.422769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:29:16.422769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:29:16.422769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:16.422769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:16.422769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:16.422769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:16.422769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:16.422769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:16.422769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:16.422769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:16.422769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:16.422769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:16.422769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:16.422769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:16.424305 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:16.424305 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:16.424305 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:16.424305 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:16.424305 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:29:16.424305 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:29:16.424305 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:29:16.424305 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:29:16.424305 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:29:16.424305 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:29:16.424305 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:29:16.424305 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:29:16.424305 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 38/79] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:29:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:29:16.424305 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94598ef7-5cb7-4541-8dc7-a46aaa12cb2c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:16.426613 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94598ef7-5cb7-4541-8dc7-a46aaa12cb2c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:16.426613 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94598ef7-5cb7-4541-8dc7-a46aaa12cb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:16.447469 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-94598ef7-5cb7-4541-8dc7-a46aaa12cb2c None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:16.449107 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-94598ef7-5cb7-4541-8dc7-a46aaa12cb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:16.516262 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe0b85-a32c-4659-8880-cac8f40c37e6 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:16.538103 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 39/80] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:29:16.539214 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94598ef7-5cb7-4541-8dc7-a46aaa12cb2c None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:16.566074 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:16.580056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ddf841-81f5-4363-9ab4-61876f9bfd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:16.580754 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddf841-81f5-4363-9ab4-61876f9bfd4f None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:16.581220 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddf841-81f5-4363-9ab4-61876f9bfd4f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:16.581772 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddf841-81f5-4363-9ab4-61876f9bfd4f None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:16.582655 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ddf841-81f5-4363-9ab4-61876f9bfd4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:16.583140 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ddf841-81f5-4363-9ab4-61876f9bfd4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:16.585536 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ddf841-81f5-4363-9ab4-61876f9bfd4f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:16.599064 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 42/81] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:29:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:16.601390 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ddf841-81f5-4363-9ab4-61876f9bfd4f None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:16.697290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:16.725907 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94598ef7-5cb7-4541-8dc7-a46aaa12cb2c None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:16.768265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ddf841-81f5-4363-9ab4-61876f9bfd4f None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:16.792899 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c16a4-c296-4463-b3a9-2b779a7d38c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:16.793802 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c16a4-c296-4463-b3a9-2b779a7d38c2 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:16.794241 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c16a4-c296-4463-b3a9-2b779a7d38c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:16.794698 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c16a4-c296-4463-b3a9-2b779a7d38c2 None admin] PATH_INFO: `/v3/projects/f36f364f981e4cbb8bca50ac93a26b16` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:16.796624 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c16a4-c296-4463-b3a9-2b779a7d38c2 None admin] RBAC: Authorizing `identity:get_project(project_id=f36f364f981e4cbb8bca50ac93a26b16)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:16.799133 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c16a4-c296-4463-b3a9-2b779a7d38c2 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:16.802082 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 40/82] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:29:16 2022] GET /identity/v3/projects/f36f364f981e4cbb8bca50ac93a26b16 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:16.809913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c16a4-c296-4463-b3a9-2b779a7d38c2 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:16.818989 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0bf91-0822-4a3f-9666-129ab77f7bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:16.820006 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0bf91-0822-4a3f-9666-129ab77f7bbc None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:16.820452 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0bf91-0822-4a3f-9666-129ab77f7bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:16.820884 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f0bf91-0822-4a3f-9666-129ab77f7bbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:16.923613 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:16.938468 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0bf91-0822-4a3f-9666-129ab77f7bbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:16.940125 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f0bf91-0822-4a3f-9666-129ab77f7bbc None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:16.971384 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c16a4-c296-4463-b3a9-2b779a7d38c2 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:17.017294 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45044b-dd7e-4b0f-88d4-7e2579568370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:17.018141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45044b-dd7e-4b0f-88d4-7e2579568370 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:17.018542 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45044b-dd7e-4b0f-88d4-7e2579568370 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:17.018941 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45044b-dd7e-4b0f-88d4-7e2579568370 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:17.019809 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45044b-dd7e-4b0f-88d4-7e2579568370 None admin] RBAC: Adding query filter params (name=member) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:17.020228 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45044b-dd7e-4b0f-88d4-7e2579568370 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:17.021956 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45044b-dd7e-4b0f-88d4-7e2579568370 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:17.032833 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 41/83] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 26 05:29:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:17.033931 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45044b-dd7e-4b0f-88d4-7e2579568370 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:17.063778 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:17.078378 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 43/84] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:29:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:17.079844 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0bf91-0822-4a3f-9666-129ab77f7bbc None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:17.171565 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45044b-dd7e-4b0f-88d4-7e2579568370 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:17.191117 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:17.204034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f0bf91-0822-4a3f-9666-129ab77f7bbc None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:17.213763 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d1b47-476b-4e39-8d62-212cf04bae1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:17.214546 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d1b47-476b-4e39-8d62-212cf04bae1f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:17.214908 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d1b47-476b-4e39-8d62-212cf04bae1f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:17.215367 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8d1b47-476b-4e39-8d62-212cf04bae1f None admin] PATH_INFO: `/v3/users/68623c0b9d92445197ab588b18e08f43` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:17.216948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d1b47-476b-4e39-8d62-212cf04bae1f None admin] RBAC: Authorizing `identity:get_user(user_id=68623c0b9d92445197ab588b18e08f43)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:17.218808 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8d1b47-476b-4e39-8d62-212cf04bae1f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:17.220904 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 42/85] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:29:17 2022] GET /identity/v3/users/68623c0b9d92445197ab588b18e08f43 => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:17.222274 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d1b47-476b-4e39-8d62-212cf04bae1f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:17.256396 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb045dd0-99aa-456f-a7d7-61aaf2c46a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:17.257149 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb045dd0-99aa-456f-a7d7-61aaf2c46a33 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:17.257536 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb045dd0-99aa-456f-a7d7-61aaf2c46a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:17.257933 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb045dd0-99aa-456f-a7d7-61aaf2c46a33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:17.258816 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb045dd0-99aa-456f-a7d7-61aaf2c46a33 None admin] RBAC: Adding query filter params (role.id=c5a02c4618d94f1da7257ef437b8ce9e, scope.project.id=f36f364f981e4cbb8bca50ac93a26b16, user.id=79a88eb97e944d76b6e903c71c5cf94c) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:17.259292 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb045dd0-99aa-456f-a7d7-61aaf2c46a33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:17.261142 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb045dd0-99aa-456f-a7d7-61aaf2c46a33 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:17.267629 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 44/86] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:29:17 2022] GET /identity/v3/role_assignments?user.id=79a88eb97e944d76b6e903c71c5cf94c&scope.project.id=f36f364f981e4cbb8bca50ac93a26b16&role.id=c5a02c4618d94f1da7257ef437b8ce9e => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:17.269107 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb045dd0-99aa-456f-a7d7-61aaf2c46a33 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:17.354626 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:17.379893 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8d1b47-476b-4e39-8d62-212cf04bae1f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:17.428741 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb045dd0-99aa-456f-a7d7-61aaf2c46a33 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:17.445249 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874d472-6254-48d6-90d2-0063b29c22a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:17.446700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874d472-6254-48d6-90d2-0063b29c22a3 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:17.447216 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874d472-6254-48d6-90d2-0063b29c22a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:17.448415 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874d472-6254-48d6-90d2-0063b29c22a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:17.451210 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874d472-6254-48d6-90d2-0063b29c22a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:17.454703 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874d472-6254-48d6-90d2-0063b29c22a3 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:17.459680 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 43/87] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:29:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:17.460863 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874d472-6254-48d6-90d2-0063b29c22a3 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:17.478497 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90811be8-d51e-4dd3-971f-bf9bf0bd5782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:17.480265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90811be8-d51e-4dd3-971f-bf9bf0bd5782 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:17.480682 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90811be8-d51e-4dd3-971f-bf9bf0bd5782 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:17.481092 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90811be8-d51e-4dd3-971f-bf9bf0bd5782 None admin] PATH_INFO: `/v3/users/79a88eb97e944d76b6e903c71c5cf94c` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:17.482570 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90811be8-d51e-4dd3-971f-bf9bf0bd5782 None admin] RBAC: Authorizing `identity:get_user(user_id=79a88eb97e944d76b6e903c71c5cf94c)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:17.484577 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90811be8-d51e-4dd3-971f-bf9bf0bd5782 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:17.494479 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 45/88] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:29:17 2022] GET /identity/v3/users/79a88eb97e944d76b6e903c71c5cf94c => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:17.494479 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90811be8-d51e-4dd3-971f-bf9bf0bd5782 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:17.528272 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:17.632488 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874d472-6254-48d6-90d2-0063b29c22a3 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:17.675554 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea34e8-dda6-4021-a852-ab0db1a2671c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:17.676406 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea34e8-dda6-4021-a852-ab0db1a2671c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:17.676851 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea34e8-dda6-4021-a852-ab0db1a2671c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:17.677167 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea34e8-dda6-4021-a852-ab0db1a2671c None admin] PATH_INFO: `/v3/projects/f36f364f981e4cbb8bca50ac93a26b16` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:17.678661 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea34e8-dda6-4021-a852-ab0db1a2671c None admin] RBAC: Authorizing `identity:get_project(project_id=f36f364f981e4cbb8bca50ac93a26b16)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:17.680290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea34e8-dda6-4021-a852-ab0db1a2671c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:17.682086 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 44/89] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:29:17 2022] GET /identity/v3/projects/f36f364f981e4cbb8bca50ac93a26b16 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:17.682856 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90811be8-d51e-4dd3-971f-bf9bf0bd5782 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:17.683385 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea34e8-dda6-4021-a852-ab0db1a2671c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:17.730275 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:17.753140 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0a00e-c7e8-4d22-adb4-80e55a98c737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:17.754189 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0a00e-c7e8-4d22-adb4-80e55a98c737 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:17.754661 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0a00e-c7e8-4d22-adb4-80e55a98c737 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:17.755131 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0a00e-c7e8-4d22-adb4-80e55a98c737 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:17.830720 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea34e8-dda6-4021-a852-ab0db1a2671c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:17.874204 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426cc39-78bf-414c-a9d6-186b8d29b88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:17.875171 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426cc39-78bf-414c-a9d6-186b8d29b88c None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:17.875671 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426cc39-78bf-414c-a9d6-186b8d29b88c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:17.876186 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426cc39-78bf-414c-a9d6-186b8d29b88c None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:17.877065 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426cc39-78bf-414c-a9d6-186b8d29b88c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:17.878998 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426cc39-78bf-414c-a9d6-186b8d29b88c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:17.884730 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0a00e-c7e8-4d22-adb4-80e55a98c737 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:17.887434 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0a00e-c7e8-4d22-adb4-80e55a98c737 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:17.915054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 45/90] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 26 05:29:17 2022] POST /identity/v3/users => generated 289 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:17.916930 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426cc39-78bf-414c-a9d6-186b8d29b88c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:17.949976 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:18.086514 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:18.106327 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 46/91] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:29:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:18.113992 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0a00e-c7e8-4d22-adb4-80e55a98c737 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:18.128436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426cc39-78bf-414c-a9d6-186b8d29b88c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:18.205754 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dc0d5-d7eb-4a5e-b4c6-ba085968106c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:18.207055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dc0d5-d7eb-4a5e-b4c6-ba085968106c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:18.207633 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dc0d5-d7eb-4a5e-b4c6-ba085968106c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:18.208151 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dc0d5-d7eb-4a5e-b4c6-ba085968106c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:18.306065 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0a00e-c7e8-4d22-adb4-80e55a98c737 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:18.339253 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988dc0d5-d7eb-4a5e-b4c6-ba085968106c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:18.341823 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988dc0d5-d7eb-4a5e-b4c6-ba085968106c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:18.350950 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:18.380274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fda68a-6724-4a2e-a4a5-3b0c2ee1c317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:18.381354 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fda68a-6724-4a2e-a4a5-3b0c2ee1c317 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:18.381798 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fda68a-6724-4a2e-a4a5-3b0c2ee1c317 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:18.382229 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fda68a-6724-4a2e-a4a5-3b0c2ee1c317 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:18.383898 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fda68a-6724-4a2e-a4a5-3b0c2ee1c317 None admin] RBAC: Adding query filter params (role.id=7cb00fff13fb4eefa6a734c91c0d59ea, scope.project.id=f36f364f981e4cbb8bca50ac93a26b16, user.id=79a88eb97e944d76b6e903c71c5cf94c) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:18.384394 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fda68a-6724-4a2e-a4a5-3b0c2ee1c317 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:18.387638 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fda68a-6724-4a2e-a4a5-3b0c2ee1c317 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:18.399859 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 47/92] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:29:18 2022] GET /identity/v3/role_assignments?user.id=79a88eb97e944d76b6e903c71c5cf94c&scope.project.id=f36f364f981e4cbb8bca50ac93a26b16&role.id=7cb00fff13fb4eefa6a734c91c0d59ea => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:18.401137 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fda68a-6724-4a2e-a4a5-3b0c2ee1c317 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:18.548373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:18.568827 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 46/93] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:29:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:18.578653 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dc0d5-d7eb-4a5e-b4c6-ba085968106c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:18.622371 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fda68a-6724-4a2e-a4a5-3b0c2ee1c317 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:18.716121 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ee720-c236-4958-9d54-68dec351d318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:18.717216 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ee720-c236-4958-9d54-68dec351d318 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:18.717701 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ee720-c236-4958-9d54-68dec351d318 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:18.718166 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ee720-c236-4958-9d54-68dec351d318 None admin] PATH_INFO: `/v3/projects/f36f364f981e4cbb8bca50ac93a26b16` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:18.723769 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ee720-c236-4958-9d54-68dec351d318 None admin] RBAC: Authorizing `identity:get_project(project_id=f36f364f981e4cbb8bca50ac93a26b16)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:18.727094 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ee720-c236-4958-9d54-68dec351d318 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:18.733959 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 48/94] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:29:18 2022] GET /identity/v3/projects/f36f364f981e4cbb8bca50ac93a26b16 => generated 298 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:18.743464 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ee720-c236-4958-9d54-68dec351d318 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:18.826356 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dc0d5-d7eb-4a5e-b4c6-ba085968106c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:18.897634 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f907d-220e-4790-84e9-8020b62c0a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:18.898692 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f907d-220e-4790-84e9-8020b62c0a08 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:18.899163 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f907d-220e-4790-84e9-8020b62c0a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:18.899658 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f907d-220e-4790-84e9-8020b62c0a08 None admin] PATH_INFO: `/v3/projects/bcf2f6a7c6e84ca9a2f7a3c3f3f878e0` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:18.905014 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f907d-220e-4790-84e9-8020b62c0a08 None admin] RBAC: Authorizing `identity:get_project(project_id=bcf2f6a7c6e84ca9a2f7a3c3f3f878e0)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:18.907984 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f907d-220e-4790-84e9-8020b62c0a08 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:18.911338 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 47/95] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:29:18 2022] GET /identity/v3/projects/bcf2f6a7c6e84ca9a2f7a3c3f3f878e0 => generated 312 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:18.921657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f907d-220e-4790-84e9-8020b62c0a08 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:18.970530 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:19.032176 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:19.123026 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f907d-220e-4790-84e9-8020b62c0a08 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:19.134735 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ee720-c236-4958-9d54-68dec351d318 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:19.209643 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8c628-9a57-421c-a97a-f277e2c820c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:19.211021 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8c628-9a57-421c-a97a-f277e2c820c4 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:19.211461 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8c628-9a57-421c-a97a-f277e2c820c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:19.211909 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8c628-9a57-421c-a97a-f277e2c820c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:19.213040 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8c628-9a57-421c-a97a-f277e2c820c4 None admin] RBAC: Adding query filter params (role.id=c5a02c4618d94f1da7257ef437b8ce9e, scope.project.id=bcf2f6a7c6e84ca9a2f7a3c3f3f878e0, user.id=79a88eb97e944d76b6e903c71c5cf94c) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:19.213528 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8c628-9a57-421c-a97a-f277e2c820c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:19.224645 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8c628-9a57-421c-a97a-f277e2c820c4 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:19.264342 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 48/96] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:29:18 2022] GET /identity/v3/role_assignments?user.id=79a88eb97e944d76b6e903c71c5cf94c&scope.project.id=bcf2f6a7c6e84ca9a2f7a3c3f3f878e0&role.id=c5a02c4618d94f1da7257ef437b8ce9e => generated 259 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:19.264921 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f572d3-4127-432d-8db5-2f74c343b6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:19.266119 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f572d3-4127-432d-8db5-2f74c343b6ae None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:19.266613 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f572d3-4127-432d-8db5-2f74c343b6ae None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:19.267069 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f572d3-4127-432d-8db5-2f74c343b6ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:19.268484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f572d3-4127-432d-8db5-2f74c343b6ae None admin] RBAC: Adding query filter params (role.id=cf58d66369044fb09fa65a4366dc7446, scope.project.id=f36f364f981e4cbb8bca50ac93a26b16, user.id=68623c0b9d92445197ab588b18e08f43) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:19.269026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f572d3-4127-432d-8db5-2f74c343b6ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:19.271789 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f572d3-4127-432d-8db5-2f74c343b6ae None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:19.288960 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 49/97] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:29:18 2022] GET /identity/v3/role_assignments?user.id=68623c0b9d92445197ab588b18e08f43&scope.project.id=f36f364f981e4cbb8bca50ac93a26b16&role.id=cf58d66369044fb09fa65a4366dc7446 => generated 259 bytes in 546 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:29:20.581682 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b47c4-347c-421b-a75e-830f719fffbc None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:20.582514 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b47c4-347c-421b-a75e-830f719fffbc None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:20.582644 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b47c4-347c-421b-a75e-830f719fffbc None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:20.585231 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 49/98] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:29:20.594449 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31967599-c9ce-401e-8f94-b17136f06b10 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:20.595233 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31967599-c9ce-401e-8f94-b17136f06b10 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:20.595377 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31967599-c9ce-401e-8f94-b17136f06b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:20.635286 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-31967599-c9ce-401e-8f94-b17136f06b10 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:20.637476 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-31967599-c9ce-401e-8f94-b17136f06b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:20.814452 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 50/99] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:29:21.838171 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b47c4-347c-421b-a75e-830f719fffbc None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:21.974785 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b47c4-347c-421b-a75e-830f719fffbc None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:21.991935 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:22.016050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0baa042-54b4-4ab6-aeb2-7c23954483fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:22.016713 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0baa042-54b4-4ab6-aeb2-7c23954483fb None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:22.016988 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0baa042-54b4-4ab6-aeb2-7c23954483fb None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:22.017259 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0baa042-54b4-4ab6-aeb2-7c23954483fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:22.030186 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0baa042-54b4-4ab6-aeb2-7c23954483fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:29:22.035168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-d0baa042-54b4-4ab6-aeb2-7c23954483fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:29:22.035168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:22.035168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:22.035168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:22.035168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:22.035168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:22.035168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:22.035168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:22.035168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:22.035168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:22.035168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:22.035168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:22.035168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:29:22.035168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:29:22.035168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:29:22.035168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:29:22.036821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:29:22.036821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:29:22.036821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:29:22.036821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:29:22.036821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:22.036821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:22.036821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:22.036821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:22.036821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:22.036821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:22.036821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:22.036821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:22.036821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:22.036821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:22.036821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:22.036821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:22.038445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:22.038445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:22.038445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:22.038445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:22.038445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:29:22.038445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:29:22.038445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:29:22.038445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:29:22.038445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:29:22.038445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:29:22.038445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:29:22.038445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:29:22.038445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 50/100] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:29:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:29:22.045613 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31967599-c9ce-401e-8f94-b17136f06b10 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:22.183658 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:22.305534 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31967599-c9ce-401e-8f94-b17136f06b10 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:22.370190 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62816d-21c3-48ce-b1ca-034274355232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:22.371219 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62816d-21c3-48ce-b1ca-034274355232 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:22.371717 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62816d-21c3-48ce-b1ca-034274355232 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:22.372246 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62816d-21c3-48ce-b1ca-034274355232 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:22.373525 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62816d-21c3-48ce-b1ca-034274355232 None admin] RBAC: Adding query filter params (name=member) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:22.374077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62816d-21c3-48ce-b1ca-034274355232 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:22.376737 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62816d-21c3-48ce-b1ca-034274355232 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:22.393258 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 51/101] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 26 05:29:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:22.399319 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0baa042-54b4-4ab6-aeb2-7c23954483fb None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:22.568837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0baa042-54b4-4ab6-aeb2-7c23954483fb None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:22.616833 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bcd69-dc48-4b85-a8a3-9bb55bd1edfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:22.617495 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bcd69-dc48-4b85-a8a3-9bb55bd1edfc None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:22.617778 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bcd69-dc48-4b85-a8a3-9bb55bd1edfc None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:22.618052 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bcd69-dc48-4b85-a8a3-9bb55bd1edfc None admin] PATH_INFO: `/v3/users/79a88eb97e944d76b6e903c71c5cf94c` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:22.624796 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bcd69-dc48-4b85-a8a3-9bb55bd1edfc None admin] RBAC: Authorizing `identity:get_user(user_id=79a88eb97e944d76b6e903c71c5cf94c)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:22.626364 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bcd69-dc48-4b85-a8a3-9bb55bd1edfc None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:22.628467 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 51/102] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:29:22 2022] GET /identity/v3/users/79a88eb97e944d76b6e903c71c5cf94c => generated 275 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:22.634892 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62816d-21c3-48ce-b1ca-034274355232 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:22.765374 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4177b1-2823-4b5a-ba00-91721f35b238 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:22.765779 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4177b1-2823-4b5a-ba00-91721f35b238 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:22.765945 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4177b1-2823-4b5a-ba00-91721f35b238 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:22.767518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 52/103] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:29:22.782072 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78690e79-acc2-4576-9e55-9830ed935625 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:22.782487 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78690e79-acc2-4576-9e55-9830ed935625 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:22.782636 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78690e79-acc2-4576-9e55-9830ed935625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:22.828646 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-78690e79-acc2-4576-9e55-9830ed935625 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:22.829804 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-78690e79-acc2-4576-9e55-9830ed935625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:22.893071 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62816d-21c3-48ce-b1ca-034274355232 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:22.922166 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:22.935525 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:22.958958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19cb378-8e74-4a92-a6b8-6de623cb5905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:22.960081 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cb378-8e74-4a92-a6b8-6de623cb5905 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:22.960558 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cb378-8e74-4a92-a6b8-6de623cb5905 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:22.961831 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cb378-8e74-4a92-a6b8-6de623cb5905 None admin] PATH_INFO: `/v3/projects/f36f364f981e4cbb8bca50ac93a26b16` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:22.963246 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19cb378-8e74-4a92-a6b8-6de623cb5905 None admin] RBAC: Authorizing `identity:get_project(project_id=f36f364f981e4cbb8bca50ac93a26b16)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:22.973370 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19cb378-8e74-4a92-a6b8-6de623cb5905 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:22.977213 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 52/104] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:29:22 2022] GET /identity/v3/projects/f36f364f981e4cbb8bca50ac93a26b16 => generated 298 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:22.979835 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac998e-85a9-436f-bae3-69d0c8d80451 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:22.980309 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac998e-85a9-436f-bae3-69d0c8d80451 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:22.980767 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac998e-85a9-436f-bae3-69d0c8d80451 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:22.983617 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 53/105] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:22.989688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac998e-85a9-436f-bae3-69d0c8d80451 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:23.027095 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 53/106] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:29:23.029729 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07adfbe-c29d-4be4-917e-e1869c86fc5d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:23.030490 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07adfbe-c29d-4be4-917e-e1869c86fc5d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:23.031131 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07adfbe-c29d-4be4-917e-e1869c86fc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:23.085859 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-d07adfbe-c29d-4be4-917e-e1869c86fc5d None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:23.088750 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d07adfbe-c29d-4be4-917e-e1869c86fc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:23.209911 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac998e-85a9-436f-bae3-69d0c8d80451 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:23.275205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d565d-0962-497e-86c4-174ad811a541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:23.276415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d565d-0962-497e-86c4-174ad811a541 None admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:23.276901 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d565d-0962-497e-86c4-174ad811a541 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:23.277382 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d565d-0962-497e-86c4-174ad811a541 None admin] PATH_INFO: `/v3/projects/f36f364f981e4cbb8bca50ac93a26b16/users/79a88eb97e944d76b6e903c71c5cf94c/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:23.280997 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d565d-0962-497e-86c4-174ad811a541 None admin] RBAC: Authorizing `identity:create_grant(project_id=f36f364f981e4cbb8bca50ac93a26b16, user_id=79a88eb97e944d76b6e903c71c5cf94c, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:23.284271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d565d-0962-497e-86c4-174ad811a541 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:23.312090 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 54/107] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:29:23.314533 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cea4a9-abbb-472b-a1f6-d982f28e2a42 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:23.315020 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cea4a9-abbb-472b-a1f6-d982f28e2a42 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:23.315510 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cea4a9-abbb-472b-a1f6-d982f28e2a42 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:23.318766 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 55/108] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:23.331386 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 54/109] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 26 05:29:22 2022] PUT /identity/v3/projects/f36f364f981e4cbb8bca50ac93a26b16/users/79a88eb97e944d76b6e903c71c5cf94c/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:29:23.335403 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8508b-050a-41f3-a44a-9d4af7e46e20 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:23.336013 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8508b-050a-41f3-a44a-9d4af7e46e20 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:23.336438 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8508b-050a-41f3-a44a-9d4af7e46e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:23.397920 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-2db8508b-050a-41f3-a44a-9d4af7e46e20 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:23.400093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2db8508b-050a-41f3-a44a-9d4af7e46e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:23.441380 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d565d-0962-497e-86c4-174ad811a541 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:23.560197 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:23.639638 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 56/110] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:29:23.737066 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ac7df-105f-4e1a-8606-ea8e692c0fc3 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:23.737520 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ac7df-105f-4e1a-8606-ea8e692c0fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:23.737979 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ac7df-105f-4e1a-8606-ea8e692c0fc3 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:23.740475 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 57/111] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:29:23.757627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a4e2d-fd06-42fd-aff0-acccaecd0f94 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:23.758081 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a4e2d-fd06-42fd-aff0-acccaecd0f94 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:23.758541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1a4e2d-fd06-42fd-aff0-acccaecd0f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:23.779569 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d565d-0962-497e-86c4-174ad811a541 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:23.809736 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-9d1a4e2d-fd06-42fd-aff0-acccaecd0f94 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:23.811829 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9d1a4e2d-fd06-42fd-aff0-acccaecd0f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:23.905430 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d86f46-7f3c-4b5e-939f-da88574a6da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:23.906389 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d86f46-7f3c-4b5e-939f-da88574a6da0 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:23.906881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d86f46-7f3c-4b5e-939f-da88574a6da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:23.907344 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d86f46-7f3c-4b5e-939f-da88574a6da0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:23.908781 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:23.957597 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d86f46-7f3c-4b5e-939f-da88574a6da0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:29:23.963400 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-32d86f46-7f3c-4b5e-939f-da88574a6da0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:29:23.963400 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:23.963400 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:23.963400 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:23.963400 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:23.963400 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:23.963400 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:23.963400 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:23.963400 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:23.963400 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:23.963400 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:23.963400 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:23.963400 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:29:23.963400 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:29:23.963400 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:29:23.963400 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:29:23.964949 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:29:23.964949 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:29:23.964949 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:29:23.964949 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:29:23.964949 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:23.964949 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:23.964949 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:23.964949 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:23.964949 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:23.964949 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:23.964949 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:23.964949 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:23.964949 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:23.964949 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:23.964949 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:23.964949 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:23.966367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:23.966367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:23.966367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:23.966367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:23.966367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:29:23.966367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:29:23.966367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:29:23.966367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:29:23.966367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:29:23.966367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:29:23.966367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:29:23.966367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:29:23.973198 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 55/112] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:29:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 532 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:29:23.979198 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d86f46-7f3c-4b5e-939f-da88574a6da0 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:24.058159 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 58/113] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:29:24.114321 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a4e2d-fd06-42fd-aff0-acccaecd0f94 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:24.331788 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:24.342904 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d86f46-7f3c-4b5e-939f-da88574a6da0 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:24.372468 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1a4e2d-fd06-42fd-aff0-acccaecd0f94 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:24.420735 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f26ec-bd13-4ad4-8a65-0171e4713c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:24.421414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f26ec-bd13-4ad4-8a65-0171e4713c95 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:24.421698 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f26ec-bd13-4ad4-8a65-0171e4713c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:24.421978 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f26ec-bd13-4ad4-8a65-0171e4713c95 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:24.423197 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f26ec-bd13-4ad4-8a65-0171e4713c95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:24.424659 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de9c7f-252d-4761-9977-9dee3f66900c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:24.424868 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f26ec-bd13-4ad4-8a65-0171e4713c95 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:24.425822 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de9c7f-252d-4761-9977-9dee3f66900c None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:24.426388 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de9c7f-252d-4761-9977-9dee3f66900c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:24.426827 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 59/114] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:29:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:29:24.427067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de9c7f-252d-4761-9977-9dee3f66900c None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:24.428219 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14969c8a-f313-4264-af42-0fce8216424a None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:24.428501 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14969c8a-f313-4264-af42-0fce8216424a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:24.428661 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de9c7f-252d-4761-9977-9dee3f66900c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:24.428802 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14969c8a-f313-4264-af42-0fce8216424a None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:24.429190 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de9c7f-252d-4761-9977-9dee3f66900c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:24.432300 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de9c7f-252d-4761-9977-9dee3f66900c None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:24.434668 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 60/115] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:24.436165 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14969c8a-f313-4264-af42-0fce8216424a None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:24.454387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 56/116] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 26 05:29:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 476 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:24.457210 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db4de1-853f-43e7-a26d-e3263b1a76a9 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:24.457777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db4de1-853f-43e7-a26d-e3263b1a76a9 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:24.458328 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db4de1-853f-43e7-a26d-e3263b1a76a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:24.499342 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-23db4de1-853f-43e7-a26d-e3263b1a76a9 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:24.502485 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-23db4de1-853f-43e7-a26d-e3263b1a76a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:24.564503 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:24.577703 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14969c8a-f313-4264-af42-0fce8216424a None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:24.632038 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3531d-8ca4-46b8-9f42-1e0f9c327a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:24.632603 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3531d-8ca4-46b8-9f42-1e0f9c327a63 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:24.632882 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3531d-8ca4-46b8-9f42-1e0f9c327a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:24.633140 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3531d-8ca4-46b8-9f42-1e0f9c327a63 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:24.645832 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed3531d-8ca4-46b8-9f42-1e0f9c327a63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:29:24.649327 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 57/117] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:29:24.651317 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db4de1-853f-43e7-a26d-e3263b1a76a9 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:24.652629 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-2ed3531d-8ca4-46b8-9f42-1e0f9c327a63 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:29:24.652629 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:24.652629 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:24.652629 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:24.652629 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:24.652629 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:24.652629 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:24.652629 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:24.652629 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:24.652629 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:24.652629 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:24.652629 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:24.652629 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:29:24.652629 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:29:24.652629 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:29:24.652629 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:29:24.654256 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:29:24.654256 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:29:24.654256 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:29:24.654256 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:29:24.654256 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:24.654256 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:24.654256 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:24.654256 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:24.654256 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:24.654256 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:24.654256 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:24.654256 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:24.654256 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:24.654256 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:24.654256 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:24.654256 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:24.656001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:24.656001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:24.656001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:24.656001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:24.656001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:29:24.656001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:29:24.656001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:29:24.656001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:29:24.656001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:29:24.656001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:29:24.656001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:29:24.656001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:29:24.656001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 61/118] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 26 05:29:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:29:24.656001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3531d-8ca4-46b8-9f42-1e0f9c327a63 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:24.827928 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:24.842090 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:24.849166 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db4de1-853f-43e7-a26d-e3263b1a76a9 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:24.860383 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3531d-8ca4-46b8-9f42-1e0f9c327a63 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:24.905469 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d782c8-cd65-4077-8ee0-72134d6f72e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:24.906629 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d782c8-cd65-4077-8ee0-72134d6f72e1 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:24.907076 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d782c8-cd65-4077-8ee0-72134d6f72e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:24.907478 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d782c8-cd65-4077-8ee0-72134d6f72e1 None admin] PATH_INFO: `/v3/users/77c61e6dbfbb4fd19b53a2d4fe69c378` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:24.916779 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f98a2-c8d7-4d18-af20-9be8e82a1781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:24.918237 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f98a2-c8d7-4d18-af20-9be8e82a1781 None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:24.918831 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f98a2-c8d7-4d18-af20-9be8e82a1781 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:24.919424 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f98a2-c8d7-4d18-af20-9be8e82a1781 None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:24.920821 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f98a2-c8d7-4d18-af20-9be8e82a1781 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:24.923715 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f98a2-c8d7-4d18-af20-9be8e82a1781 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:24.926146 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d782c8-cd65-4077-8ee0-72134d6f72e1 None admin] RBAC: Authorizing `identity:get_user(user_id=77c61e6dbfbb4fd19b53a2d4fe69c378)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:24.927652 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d782c8-cd65-4077-8ee0-72134d6f72e1 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:24.929487 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 62/119] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:29:24 2022] GET /identity/v3/users/77c61e6dbfbb4fd19b53a2d4fe69c378 => generated 289 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:24.930374 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d782c8-cd65-4077-8ee0-72134d6f72e1 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:24.971862 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 58/120] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Sep 26 05:29:24 2022] POST /identity/v3/projects => generated 302 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:24.971862 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f98a2-c8d7-4d18-af20-9be8e82a1781 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:25.124904 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f98a2-c8d7-4d18-af20-9be8e82a1781 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:25.127494 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d782c8-cd65-4077-8ee0-72134d6f72e1 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:25.180942 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31d65a-e75a-4547-b179-16973137aac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:25.182140 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31d65a-e75a-4547-b179-16973137aac9 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:25.182602 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31d65a-e75a-4547-b179-16973137aac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:25.182767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac82b0a-ade3-4080-9419-80aa85941d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:25.183094 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d31d65a-e75a-4547-b179-16973137aac9 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:25.183403 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac82b0a-ade3-4080-9419-80aa85941d55 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:25.183674 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac82b0a-ade3-4080-9419-80aa85941d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:25.184172 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac82b0a-ade3-4080-9419-80aa85941d55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:25.184736 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31d65a-e75a-4547-b179-16973137aac9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:25.185297 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31d65a-e75a-4547-b179-16973137aac9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:25.188543 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d31d65a-e75a-4547-b179-16973137aac9 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:25.199410 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac82b0a-ade3-4080-9419-80aa85941d55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:29:25.201705 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 59/121] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:29:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:25.202649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31d65a-e75a-4547-b179-16973137aac9 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:25.206648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-dac82b0a-ade3-4080-9419-80aa85941d55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:29:25.206648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:25.206648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:25.206648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:25.206648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:25.206648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:25.206648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:25.206648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:25.206648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:25.206648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:25.206648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:25.206648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:25.206648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:29:25.206648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:29:25.206648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:29:25.206648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:29:25.208630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:29:25.208630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:29:25.208630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:29:25.208630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:29:25.208630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:25.208630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:25.208630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:25.208630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:25.208630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:25.208630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:25.208630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:25.208630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:25.208630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:25.208630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:25.208630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:25.208630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:25.210141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:25.210141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:25.210141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:25.210141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:25.210141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:29:25.210141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:29:25.210141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:29:25.210141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:29:25.210141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:29:25.210141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:29:25.210141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:29:25.210141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:29:25.210141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 63/122] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:29:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:29:25.210141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac82b0a-ade3-4080-9419-80aa85941d55 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:25.212492 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:25.223651 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:25.351050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac82b0a-ade3-4080-9419-80aa85941d55 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:25.352219 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d31d65a-e75a-4547-b179-16973137aac9 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:25.396886 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043298bd-e9e7-4922-b221-0ade958bd891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:25.397623 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043298bd-e9e7-4922-b221-0ade958bd891 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:25.397909 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043298bd-e9e7-4922-b221-0ade958bd891 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:25.398182 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043298bd-e9e7-4922-b221-0ade958bd891 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:25.398796 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab9085-393d-4d78-bd7c-3423c82a9a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:25.399662 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab9085-393d-4d78-bd7c-3423c82a9a17 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:25.400179 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab9085-393d-4d78-bd7c-3423c82a9a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:25.400646 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab9085-393d-4d78-bd7c-3423c82a9a17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:25.419971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab9085-393d-4d78-bd7c-3423c82a9a17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:29:25.425899 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-84ab9085-393d-4d78-bd7c-3423c82a9a17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:29:25.425899 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:25.425899 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:25.425899 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:25.425899 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:25.425899 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:25.425899 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:25.425899 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:25.425899 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:25.425899 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:25.425899 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:25.425899 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:25.425899 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:29:25.425899 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:29:25.425899 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:29:25.425899 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:29:25.426824 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:29:25.426824 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:29:25.426824 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:29:25.426824 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:29:25.426824 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:25.426824 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:25.426824 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:25.426824 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:25.426824 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:25.426824 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:25.426824 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:25.426824 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:25.426824 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:25.426824 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:25.426824 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:25.426824 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:25.427601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:25.427601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:25.427601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:25.427601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:25.427601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:29:25.427601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:29:25.427601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:29:25.427601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:29:25.427601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:29:25.427601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:29:25.427601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:29:25.427601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:29:25.432275 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 60/123] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:29:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:29:25.433253 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab9085-393d-4d78-bd7c-3423c82a9a17 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:25.480921 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043298bd-e9e7-4922-b221-0ade958bd891 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:25.482901 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043298bd-e9e7-4922-b221-0ade958bd891 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:25.492365 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:25.506216 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:25.550949 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab9085-393d-4d78-bd7c-3423c82a9a17 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:25.592758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791078a-3402-4c1a-a3ff-0e37175c4c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:25.593682 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791078a-3402-4c1a-a3ff-0e37175c4c78 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:25.594106 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791078a-3402-4c1a-a3ff-0e37175c4c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:25.594554 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9791078a-3402-4c1a-a3ff-0e37175c4c78 None admin] PATH_INFO: `/v3/users/79a88eb97e944d76b6e903c71c5cf94c` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:25.596200 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791078a-3402-4c1a-a3ff-0e37175c4c78 None admin] RBAC: Authorizing `identity:get_user(user_id=79a88eb97e944d76b6e903c71c5cf94c)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:25.597896 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9791078a-3402-4c1a-a3ff-0e37175c4c78 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:25.600171 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 61/124] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:29:25 2022] GET /identity/v3/users/79a88eb97e944d76b6e903c71c5cf94c => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:25.601233 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791078a-3402-4c1a-a3ff-0e37175c4c78 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:25.604429 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 64/125] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:29:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:25.609255 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043298bd-e9e7-4922-b221-0ade958bd891 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:25.809828 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9791078a-3402-4c1a-a3ff-0e37175c4c78 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:25.820905 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043298bd-e9e7-4922-b221-0ade958bd891 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:25.837514 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:25.876168 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:25.884356 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374867d0-b1bb-4e71-b3a8-d0d07ed1c84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:25.885632 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374867d0-b1bb-4e71-b3a8-d0d07ed1c84e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:25.886109 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374867d0-b1bb-4e71-b3a8-d0d07ed1c84e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:25.886588 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374867d0-b1bb-4e71-b3a8-d0d07ed1c84e None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:25.888418 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374867d0-b1bb-4e71-b3a8-d0d07ed1c84e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:25.888944 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374867d0-b1bb-4e71-b3a8-d0d07ed1c84e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:25.892395 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374867d0-b1bb-4e71-b3a8-d0d07ed1c84e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:25.896165 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795b84f-bc25-4585-8c1b-1f74a7808ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:25.897652 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795b84f-bc25-4585-8c1b-1f74a7808ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:25.898374 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795b84f-bc25-4585-8c1b-1f74a7808ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:25.899054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795b84f-bc25-4585-8c1b-1f74a7808ff6 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:25.900476 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795b84f-bc25-4585-8c1b-1f74a7808ff6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:25.901261 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795b84f-bc25-4585-8c1b-1f74a7808ff6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:25.904547 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795b84f-bc25-4585-8c1b-1f74a7808ff6 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:25.916112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 62/126] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:29:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:25.920768 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374867d0-b1bb-4e71-b3a8-d0d07ed1c84e None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:25.923799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 65/127] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 26 05:29:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:25.930023 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795b84f-bc25-4585-8c1b-1f74a7808ff6 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:26.136798 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795b84f-bc25-4585-8c1b-1f74a7808ff6 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:26.148691 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374867d0-b1bb-4e71-b3a8-d0d07ed1c84e None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:26.216122 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78a35b-350c-49f1-aee0-8d8fd739fcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:26.217198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78a35b-350c-49f1-aee0-8d8fd739fcdf None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:26.217350 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2d6fb-90bb-4296-8db6-046783074aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:26.217663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78a35b-350c-49f1-aee0-8d8fd739fcdf None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:26.218105 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78a35b-350c-49f1-aee0-8d8fd739fcdf None admin] PATH_INFO: `/v3/projects/f36f364f981e4cbb8bca50ac93a26b16` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:26.219287 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2d6fb-90bb-4296-8db6-046783074aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:26.220110 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2d6fb-90bb-4296-8db6-046783074aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:26.220262 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78a35b-350c-49f1-aee0-8d8fd739fcdf None admin] RBAC: Authorizing `identity:get_project(project_id=f36f364f981e4cbb8bca50ac93a26b16)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:26.221060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2d6fb-90bb-4296-8db6-046783074aa3 None admin] PATH_INFO: `/v3/projects/f36f364f981e4cbb8bca50ac93a26b16` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:26.223157 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78a35b-350c-49f1-aee0-8d8fd739fcdf None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:26.224042 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2d6fb-90bb-4296-8db6-046783074aa3 None admin] RBAC: Authorizing `identity:get_project(project_id=f36f364f981e4cbb8bca50ac93a26b16)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:26.226570 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 66/128] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:29:25 2022] GET /identity/v3/projects/f36f364f981e4cbb8bca50ac93a26b16 => generated 298 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:26.227928 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2d6fb-90bb-4296-8db6-046783074aa3 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:26.228095 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78a35b-350c-49f1-aee0-8d8fd739fcdf None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:26.231708 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 63/129] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:29:25 2022] GET /identity/v3/projects/f36f364f981e4cbb8bca50ac93a26b16 => generated 298 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:26.233800 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2d6fb-90bb-4296-8db6-046783074aa3 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:26.307681 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:26.369763 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:26.428309 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78a35b-350c-49f1-aee0-8d8fd739fcdf None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:26.431390 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2d6fb-90bb-4296-8db6-046783074aa3 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:26.474233 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1c0f4-ea04-41f4-b074-e57c1e4954eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:26.475268 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1c0f4-ea04-41f4-b074-e57c1e4954eb None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:26.475932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1c0f4-ea04-41f4-b074-e57c1e4954eb None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:26.476611 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1c0f4-ea04-41f4-b074-e57c1e4954eb None admin] PATH_INFO: `/v3/users/68623c0b9d92445197ab588b18e08f43` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:26.478619 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1c0f4-ea04-41f4-b074-e57c1e4954eb None admin] RBAC: Authorizing `identity:get_user(user_id=68623c0b9d92445197ab588b18e08f43)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:26.481412 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e1c0f4-ea04-41f4-b074-e57c1e4954eb None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:26.489034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 67/130] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:29:26 2022] GET /identity/v3/users/68623c0b9d92445197ab588b18e08f43 => generated 247 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:26.489034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1c0f4-ea04-41f4-b074-e57c1e4954eb None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:26.496929 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db1c73-d45c-4e2b-8801-4acb718d7108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:26.497665 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db1c73-d45c-4e2b-8801-4acb718d7108 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:26.497999 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db1c73-d45c-4e2b-8801-4acb718d7108 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:26.498327 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db1c73-d45c-4e2b-8801-4acb718d7108 None admin] PATH_INFO: `/v3/users/79a88eb97e944d76b6e903c71c5cf94c` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:26.499661 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db1c73-d45c-4e2b-8801-4acb718d7108 None admin] RBAC: Authorizing `identity:get_user(user_id=79a88eb97e944d76b6e903c71c5cf94c)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:26.502031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db1c73-d45c-4e2b-8801-4acb718d7108 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:26.503935 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 64/131] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:29:26 2022] GET /identity/v3/users/79a88eb97e944d76b6e903c71c5cf94c => generated 275 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:26.505009 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db1c73-d45c-4e2b-8801-4acb718d7108 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:26.638044 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1c0f4-ea04-41f4-b074-e57c1e4954eb None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:26.642255 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:26.680314 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db1c73-d45c-4e2b-8801-4acb718d7108 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:26.686909 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3f70e-ca06-4b94-b114-238f9029c43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:26.688026 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3f70e-ca06-4b94-b114-238f9029c43b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:26.688523 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3f70e-ca06-4b94-b114-238f9029c43b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:26.689040 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3f70e-ca06-4b94-b114-238f9029c43b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:26.690350 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3f70e-ca06-4b94-b114-238f9029c43b None admin] RBAC: Adding query filter params (role.id=f003916a5d7249639775054051c6d3ab, scope.project.id=f36f364f981e4cbb8bca50ac93a26b16, user.id=77c61e6dbfbb4fd19b53a2d4fe69c378) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:26.690918 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3f70e-ca06-4b94-b114-238f9029c43b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:26.693481 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3f70e-ca06-4b94-b114-238f9029c43b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:26.703574 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 68/132] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:29:26 2022] GET /identity/v3/role_assignments?user.id=77c61e6dbfbb4fd19b53a2d4fe69c378&scope.project.id=f36f364f981e4cbb8bca50ac93a26b16&role.id=f003916a5d7249639775054051c6d3ab => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:26.705077 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694c3fd-8a72-49ae-b77c-058fa5eeb583 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:26.705523 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694c3fd-8a72-49ae-b77c-058fa5eeb583 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:26.705953 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694c3fd-8a72-49ae-b77c-058fa5eeb583 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:26.707691 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 69/133] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:26.708563 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694c3fd-8a72-49ae-b77c-058fa5eeb583 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:26.753960 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:26.767516 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cb98a-613e-4f44-bc71-76a1968eb4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:26.769260 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cb98a-613e-4f44-bc71-76a1968eb4d0 None admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:26.770049 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cb98a-613e-4f44-bc71-76a1968eb4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:26.770787 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671cb98a-613e-4f44-bc71-76a1968eb4d0 None admin] PATH_INFO: `/v3/projects/f36f364f981e4cbb8bca50ac93a26b16/users/79a88eb97e944d76b6e903c71c5cf94c/roles/7cb00fff13fb4eefa6a734c91c0d59ea` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:26.775377 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671cb98a-613e-4f44-bc71-76a1968eb4d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=f36f364f981e4cbb8bca50ac93a26b16, user_id=79a88eb97e944d76b6e903c71c5cf94c, role_id=7cb00fff13fb4eefa6a734c91c0d59ea)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:26.778740 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671cb98a-613e-4f44-bc71-76a1968eb4d0 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:26.809991 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 65/134] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 26 05:29:26 2022] PUT /identity/v3/projects/f36f364f981e4cbb8bca50ac93a26b16/users/79a88eb97e944d76b6e903c71c5cf94c/roles/7cb00fff13fb4eefa6a734c91c0d59ea => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:26.812341 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cb98a-613e-4f44-bc71-76a1968eb4d0 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:26.840504 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694c3fd-8a72-49ae-b77c-058fa5eeb583 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:26.882569 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17461dbc-5662-4004-8b82-a2287f500cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:26.883232 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17461dbc-5662-4004-8b82-a2287f500cba None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:26.883508 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17461dbc-5662-4004-8b82-a2287f500cba None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:26.883803 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17461dbc-5662-4004-8b82-a2287f500cba None admin] PATH_INFO: `/v3/projects/f36f364f981e4cbb8bca50ac93a26b16` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:26.885144 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17461dbc-5662-4004-8b82-a2287f500cba None admin] RBAC: Authorizing `identity:get_project(project_id=f36f364f981e4cbb8bca50ac93a26b16)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:26.886741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17461dbc-5662-4004-8b82-a2287f500cba None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:26.888647 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 70/135] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:29:26 2022] GET /identity/v3/projects/f36f364f981e4cbb8bca50ac93a26b16 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:26.893294 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c12d1a-c36c-4325-a026-59727758046d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:26.893725 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c12d1a-c36c-4325-a026-59727758046d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:26.893894 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c12d1a-c36c-4325-a026-59727758046d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:26.917737 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-70c12d1a-c36c-4325-a026-59727758046d None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:26.919348 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-70c12d1a-c36c-4325-a026-59727758046d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:26.956197 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:27.039401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 71/136] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:29:27.044744 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c12d1a-c36c-4325-a026-59727758046d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:27.054721 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671cb98a-613e-4f44-bc71-76a1968eb4d0 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:27.128170 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c63324-00ed-42ed-ac95-59b0c2ade413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:27.129824 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c63324-00ed-42ed-ac95-59b0c2ade413 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:27.130523 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c63324-00ed-42ed-ac95-59b0c2ade413 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:27.131369 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c63324-00ed-42ed-ac95-59b0c2ade413 None admin] PATH_INFO: `/v3/projects/bcf2f6a7c6e84ca9a2f7a3c3f3f878e0` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:27.133924 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c63324-00ed-42ed-ac95-59b0c2ade413 None admin] RBAC: Authorizing `identity:get_project(project_id=bcf2f6a7c6e84ca9a2f7a3c3f3f878e0)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:27.137401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c63324-00ed-42ed-ac95-59b0c2ade413 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:27.142318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 66/137] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:29:26 2022] GET /identity/v3/projects/bcf2f6a7c6e84ca9a2f7a3c3f3f878e0 => generated 312 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:27.149745 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c63324-00ed-42ed-ac95-59b0c2ade413 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:27.222551 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c12d1a-c36c-4325-a026-59727758046d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:27.280618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:27.292958 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ada26-05b2-4a02-9305-abfcc7274c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:27.299499 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ada26-05b2-4a02-9305-abfcc7274c66 None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:27.300643 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ada26-05b2-4a02-9305-abfcc7274c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:27.301435 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ada26-05b2-4a02-9305-abfcc7274c66 None admin] PATH_INFO: `/v3/projects/f36f364f981e4cbb8bca50ac93a26b16/users/68623c0b9d92445197ab588b18e08f43/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:27.312267 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ada26-05b2-4a02-9305-abfcc7274c66 None admin] RBAC: Authorizing `identity:create_grant(project_id=f36f364f981e4cbb8bca50ac93a26b16, user_id=68623c0b9d92445197ab588b18e08f43, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:27.315409 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8ada26-05b2-4a02-9305-abfcc7274c66 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:27.366542 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 72/138] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 26 05:29:27 2022] PUT /identity/v3/projects/f36f364f981e4cbb8bca50ac93a26b16/users/68623c0b9d92445197ab588b18e08f43/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:27.402207 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c63324-00ed-42ed-ac95-59b0c2ade413 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:27.473869 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7daf2a3-ff99-40d0-97af-09d74f6475e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:27.475883 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7daf2a3-ff99-40d0-97af-09d74f6475e0 None admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:27.476764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7daf2a3-ff99-40d0-97af-09d74f6475e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:27.477561 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7daf2a3-ff99-40d0-97af-09d74f6475e0 None admin] PATH_INFO: `/v3/projects/bcf2f6a7c6e84ca9a2f7a3c3f3f878e0/users/79a88eb97e944d76b6e903c71c5cf94c/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:27.481880 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7daf2a3-ff99-40d0-97af-09d74f6475e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=bcf2f6a7c6e84ca9a2f7a3c3f3f878e0, user_id=79a88eb97e944d76b6e903c71c5cf94c, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:27.485246 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7daf2a3-ff99-40d0-97af-09d74f6475e0 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:27.520357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 67/139] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 26 05:29:27 2022] PUT /identity/v3/projects/bcf2f6a7c6e84ca9a2f7a3c3f3f878e0/users/79a88eb97e944d76b6e903c71c5cf94c/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:27.631661 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ada26-05b2-4a02-9305-abfcc7274c66 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:27.671033 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:27.784194 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ada26-05b2-4a02-9305-abfcc7274c66 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:27.838314 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5442b6-8f58-445d-9064-c49c961fdabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:27.838991 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5442b6-8f58-445d-9064-c49c961fdabe None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:27.839257 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5442b6-8f58-445d-9064-c49c961fdabe None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:27.839527 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5442b6-8f58-445d-9064-c49c961fdabe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:27.853312 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5442b6-8f58-445d-9064-c49c961fdabe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:29:27.858656 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-ee5442b6-8f58-445d-9064-c49c961fdabe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:29:27.858656 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:27.858656 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:27.858656 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:27.858656 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:27.858656 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:27.858656 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:27.858656 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:27.858656 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:27.858656 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:27.858656 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:27.858656 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:27.858656 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:29:27.858656 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:29:27.858656 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:29:27.858656 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:29:27.860266 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:29:27.860266 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:29:27.860266 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:29:27.860266 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:29:27.860266 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:27.860266 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:27.860266 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:27.860266 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:27.860266 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:27.860266 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:27.860266 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:27.860266 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:27.860266 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:27.860266 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:27.860266 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:27.860266 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:27.861700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:27.861700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:27.861700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:27.861700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:27.861700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:29:27.861700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:29:27.861700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:29:27.861700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:29:27.861700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:29:27.861700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:29:27.861700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:29:27.861700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:29:27.861700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 73/140] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:29:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:29:27.869659 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7daf2a3-ff99-40d0-97af-09d74f6475e0 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:28.094277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7daf2a3-ff99-40d0-97af-09d74f6475e0 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:28.138265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:28.143494 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806203b-5eca-4ef3-86b1-28b07df3fca0 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:28.143882 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806203b-5eca-4ef3-86b1-28b07df3fca0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:28.146976 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806203b-5eca-4ef3-86b1-28b07df3fca0 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:28.146976 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 74/141] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:28.152993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f760c2-0c06-4b45-ad93-e5fa75fb6c5c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:28.153253 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f760c2-0c06-4b45-ad93-e5fa75fb6c5c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:28.153531 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f760c2-0c06-4b45-ad93-e5fa75fb6c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:28.167135 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637ffd8-d12c-47b9-92b4-7ad2db6d4c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:28.167799 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637ffd8-d12c-47b9-92b4-7ad2db6d4c4e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:28.168081 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637ffd8-d12c-47b9-92b4-7ad2db6d4c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:28.168353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637ffd8-d12c-47b9-92b4-7ad2db6d4c4e None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:28.169038 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637ffd8-d12c-47b9-92b4-7ad2db6d4c4e None admin] RBAC: Adding query filter params (name=member) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:28.169341 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637ffd8-d12c-47b9-92b4-7ad2db6d4c4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:28.170724 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637ffd8-d12c-47b9-92b4-7ad2db6d4c4e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:28.190504 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 68/142] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 26 05:29:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:28.200778 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-63f760c2-0c06-4b45-ad93-e5fa75fb6c5c None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:28.202346 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-63f760c2-0c06-4b45-ad93-e5fa75fb6c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:28.210257 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637ffd8-d12c-47b9-92b4-7ad2db6d4c4e None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:28.379859 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 75/143] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:29:28.474194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637ffd8-d12c-47b9-92b4-7ad2db6d4c4e None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:28.533827 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452dc98-66ff-4b8a-990a-3c5c78c3067d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:28.534516 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452dc98-66ff-4b8a-990a-3c5c78c3067d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:28.534786 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452dc98-66ff-4b8a-990a-3c5c78c3067d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:28.535062 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452dc98-66ff-4b8a-990a-3c5c78c3067d None admin] PATH_INFO: `/v3/users/79a88eb97e944d76b6e903c71c5cf94c` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:28.536401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452dc98-66ff-4b8a-990a-3c5c78c3067d None admin] RBAC: Authorizing `identity:get_user(user_id=79a88eb97e944d76b6e903c71c5cf94c)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:28.538210 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452dc98-66ff-4b8a-990a-3c5c78c3067d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:28.540345 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 69/144] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:29:28 2022] GET /identity/v3/users/79a88eb97e944d76b6e903c71c5cf94c => generated 275 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:28.549303 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f760c2-0c06-4b45-ad93-e5fa75fb6c5c None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:28.600891 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:28.803497 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f760c2-0c06-4b45-ad93-e5fa75fb6c5c None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:28.877633 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292006a-9297-47e6-9f7d-f353e01a2352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:28.879131 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292006a-9297-47e6-9f7d-f353e01a2352 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:28.879911 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292006a-9297-47e6-9f7d-f353e01a2352 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:28.880660 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292006a-9297-47e6-9f7d-f353e01a2352 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:29.003410 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292006a-9297-47e6-9f7d-f353e01a2352 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:29.006304 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292006a-9297-47e6-9f7d-f353e01a2352 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:29.020876 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452dc98-66ff-4b8a-990a-3c5c78c3067d None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:29.037479 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:29.192308 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:29.232980 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 76/145] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:29:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:29.242986 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292006a-9297-47e6-9f7d-f353e01a2352 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:29.341470 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452dc98-66ff-4b8a-990a-3c5c78c3067d None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:29.473772 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948ecab-c0aa-4f4c-91a7-631f307a207d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:29.474489 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948ecab-c0aa-4f4c-91a7-631f307a207d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:29.475393 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948ecab-c0aa-4f4c-91a7-631f307a207d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:29.475393 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948ecab-c0aa-4f4c-91a7-631f307a207d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:29.479517 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948ecab-c0aa-4f4c-91a7-631f307a207d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:29.481056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948ecab-c0aa-4f4c-91a7-631f307a207d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:29.484300 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 70/146] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:29:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 463 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:29.496862 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948ecab-c0aa-4f4c-91a7-631f307a207d None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:29.600030 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292006a-9297-47e6-9f7d-f353e01a2352 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:29.643999 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:29.699627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53bdd2-a770-4e45-90ec-2fd620955451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:29.701691 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53bdd2-a770-4e45-90ec-2fd620955451 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:29.702449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53bdd2-a770-4e45-90ec-2fd620955451 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:29.703167 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53bdd2-a770-4e45-90ec-2fd620955451 None admin] PATH_INFO: `/v3/projects/f36f364f981e4cbb8bca50ac93a26b16` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:29.713809 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53bdd2-a770-4e45-90ec-2fd620955451 None admin] RBAC: Authorizing `identity:get_project(project_id=f36f364f981e4cbb8bca50ac93a26b16)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:29.716814 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53bdd2-a770-4e45-90ec-2fd620955451 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:29.720350 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 77/147] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:29:29 2022] GET /identity/v3/projects/f36f364f981e4cbb8bca50ac93a26b16 => generated 298 bytes in 479 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:29:29.730098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53bdd2-a770-4e45-90ec-2fd620955451 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:29.854450 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948ecab-c0aa-4f4c-91a7-631f307a207d None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:29.910918 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:30.008367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cdbae-9470-4a53-bd10-86930494aa0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:30.008367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cdbae-9470-4a53-bd10-86930494aa0f None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:30.008367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cdbae-9470-4a53-bd10-86930494aa0f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:30.008367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cdbae-9470-4a53-bd10-86930494aa0f None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:30.008997 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0cdbae-9470-4a53-bd10-86930494aa0f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:30.011220 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0cdbae-9470-4a53-bd10-86930494aa0f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:30.087988 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 71/148] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 26 05:29:29 2022] POST /identity/v3/users => generated 283 bytes in 591 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:30.095266 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53bdd2-a770-4e45-90ec-2fd620955451 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:30.178257 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d6525-7cd5-42f1-b42e-6ecd8245304c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:30.178898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d6525-7cd5-42f1-b42e-6ecd8245304c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:30.179161 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d6525-7cd5-42f1-b42e-6ecd8245304c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:30.179426 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d6525-7cd5-42f1-b42e-6ecd8245304c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:30.180200 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d6525-7cd5-42f1-b42e-6ecd8245304c None admin] RBAC: Adding query filter params (role.id=c5a02c4618d94f1da7257ef437b8ce9e, scope.project.id=f36f364f981e4cbb8bca50ac93a26b16, user.id=79a88eb97e944d76b6e903c71c5cf94c) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:30.180499 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d6525-7cd5-42f1-b42e-6ecd8245304c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:30.182131 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d6525-7cd5-42f1-b42e-6ecd8245304c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:30.192750 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 78/149] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:29:29 2022] GET /identity/v3/role_assignments?user.id=79a88eb97e944d76b6e903c71c5cf94c&scope.project.id=f36f364f981e4cbb8bca50ac93a26b16&role.id=c5a02c4618d94f1da7257ef437b8ce9e => generated 608 bytes in 464 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:29:30.705317 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9df61-9508-4418-8d18-db2811b72fad None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:30.705980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9df61-9508-4418-8d18-db2811b72fad None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:30.705980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e9df61-9508-4418-8d18-db2811b72fad None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:30.707663 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 72/150] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:30.715056 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0e43f-7c04-4fe2-be26-d22b98efb53c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:30.715846 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0e43f-7c04-4fe2-be26-d22b98efb53c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:30.715846 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0e43f-7c04-4fe2-be26-d22b98efb53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:30.739475 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-a2e0e43f-7c04-4fe2-be26-d22b98efb53c None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:30.740769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a2e0e43f-7c04-4fe2-be26-d22b98efb53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:30.830507 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:30.879414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 79/151] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:29:31.055302 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf5567-5ec2-49ea-a56a-2892dee7887b None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:31.055828 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf5567-5ec2-49ea-a56a-2892dee7887b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:31.056237 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf5567-5ec2-49ea-a56a-2892dee7887b None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:31.059229 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 73/152] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:31.075392 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9952bb3-a05e-48c9-b405-802f5d45f887 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:31.076401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9952bb3-a05e-48c9-b405-802f5d45f887 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:31.076797 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9952bb3-a05e-48c9-b405-802f5d45f887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:31.123025 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-e9952bb3-a05e-48c9-b405-802f5d45f887 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:31.123025 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e9952bb3-a05e-48c9-b405-802f5d45f887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:31.262924 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 80/153] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:29:31.342477 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf5567-5ec2-49ea-a56a-2892dee7887b None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:31.591939 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf5567-5ec2-49ea-a56a-2892dee7887b None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:31.707944 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9952bb3-a05e-48c9-b405-802f5d45f887 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:31.712677 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ed64f-330d-41e2-9bb8-c4a717470493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:31.713708 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ed64f-330d-41e2-9bb8-c4a717470493 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:31.714207 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ed64f-330d-41e2-9bb8-c4a717470493 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:31.714692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ed64f-330d-41e2-9bb8-c4a717470493 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:31.743798 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ed64f-330d-41e2-9bb8-c4a717470493 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:29:31.752436 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-965ed64f-330d-41e2-9bb8-c4a717470493 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:29:31.752436 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:31.752436 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:31.752436 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:31.752436 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:31.752436 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:31.752436 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:31.752436 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:31.752436 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:31.752436 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:31.752436 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:31.752436 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:31.752436 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:29:31.752436 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:29:31.752436 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:29:31.752436 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:29:31.753365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:29:31.753365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:29:31.753365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:29:31.753365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:29:31.753365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:31.753365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:31.753365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:31.753365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:31.753365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:31.753365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:31.753365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:31.753365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:31.753365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:31.753365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:31.753365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:31.753365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:31.754162 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:31.754162 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:31.754162 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:31.754162 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:31.754162 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:29:31.754162 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:29:31.754162 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:29:31.754162 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:29:31.754162 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:29:31.754162 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:29:31.754162 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:29:31.754162 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:29:31.755350 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 74/154] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 26 05:29:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 414 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:29:31.767172 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ed64f-330d-41e2-9bb8-c4a717470493 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:31.927436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9952bb3-a05e-48c9-b405-802f5d45f887 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:31.935725 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:31.961011 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:31.991684 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfc704-d7c3-49de-a553-a4ebbfe2b3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:31.992402 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfc704-d7c3-49de-a553-a4ebbfe2b3db None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:31.992683 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfc704-d7c3-49de-a553-a4ebbfe2b3db None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:31.992951 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfc704-d7c3-49de-a553-a4ebbfe2b3db None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:32.029044 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dfc704-d7c3-49de-a553-a4ebbfe2b3db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:29:32.034291 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-d5dfc704-d7c3-49de-a553-a4ebbfe2b3db None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:29:32.034291 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:32.034291 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:32.034291 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:32.034291 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:32.034291 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:32.034291 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:32.034291 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:32.034291 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:32.034291 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:32.034291 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:32.034291 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:32.034291 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:29:32.034291 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:29:32.034291 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:29:32.034291 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:29:32.035442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:29:32.035442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:29:32.035442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:29:32.035442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:29:32.035442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:32.035442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:32.035442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:32.035442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:32.035442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:32.035442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:32.035442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:32.035442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:32.035442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:32.035442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:32.035442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:32.035442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:32.036344 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:32.036344 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:32.036344 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:32.036344 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:32.036344 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:29:32.036344 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:29:32.036344 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:29:32.036344 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:29:32.036344 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:29:32.036344 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:29:32.036344 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:29:32.036344 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:29:32.036344 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 81/155] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:29:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:29:32.045421 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfc704-d7c3-49de-a553-a4ebbfe2b3db None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:32.224778 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ed64f-330d-41e2-9bb8-c4a717470493 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:32.316111 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfc704-d7c3-49de-a553-a4ebbfe2b3db None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:32.328706 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f39a9c-88e8-4e79-8806-7df0246e7c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:32.329349 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f39a9c-88e8-4e79-8806-7df0246e7c6d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:32.329620 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f39a9c-88e8-4e79-8806-7df0246e7c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:32.329930 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f39a9c-88e8-4e79-8806-7df0246e7c6d None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:32.330620 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f39a9c-88e8-4e79-8806-7df0246e7c6d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:32.330902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f39a9c-88e8-4e79-8806-7df0246e7c6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:32.333027 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f39a9c-88e8-4e79-8806-7df0246e7c6d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:32.354045 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 75/156] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:29:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 588 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:32.360182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9d8dc-bd7a-4480-b957-d6468fce4199 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:32.362416 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9d8dc-bd7a-4480-b957-d6468fce4199 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:32.362966 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9d8dc-bd7a-4480-b957-d6468fce4199 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:32.364991 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 76/157] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:32.371892 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9d8dc-bd7a-4480-b957-d6468fce4199 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:32.390503 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712e70e-3e6a-4741-afb9-c1b40d5567ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:32.391511 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712e70e-3e6a-4741-afb9-c1b40d5567ac None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:32.392016 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712e70e-3e6a-4741-afb9-c1b40d5567ac None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:32.392496 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712e70e-3e6a-4741-afb9-c1b40d5567ac None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:32.393375 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e712e70e-3e6a-4741-afb9-c1b40d5567ac None admin] RBAC: Adding query filter params (name=reader) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:32.393866 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e712e70e-3e6a-4741-afb9-c1b40d5567ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:32.395502 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e712e70e-3e6a-4741-afb9-c1b40d5567ac None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:32.415207 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 82/158] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 26 05:29:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:32.420617 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25fcad-1817-4a47-a942-82bb1cab0de8 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:32.421039 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25fcad-1817-4a47-a942-82bb1cab0de8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:32.421486 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25fcad-1817-4a47-a942-82bb1cab0de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:32.481813 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-2c25fcad-1817-4a47-a942-82bb1cab0de8 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:32.483413 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2c25fcad-1817-4a47-a942-82bb1cab0de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:32.531401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:32.605800 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 83/159] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:29:32.607071 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25fcad-1817-4a47-a942-82bb1cab0de8 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:32.796383 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:32.829979 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c9d8dc-bd7a-4480-b957-d6468fce4199 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:32.882111 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25fcad-1817-4a47-a942-82bb1cab0de8 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:32.915093 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079df15-37e6-4652-9266-bec8cd673887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:32.915858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079df15-37e6-4652-9266-bec8cd673887 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:32.916136 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079df15-37e6-4652-9266-bec8cd673887 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:32.916408 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079df15-37e6-4652-9266-bec8cd673887 None admin] PATH_INFO: `/v3/users/79a88eb97e944d76b6e903c71c5cf94c` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:32.920756 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2079df15-37e6-4652-9266-bec8cd673887 None admin] RBAC: Authorizing `identity:get_user(user_id=79a88eb97e944d76b6e903c71c5cf94c)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:32.922257 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2079df15-37e6-4652-9266-bec8cd673887 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:32.924526 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 77/160] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:29:32 2022] GET /identity/v3/users/79a88eb97e944d76b6e903c71c5cf94c => generated 275 bytes in 557 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:32.927254 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5435677-0d62-42b2-8814-4548fbf64fc1 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:32.927537 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5435677-0d62-42b2-8814-4548fbf64fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:32.927833 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5435677-0d62-42b2-8814-4548fbf64fc1 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:32.929598 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 78/161] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:32.932921 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5435677-0d62-42b2-8814-4548fbf64fc1 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:32.960303 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f11b33-0860-4c9d-8d27-b5168426bc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:32.960975 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f11b33-0860-4c9d-8d27-b5168426bc93 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:32.961238 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f11b33-0860-4c9d-8d27-b5168426bc93 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:32.961507 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f11b33-0860-4c9d-8d27-b5168426bc93 None admin] PATH_INFO: `/v3/users/77c61e6dbfbb4fd19b53a2d4fe69c378` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:32.963020 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f11b33-0860-4c9d-8d27-b5168426bc93 None admin] RBAC: Authorizing `identity:get_user(user_id=77c61e6dbfbb4fd19b53a2d4fe69c378)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:32.964797 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f11b33-0860-4c9d-8d27-b5168426bc93 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:32.966504 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 84/162] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:29:32 2022] GET /identity/v3/users/77c61e6dbfbb4fd19b53a2d4fe69c378 => generated 289 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:32.973035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37903860-ee3c-450e-bb06-2f33c0cfa307 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:32.973329 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37903860-ee3c-450e-bb06-2f33c0cfa307 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:32.973868 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37903860-ee3c-450e-bb06-2f33c0cfa307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:32.998032 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-37903860-ee3c-450e-bb06-2f33c0cfa307 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:32.999242 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-37903860-ee3c-450e-bb06-2f33c0cfa307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:33.032662 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:33.108053 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 85/163] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:29:33.108681 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37903860-ee3c-450e-bb06-2f33c0cfa307 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:33.152792 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5435677-0d62-42b2-8814-4548fbf64fc1 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:33.197126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e3ce7-4489-460b-847b-0a9241b45b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:33.199289 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e3ce7-4489-460b-847b-0a9241b45b58 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:33.199289 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e3ce7-4489-460b-847b-0a9241b45b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:33.199504 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e3ce7-4489-460b-847b-0a9241b45b58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:33.238112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:33.281724 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e3ce7-4489-460b-847b-0a9241b45b58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:33.283666 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e3ce7-4489-460b-847b-0a9241b45b58 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:33.346304 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37903860-ee3c-450e-bb06-2f33c0cfa307 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:33.400145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 79/164] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:29:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:33.403953 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e3ce7-4489-460b-847b-0a9241b45b58 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:33.410611 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc7742-f02e-4fdb-9b6d-6a95ad28d42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:33.411276 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc7742-f02e-4fdb-9b6d-6a95ad28d42a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:33.411548 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc7742-f02e-4fdb-9b6d-6a95ad28d42a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:33.411842 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc7742-f02e-4fdb-9b6d-6a95ad28d42a None admin] PATH_INFO: `/v3/projects/f36f364f981e4cbb8bca50ac93a26b16` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:33.413108 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc7742-f02e-4fdb-9b6d-6a95ad28d42a None admin] RBAC: Authorizing `identity:get_project(project_id=f36f364f981e4cbb8bca50ac93a26b16)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:33.414609 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc7742-f02e-4fdb-9b6d-6a95ad28d42a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:33.416541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 86/165] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:29:33 2022] GET /identity/v3/projects/f36f364f981e4cbb8bca50ac93a26b16 => generated 298 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:33.417438 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc7742-f02e-4fdb-9b6d-6a95ad28d42a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:33.448915 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:33.481077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:33.527369 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e3ce7-4489-460b-847b-0a9241b45b58 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:33.535342 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc7742-f02e-4fdb-9b6d-6a95ad28d42a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:33.567760 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a2869-13c6-4423-9b1a-b9ccbd461110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:33.568703 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a2869-13c6-4423-9b1a-b9ccbd461110 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:33.569233 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a2869-13c6-4423-9b1a-b9ccbd461110 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:33.569721 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a2869-13c6-4423-9b1a-b9ccbd461110 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:33.576600 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283219c7-1577-4fb2-9612-f620b7b00434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:33.577304 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283219c7-1577-4fb2-9612-f620b7b00434 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:33.577526 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283219c7-1577-4fb2-9612-f620b7b00434 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:33.577791 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283219c7-1577-4fb2-9612-f620b7b00434 None admin] PATH_INFO: `/v3/projects/f36f364f981e4cbb8bca50ac93a26b16` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:33.579147 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283219c7-1577-4fb2-9612-f620b7b00434 None admin] RBAC: Authorizing `identity:get_project(project_id=f36f364f981e4cbb8bca50ac93a26b16)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:33.580722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283219c7-1577-4fb2-9612-f620b7b00434 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:33.582801 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 87/166] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:29:33 2022] GET /identity/v3/projects/f36f364f981e4cbb8bca50ac93a26b16 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:33.583487 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283219c7-1577-4fb2-9612-f620b7b00434 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:33.596487 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a2869-13c6-4423-9b1a-b9ccbd461110 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:29:33.602881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-0f0a2869-13c6-4423-9b1a-b9ccbd461110 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:29:33.602881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:33.602881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:33.602881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:33.602881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:33.602881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:33.602881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:33.602881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:33.602881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:33.602881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:33.602881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:33.602881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:33.602881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:29:33.602881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:29:33.602881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:29:33.602881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:29:33.604126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:29:33.604126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:29:33.604126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:29:33.604126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:29:33.604126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:33.604126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:33.604126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:33.604126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:33.604126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:33.604126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:33.604126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:33.604126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:33.604126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:33.604126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:33.604126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:33.604126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:33.605160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:33.605160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:33.605160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:33.605160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:33.605160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:29:33.605160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:29:33.605160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:29:33.605160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:29:33.605160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:29:33.605160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:29:33.605160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:29:33.605160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:29:33.607635 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 80/167] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:29:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:29:33.608826 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a2869-13c6-4423-9b1a-b9ccbd461110 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:33.703282 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283219c7-1577-4fb2-9612-f620b7b00434 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:33.736790 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:33.747141 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a2869-13c6-4423-9b1a-b9ccbd461110 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:33.774813 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:33.789846 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed22de5-82a0-463b-b548-309818c1fbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:33.790890 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed22de5-82a0-463b-b548-309818c1fbae None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:33.791381 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed22de5-82a0-463b-b548-309818c1fbae None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:33.791877 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed22de5-82a0-463b-b548-309818c1fbae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:33.792988 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed22de5-82a0-463b-b548-309818c1fbae None admin] RBAC: Adding query filter params (role.id=7cb00fff13fb4eefa6a734c91c0d59ea, scope.project.id=f36f364f981e4cbb8bca50ac93a26b16, user.id=79a88eb97e944d76b6e903c71c5cf94c) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:33.793565 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed22de5-82a0-463b-b548-309818c1fbae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:33.795268 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed22de5-82a0-463b-b548-309818c1fbae None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:33.796877 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a4bdd-363b-4b94-bc87-4a12577ac18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:33.797940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a4bdd-363b-4b94-bc87-4a12577ac18a None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:33.798402 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a4bdd-363b-4b94-bc87-4a12577ac18a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:33.798857 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a4bdd-363b-4b94-bc87-4a12577ac18a None admin] PATH_INFO: `/v3/projects/f36f364f981e4cbb8bca50ac93a26b16/users/77c61e6dbfbb4fd19b53a2d4fe69c378/roles/f003916a5d7249639775054051c6d3ab` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:33.807081 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 81/168] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:29:33 2022] GET /identity/v3/role_assignments?user.id=79a88eb97e944d76b6e903c71c5cf94c&scope.project.id=f36f364f981e4cbb8bca50ac93a26b16&role.id=7cb00fff13fb4eefa6a734c91c0d59ea => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:33.808291 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a4bdd-363b-4b94-bc87-4a12577ac18a None admin] RBAC: Authorizing `identity:create_grant(project_id=f36f364f981e4cbb8bca50ac93a26b16, user_id=77c61e6dbfbb4fd19b53a2d4fe69c378, role_id=f003916a5d7249639775054051c6d3ab)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:33.809050 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed22de5-82a0-463b-b548-309818c1fbae None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:33.811017 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a4bdd-363b-4b94-bc87-4a12577ac18a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:33.855770 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 88/169] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 26 05:29:33 2022] PUT /identity/v3/projects/f36f364f981e4cbb8bca50ac93a26b16/users/77c61e6dbfbb4fd19b53a2d4fe69c378/roles/f003916a5d7249639775054051c6d3ab => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:33.855770 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a4bdd-363b-4b94-bc87-4a12577ac18a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:33.993833 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a4bdd-363b-4b94-bc87-4a12577ac18a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:34.034829 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b4398-d3cf-4d79-9cb8-3dd14768e302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:34.035524 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b4398-d3cf-4d79-9cb8-3dd14768e302 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:34.035844 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b4398-d3cf-4d79-9cb8-3dd14768e302 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:34.036121 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b4398-d3cf-4d79-9cb8-3dd14768e302 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:34.049960 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b4398-d3cf-4d79-9cb8-3dd14768e302 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:29:34.055331 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-1f2b4398-d3cf-4d79-9cb8-3dd14768e302 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:29:34.055331 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:34.055331 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:34.055331 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:34.055331 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:34.055331 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:34.055331 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:34.055331 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:34.055331 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:34.055331 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:34.055331 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:34.055331 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:34.055331 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:29:34.055331 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:29:34.055331 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:29:34.055331 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:29:34.056350 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:29:34.056350 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:29:34.056350 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:29:34.056350 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:29:34.056350 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:34.056350 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:34.056350 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:34.056350 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:34.056350 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:34.056350 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:34.056350 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:34.056350 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:34.056350 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:34.056350 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:34.056350 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:34.056350 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:34.057229 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:34.057229 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:34.057229 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:34.057229 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:34.057229 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:29:34.057229 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:29:34.057229 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:29:34.057229 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:29:34.057229 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:29:34.057229 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:29:34.057229 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:29:34.057229 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:29:34.061893 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 89/170] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:29:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:29:34.063490 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b4398-d3cf-4d79-9cb8-3dd14768e302 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:34.084537 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:34.150152 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed22de5-82a0-463b-b548-309818c1fbae None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:34.192467 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b4398-d3cf-4d79-9cb8-3dd14768e302 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:34.233936 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e981b4-308e-46a0-825b-e4df335f6662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:34.234572 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e981b4-308e-46a0-825b-e4df335f6662 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:34.234848 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e981b4-308e-46a0-825b-e4df335f6662 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:34.235116 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e981b4-308e-46a0-825b-e4df335f6662 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:34.235835 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e981b4-308e-46a0-825b-e4df335f6662 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:34.236202 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e981b4-308e-46a0-825b-e4df335f6662 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:34.237714 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e981b4-308e-46a0-825b-e4df335f6662 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:34.247596 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 90/171] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:29:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:29:34.253625 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e981b4-308e-46a0-825b-e4df335f6662 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:34.269403 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001813a-ad55-4a5c-95bb-1e3d81d77f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:34.270428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001813a-ad55-4a5c-95bb-1e3d81d77f6d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:34.270899 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001813a-ad55-4a5c-95bb-1e3d81d77f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:34.271494 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4001813a-ad55-4a5c-95bb-1e3d81d77f6d None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:34.272904 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001813a-ad55-4a5c-95bb-1e3d81d77f6d None admin] RBAC: Adding query filter params (name=member) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:34.273415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001813a-ad55-4a5c-95bb-1e3d81d77f6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:34.280472 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4001813a-ad55-4a5c-95bb-1e3d81d77f6d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:34.308370 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 82/172] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 26 05:29:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 500 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:34.315199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001813a-ad55-4a5c-95bb-1e3d81d77f6d None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:34.348695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:34.374098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e981b4-308e-46a0-825b-e4df335f6662 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:34.452932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a966dff-3936-4173-8fd3-2b5a918ea07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:34.453606 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a966dff-3936-4173-8fd3-2b5a918ea07f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:34.453884 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a966dff-3936-4173-8fd3-2b5a918ea07f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:34.454008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:34.454164 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a966dff-3936-4173-8fd3-2b5a918ea07f None admin] PATH_INFO: `/v3/users/68623c0b9d92445197ab588b18e08f43` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:34.456939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a966dff-3936-4173-8fd3-2b5a918ea07f None admin] RBAC: Authorizing `identity:get_user(user_id=68623c0b9d92445197ab588b18e08f43)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:34.458732 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a966dff-3936-4173-8fd3-2b5a918ea07f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:34.463990 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 91/173] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:29:34 2022] GET /identity/v3/users/68623c0b9d92445197ab588b18e08f43 => generated 247 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:34.468782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a966dff-3936-4173-8fd3-2b5a918ea07f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:34.587015 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a966dff-3936-4173-8fd3-2b5a918ea07f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:34.614872 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4001813a-ad55-4a5c-95bb-1e3d81d77f6d None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:34.625851 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf59f2-837b-40e8-b86e-215c857779c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:34.626479 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf59f2-837b-40e8-b86e-215c857779c9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:34.626755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf59f2-837b-40e8-b86e-215c857779c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:34.627021 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaf59f2-837b-40e8-b86e-215c857779c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:34.643812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:34.706573 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf59f2-837b-40e8-b86e-215c857779c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:34.708157 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaf59f2-837b-40e8-b86e-215c857779c9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:34.774273 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730576e-3927-441e-b973-69aff86f4a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:34.775444 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730576e-3927-441e-b973-69aff86f4a67 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:34.775969 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730576e-3927-441e-b973-69aff86f4a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:34.776450 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730576e-3927-441e-b973-69aff86f4a67 None admin] PATH_INFO: `/v3/users/79a88eb97e944d76b6e903c71c5cf94c` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:34.778690 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730576e-3927-441e-b973-69aff86f4a67 None admin] RBAC: Authorizing `identity:get_user(user_id=79a88eb97e944d76b6e903c71c5cf94c)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:34.781431 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730576e-3927-441e-b973-69aff86f4a67 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:34.784697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 83/174] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:29:34 2022] GET /identity/v3/users/79a88eb97e944d76b6e903c71c5cf94c => generated 275 bytes in 471 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:34.793453 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730576e-3927-441e-b973-69aff86f4a67 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:34.835921 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 92/175] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:29:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:34.837978 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf59f2-837b-40e8-b86e-215c857779c9 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:34.925187 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:35.013699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaf59f2-837b-40e8-b86e-215c857779c9 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:35.101942 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b14030-2036-4ce9-8552-a7fee45edb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:35.103121 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b14030-2036-4ce9-8552-a7fee45edb43 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:35.103614 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b14030-2036-4ce9-8552-a7fee45edb43 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:35.104103 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b14030-2036-4ce9-8552-a7fee45edb43 None admin] PATH_INFO: `/v3/projects/f36f364f981e4cbb8bca50ac93a26b16` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:35.105528 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b14030-2036-4ce9-8552-a7fee45edb43 None admin] RBAC: Authorizing `identity:get_project(project_id=f36f364f981e4cbb8bca50ac93a26b16)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:35.108004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b14030-2036-4ce9-8552-a7fee45edb43 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:35.115214 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 93/176] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:29:34 2022] GET /identity/v3/projects/f36f364f981e4cbb8bca50ac93a26b16 => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:35.117004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b14030-2036-4ce9-8552-a7fee45edb43 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:35.138617 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730576e-3927-441e-b973-69aff86f4a67 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:35.176282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:35.236368 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65234a-9400-4916-9996-bc298971a871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:35.237003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65234a-9400-4916-9996-bc298971a871 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:35.237276 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65234a-9400-4916-9996-bc298971a871 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:35.237542 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65234a-9400-4916-9996-bc298971a871 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:35.288229 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b14030-2036-4ce9-8552-a7fee45edb43 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:35.309831 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:35.352848 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b2e67-85bf-4aba-989b-f39443c01308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:35.353634 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b2e67-85bf-4aba-989b-f39443c01308 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:35.354016 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b2e67-85bf-4aba-989b-f39443c01308 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:35.354381 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b2e67-85bf-4aba-989b-f39443c01308 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:35.355603 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b2e67-85bf-4aba-989b-f39443c01308 None admin] RBAC: Adding query filter params (role.id=cf58d66369044fb09fa65a4366dc7446, scope.project.id=f36f364f981e4cbb8bca50ac93a26b16, user.id=68623c0b9d92445197ab588b18e08f43) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:35.356128 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b2e67-85bf-4aba-989b-f39443c01308 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:35.358600 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b2e67-85bf-4aba-989b-f39443c01308 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:35.372469 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 94/177] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:29:35 2022] GET /identity/v3/role_assignments?user.id=68623c0b9d92445197ab588b18e08f43&scope.project.id=f36f364f981e4cbb8bca50ac93a26b16&role.id=cf58d66369044fb09fa65a4366dc7446 => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:35.423983 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65234a-9400-4916-9996-bc298971a871 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:35.425491 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65234a-9400-4916-9996-bc298971a871 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:35.548953 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1e592-a37f-4d9e-ba75-4eb0105bd08a None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:35.549451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1e592-a37f-4d9e-ba75-4eb0105bd08a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:35.549601 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1e592-a37f-4d9e-ba75-4eb0105bd08a None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:35.551330 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 95/178] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:35.559228 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf0adb-1362-48fa-8d6e-d71fab56547f None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:35.559625 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf0adb-1362-48fa-8d6e-d71fab56547f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:35.559815 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf0adb-1362-48fa-8d6e-d71fab56547f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:35.584021 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-e7cf0adb-1362-48fa-8d6e-d71fab56547f None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:35.586474 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e7cf0adb-1362-48fa-8d6e-d71fab56547f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:35.612783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 84/179] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:29:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 820 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:35.614012 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30f77b-785b-4ef7-8779-63c1c6a6f019 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:35.614290 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30f77b-785b-4ef7-8779-63c1c6a6f019 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:35.614555 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b30f77b-785b-4ef7-8779-63c1c6a6f019 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:35.616269 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 85/180] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:35.620943 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30f77b-785b-4ef7-8779-63c1c6a6f019 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:35.664675 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:35.695389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 96/181] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:29:35.710344 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87c697-7827-463c-be90-d399db3f70ba None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:35.710626 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87c697-7827-463c-be90-d399db3f70ba None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:35.711035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87c697-7827-463c-be90-d399db3f70ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:35.740564 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-dc87c697-7827-463c-be90-d399db3f70ba None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:35.743981 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-dc87c697-7827-463c-be90-d399db3f70ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:35.872620 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b30f77b-785b-4ef7-8779-63c1c6a6f019 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:35.895446 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 97/182] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:29:35.931400 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c79c54-ec1b-461a-98e4-3c83a91b523d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:35.932103 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c79c54-ec1b-461a-98e4-3c83a91b523d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:35.932375 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c79c54-ec1b-461a-98e4-3c83a91b523d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:35.932641 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c79c54-ec1b-461a-98e4-3c83a91b523d None admin] PATH_INFO: `/v3/projects/bcf2f6a7c6e84ca9a2f7a3c3f3f878e0` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:35.933798 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c79c54-ec1b-461a-98e4-3c83a91b523d None admin] RBAC: Authorizing `identity:get_project(project_id=bcf2f6a7c6e84ca9a2f7a3c3f3f878e0)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:35.940872 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c79c54-ec1b-461a-98e4-3c83a91b523d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:35.942667 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 86/183] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:29:35 2022] GET /identity/v3/projects/bcf2f6a7c6e84ca9a2f7a3c3f3f878e0 => generated 312 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:29:35.949006 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87c697-7827-463c-be90-d399db3f70ba None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:36.000245 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:36.091751 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87c697-7827-463c-be90-d399db3f70ba None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:36.146225 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5d3d5-7520-4007-bb11-94487ad995c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:36.146777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5d3d5-7520-4007-bb11-94487ad995c7 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:36.147131 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5d3d5-7520-4007-bb11-94487ad995c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:36.147401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5d3d5-7520-4007-bb11-94487ad995c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:36.148172 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb5d3d5-7520-4007-bb11-94487ad995c7 None admin] RBAC: Adding query filter params (role.id=c5a02c4618d94f1da7257ef437b8ce9e, scope.project.id=bcf2f6a7c6e84ca9a2f7a3c3f3f878e0, user.id=79a88eb97e944d76b6e903c71c5cf94c) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:36.148477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb5d3d5-7520-4007-bb11-94487ad995c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:36.149978 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb5d3d5-7520-4007-bb11-94487ad995c7 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:36.162258 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 98/184] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:29:35 2022] GET /identity/v3/role_assignments?user.id=79a88eb97e944d76b6e903c71c5cf94c&scope.project.id=bcf2f6a7c6e84ca9a2f7a3c3f3f878e0&role.id=c5a02c4618d94f1da7257ef437b8ce9e => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:36.235774 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c79c54-ec1b-461a-98e4-3c83a91b523d None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:36.334597 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5d3d5-7520-4007-bb11-94487ad995c7 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:36.358187 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:36.379894 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c79c54-ec1b-461a-98e4-3c83a91b523d None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:36.421870 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa75cf-b8ad-454c-93be-6ea140d29b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:36.422534 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa75cf-b8ad-454c-93be-6ea140d29b8d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:36.422808 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa75cf-b8ad-454c-93be-6ea140d29b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:36.423070 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa75cf-b8ad-454c-93be-6ea140d29b8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:36.434892 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa75cf-b8ad-454c-93be-6ea140d29b8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:29:36.440052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-d6fa75cf-b8ad-454c-93be-6ea140d29b8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:29:36.440052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:36.440052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:36.440052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:36.440052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:36.440052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:36.440052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:36.440052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:36.440052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:36.440052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:36.440052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:36.440052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:36.440052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:29:36.440052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:29:36.440052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:29:36.440052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:29:36.441906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:29:36.441906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:29:36.441906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:29:36.441906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:29:36.441906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:36.441906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:36.441906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:36.441906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:36.441906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:36.441906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:36.441906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:36.441906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:36.441906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:36.441906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:36.441906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:36.441906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:36.443518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:36.443518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:36.443518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:36.443518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:36.443518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:29:36.443518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:29:36.443518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:29:36.443518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:29:36.443518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:29:36.443518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:29:36.443518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:29:36.443518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:29:36.443518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 87/185] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:29:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:29:36.443518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14c313-ea68-4510-8de4-9e9468aef9bb None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:36.445012 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14c313-ea68-4510-8de4-9e9468aef9bb None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:36.445012 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14c313-ea68-4510-8de4-9e9468aef9bb None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:36.445012 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 88/186] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:36.451778 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14c313-ea68-4510-8de4-9e9468aef9bb None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:36.522332 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:36.530445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5d3d5-7520-4007-bb11-94487ad995c7 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:36.585901 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14c313-ea68-4510-8de4-9e9468aef9bb None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:36.590401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890e60b-a42d-4ede-8275-4c3911c7e533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:36.591484 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890e60b-a42d-4ede-8275-4c3911c7e533 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:36.592007 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890e60b-a42d-4ede-8275-4c3911c7e533 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:36.592491 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890e60b-a42d-4ede-8275-4c3911c7e533 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:36.594432 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890e60b-a42d-4ede-8275-4c3911c7e533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:36.597291 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890e60b-a42d-4ede-8275-4c3911c7e533 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:36.600504 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 99/187] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:29:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:36.602508 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847aa4b-a118-4dd5-b3e5-5bc63751c8f6 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:36.602895 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847aa4b-a118-4dd5-b3e5-5bc63751c8f6 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:36.603339 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847aa4b-a118-4dd5-b3e5-5bc63751c8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:36.628526 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-9847aa4b-a118-4dd5-b3e5-5bc63751c8f6 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:36.629918 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9847aa4b-a118-4dd5-b3e5-5bc63751c8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:36.633283 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebd7ba-07ad-49b4-8988-7ab828d0a546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:36.634244 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebd7ba-07ad-49b4-8988-7ab828d0a546 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:36.634615 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebd7ba-07ad-49b4-8988-7ab828d0a546 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:36.635019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bebd7ba-07ad-49b4-8988-7ab828d0a546 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:36.635918 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebd7ba-07ad-49b4-8988-7ab828d0a546 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:36.636354 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebd7ba-07ad-49b4-8988-7ab828d0a546 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:36.637869 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bebd7ba-07ad-49b4-8988-7ab828d0a546 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:36.649584 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 89/188] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:29:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:36.650678 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebd7ba-07ad-49b4-8988-7ab828d0a546 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:36.662232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:36.720037 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 100/189] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:29:36.730519 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847aa4b-a118-4dd5-b3e5-5bc63751c8f6 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:36.812904 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bebd7ba-07ad-49b4-8988-7ab828d0a546 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:36.872760 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61059a-2653-40c0-8aa4-c51d22aeaa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:36.873401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61059a-2653-40c0-8aa4-c51d22aeaa21 None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:36.873674 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61059a-2653-40c0-8aa4-c51d22aeaa21 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:36.873938 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61059a-2653-40c0-8aa4-c51d22aeaa21 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:36.874884 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c61059a-2653-40c0-8aa4-c51d22aeaa21 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:36.877050 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c61059a-2653-40c0-8aa4-c51d22aeaa21 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:36.881597 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:36.891111 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847aa4b-a118-4dd5-b3e5-5bc63751c8f6 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:36.915774 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 90/190] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 26 05:29:36 2022] POST /identity/v3/users => generated 297 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:36.970416 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb20e4e-55bc-4a77-bdc7-c7a135ed26f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:36.971340 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb20e4e-55bc-4a77-bdc7-c7a135ed26f4 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:36.971854 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb20e4e-55bc-4a77-bdc7-c7a135ed26f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:36.972296 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb20e4e-55bc-4a77-bdc7-c7a135ed26f4 None admin] PATH_INFO: `/v3/users/713d7c7a73f14c70af055650ec8cd26c` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:36.999242 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb20e4e-55bc-4a77-bdc7-c7a135ed26f4 None admin] RBAC: Authorizing `identity:get_user(user_id=713d7c7a73f14c70af055650ec8cd26c)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:37.001864 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb20e4e-55bc-4a77-bdc7-c7a135ed26f4 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:37.004914 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 101/191] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:29:36 2022] GET /identity/v3/users/713d7c7a73f14c70af055650ec8cd26c => generated 283 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:37.011143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61059a-2653-40c0-8aa4-c51d22aeaa21 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:37.087015 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb20e4e-55bc-4a77-bdc7-c7a135ed26f4 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:37.112535 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:37.160248 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61059a-2653-40c0-8aa4-c51d22aeaa21 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:37.206657 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3797a3-5f8a-4b4a-8c1d-2bcda6989b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:37.207382 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3797a3-5f8a-4b4a-8c1d-2bcda6989b23 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:37.207589 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3797a3-5f8a-4b4a-8c1d-2bcda6989b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:37.207938 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3797a3-5f8a-4b4a-8c1d-2bcda6989b23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:37.262542 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb20e4e-55bc-4a77-bdc7-c7a135ed26f4 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:37.314809 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3797a3-5f8a-4b4a-8c1d-2bcda6989b23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:37.318732 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3797a3-5f8a-4b4a-8c1d-2bcda6989b23 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:37.326792 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db4de4-ee73-4e4d-97b3-3f223c2dfa30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:37.327958 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db4de4-ee73-4e4d-97b3-3f223c2dfa30 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:37.328428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db4de4-ee73-4e4d-97b3-3f223c2dfa30 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:37.329772 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db4de4-ee73-4e4d-97b3-3f223c2dfa30 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:37.348447 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db4de4-ee73-4e4d-97b3-3f223c2dfa30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:29:37.354653 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-49db4de4-ee73-4e4d-97b3-3f223c2dfa30 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:29:37.354653 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:37.354653 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:37.354653 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:37.354653 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:37.354653 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:37.354653 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:37.354653 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:37.354653 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:37.354653 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:37.354653 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:37.354653 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:37.354653 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:29:37.354653 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:29:37.354653 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:29:37.354653 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:29:37.355700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:29:37.355700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:29:37.355700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:29:37.355700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:29:37.355700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:37.355700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:37.355700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:37.355700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:37.355700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:37.355700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:37.355700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:37.355700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:37.355700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:37.355700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:37.355700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:37.355700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:37.356716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:37.356716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:37.356716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:37.356716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:37.356716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:29:37.356716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:29:37.356716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:29:37.356716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:29:37.356716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:29:37.356716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:29:37.356716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:29:37.356716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:29:37.360261 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 102/192] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 26 05:29:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:29:37.367145 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db4de4-ee73-4e4d-97b3-3f223c2dfa30 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:37.388576 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:37.421796 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:37.490016 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 91/193] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:29:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:37.496584 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3797a3-5f8a-4b4a-8c1d-2bcda6989b23 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:37.554119 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db4de4-ee73-4e4d-97b3-3f223c2dfa30 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:37.632823 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11d94f-1c21-4454-8d38-ed47587145a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:37.633676 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11d94f-1c21-4454-8d38-ed47587145a0 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:37.633954 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11d94f-1c21-4454-8d38-ed47587145a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:37.634221 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be11d94f-1c21-4454-8d38-ed47587145a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:37.634907 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11d94f-1c21-4454-8d38-ed47587145a0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:37.635211 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11d94f-1c21-4454-8d38-ed47587145a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:37.636671 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be11d94f-1c21-4454-8d38-ed47587145a0 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:37.658850 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 103/194] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:29:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:37.665336 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11d94f-1c21-4454-8d38-ed47587145a0 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:37.681857 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3797a3-5f8a-4b4a-8c1d-2bcda6989b23 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:37.776271 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:37.788889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74039154-1a04-4d79-8ac3-85765131bc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:37.789990 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74039154-1a04-4d79-8ac3-85765131bc57 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:37.790452 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74039154-1a04-4d79-8ac3-85765131bc57 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:37.791818 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74039154-1a04-4d79-8ac3-85765131bc57 None admin] PATH_INFO: `/v3/projects/61304b31bc674654a80d1255b6e98ad3` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:37.794694 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74039154-1a04-4d79-8ac3-85765131bc57 None admin] RBAC: Authorizing `identity:get_project(project_id=61304b31bc674654a80d1255b6e98ad3)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:37.797203 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74039154-1a04-4d79-8ac3-85765131bc57 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:37.799400 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 92/195] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:29:37 2022] GET /identity/v3/projects/61304b31bc674654a80d1255b6e98ad3 => generated 302 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:37.802876 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5986d7-de25-4e02-8970-883304e2387c None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:37.805389 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5986d7-de25-4e02-8970-883304e2387c None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:37.805389 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5986d7-de25-4e02-8970-883304e2387c None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:37.811986 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 93/196] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:37.811986 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5986d7-de25-4e02-8970-883304e2387c None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:37.825095 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be11d94f-1c21-4454-8d38-ed47587145a0 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:37.848059 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:37.908545 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2948816f-1148-4f1f-bf7d-cd1c3e7c64e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:37.910185 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948816f-1148-4f1f-bf7d-cd1c3e7c64e7 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:37.910800 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948816f-1148-4f1f-bf7d-cd1c3e7c64e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:37.911709 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948816f-1148-4f1f-bf7d-cd1c3e7c64e7 None admin] PATH_INFO: `/v3/users/713d7c7a73f14c70af055650ec8cd26c` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:37.914918 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2948816f-1148-4f1f-bf7d-cd1c3e7c64e7 None admin] RBAC: Authorizing `identity:get_user(user_id=713d7c7a73f14c70af055650ec8cd26c)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:37.918732 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2948816f-1148-4f1f-bf7d-cd1c3e7c64e7 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:37.927770 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 104/197] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:29:37 2022] GET /identity/v3/users/713d7c7a73f14c70af055650ec8cd26c => generated 283 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:37.927770 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2c844-d249-4740-9720-62dd907b2b62 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:37.927770 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2c844-d249-4740-9720-62dd907b2b62 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:37.927770 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2c844-d249-4740-9720-62dd907b2b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:37.949792 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5986d7-de25-4e02-8970-883304e2387c None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:37.953902 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-cdd2c844-d249-4740-9720-62dd907b2b62 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:37.956295 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-cdd2c844-d249-4740-9720-62dd907b2b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:38.014625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cffe38-e515-4f94-a139-c104302fbb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:38.018085 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cffe38-e515-4f94-a139-c104302fbb07 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:38.018844 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cffe38-e515-4f94-a139-c104302fbb07 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:38.019531 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cffe38-e515-4f94-a139-c104302fbb07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:38.021272 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cffe38-e515-4f94-a139-c104302fbb07 None admin] RBAC: Adding query filter params (role.id=cf58d66369044fb09fa65a4366dc7446, scope.project.id=61304b31bc674654a80d1255b6e98ad3, user.id=713d7c7a73f14c70af055650ec8cd26c) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:38.022135 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cffe38-e515-4f94-a139-c104302fbb07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:38.025212 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cffe38-e515-4f94-a139-c104302fbb07 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:38.035426 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 94/198] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:29:37 2022] GET /identity/v3/role_assignments?user.id=713d7c7a73f14c70af055650ec8cd26c&scope.project.id=61304b31bc674654a80d1255b6e98ad3&role.id=cf58d66369044fb09fa65a4366dc7446 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:38.037610 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cffe38-e515-4f94-a139-c104302fbb07 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:38.038901 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 105/199] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:29:38.224786 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:38.237768 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cffe38-e515-4f94-a139-c104302fbb07 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:38.301148 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2585b-b694-467c-ae2c-da6286238859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:38.302746 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2585b-b694-467c-ae2c-da6286238859 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:38.303575 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2585b-b694-467c-ae2c-da6286238859 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:38.304313 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd2585b-b694-467c-ae2c-da6286238859 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:38.409037 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd2585b-b694-467c-ae2c-da6286238859 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:38.411383 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd2585b-b694-467c-ae2c-da6286238859 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:38.445951 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2c844-d249-4740-9720-62dd907b2b62 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:38.552363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:38.564293 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 95/200] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:29:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:38.572188 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2585b-b694-467c-ae2c-da6286238859 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:38.617460 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:38.676893 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2c844-d249-4740-9720-62dd907b2b62 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:38.774927 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea2995-9457-4d1e-9d85-8b3f605a23f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:38.775664 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea2995-9457-4d1e-9d85-8b3f605a23f1 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:38.775966 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea2995-9457-4d1e-9d85-8b3f605a23f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:38.776234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea2995-9457-4d1e-9d85-8b3f605a23f1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:38.799470 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea2995-9457-4d1e-9d85-8b3f605a23f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:29:38.804592 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-bbea2995-9457-4d1e-9d85-8b3f605a23f1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:29:38.804592 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:38.804592 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:38.804592 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:38.804592 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:38.804592 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:38.804592 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:38.804592 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:38.804592 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:38.804592 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:38.804592 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:38.804592 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:38.804592 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:29:38.804592 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:29:38.804592 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:29:38.804592 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:29:38.805481 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:29:38.805481 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:29:38.805481 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:29:38.805481 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:29:38.805481 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:38.805481 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:38.805481 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:38.805481 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:38.805481 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:38.805481 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:38.805481 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:38.805481 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:38.805481 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:38.805481 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:38.805481 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:38.805481 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:38.806289 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:38.806289 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:38.806289 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:38.806289 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:38.806289 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:29:38.806289 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:29:38.806289 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:29:38.806289 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:29:38.806289 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:29:38.806289 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:29:38.806289 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:29:38.806289 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:29:38.809300 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 106/201] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:29:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:29:38.819248 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea2995-9457-4d1e-9d85-8b3f605a23f1 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:38.829026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd2585b-b694-467c-ae2c-da6286238859 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:38.899399 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34965c-d3f7-4c36-ae6a-1c24a9502822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:38.900961 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34965c-d3f7-4c36-ae6a-1c24a9502822 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:38.901687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34965c-d3f7-4c36-ae6a-1c24a9502822 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:38.902405 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34965c-d3f7-4c36-ae6a-1c24a9502822 None admin] PATH_INFO: `/v3/projects/61304b31bc674654a80d1255b6e98ad3` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:38.906134 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34965c-d3f7-4c36-ae6a-1c24a9502822 None admin] RBAC: Authorizing `identity:get_project(project_id=61304b31bc674654a80d1255b6e98ad3)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:38.910399 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34965c-d3f7-4c36-ae6a-1c24a9502822 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:38.918141 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 96/202] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:29:38 2022] GET /identity/v3/projects/61304b31bc674654a80d1255b6e98ad3 => generated 302 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:29:38.921817 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34965c-d3f7-4c36-ae6a-1c24a9502822 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:39.078567 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea2995-9457-4d1e-9d85-8b3f605a23f1 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:39.093914 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:39.157264 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afd70a-c17c-4d4d-9e72-353429bdfcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:39.157997 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afd70a-c17c-4d4d-9e72-353429bdfcfa None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:39.158159 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afd70a-c17c-4d4d-9e72-353429bdfcfa None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:39.158436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afd70a-c17c-4d4d-9e72-353429bdfcfa None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:39.159140 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7afd70a-c17c-4d4d-9e72-353429bdfcfa None admin] RBAC: Adding query filter params (name=reader) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:39.159438 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7afd70a-c17c-4d4d-9e72-353429bdfcfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:39.160988 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7afd70a-c17c-4d4d-9e72-353429bdfcfa None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:39.169070 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:39.176478 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34965c-d3f7-4c36-ae6a-1c24a9502822 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:39.184169 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 107/203] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 26 05:29:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:39.210186 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afd70a-c17c-4d4d-9e72-353429bdfcfa None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:39.262037 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b66dd5-7f2f-4369-aec6-20bb76ff35d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:39.263680 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b66dd5-7f2f-4369-aec6-20bb76ff35d4 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:39.264445 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b66dd5-7f2f-4369-aec6-20bb76ff35d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:39.265427 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b66dd5-7f2f-4369-aec6-20bb76ff35d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:39.267062 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b66dd5-7f2f-4369-aec6-20bb76ff35d4 None admin] RBAC: Adding query filter params (role.id=7cb00fff13fb4eefa6a734c91c0d59ea, scope.project.id=61304b31bc674654a80d1255b6e98ad3, user.id=713d7c7a73f14c70af055650ec8cd26c) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:39.267948 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b66dd5-7f2f-4369-aec6-20bb76ff35d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:39.271113 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b66dd5-7f2f-4369-aec6-20bb76ff35d4 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:39.285459 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 97/204] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:29:38 2022] GET /identity/v3/role_assignments?user.id=713d7c7a73f14c70af055650ec8cd26c&scope.project.id=61304b31bc674654a80d1255b6e98ad3&role.id=7cb00fff13fb4eefa6a734c91c0d59ea => generated 259 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:29:39.398491 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afd70a-c17c-4d4d-9e72-353429bdfcfa None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:39.453448 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f45ef-7328-46bd-921a-63982b5ab7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:39.454478 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f45ef-7328-46bd-921a-63982b5ab7cd None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:39.454478 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f45ef-7328-46bd-921a-63982b5ab7cd None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:39.454692 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f45ef-7328-46bd-921a-63982b5ab7cd None admin] PATH_INFO: `/v3/users/77c61e6dbfbb4fd19b53a2d4fe69c378` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:39.455961 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f45ef-7328-46bd-921a-63982b5ab7cd None admin] RBAC: Authorizing `identity:get_user(user_id=77c61e6dbfbb4fd19b53a2d4fe69c378)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:39.457523 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f45ef-7328-46bd-921a-63982b5ab7cd None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:39.459343 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 108/205] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:29:39 2022] GET /identity/v3/users/77c61e6dbfbb4fd19b53a2d4fe69c378 => generated 289 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:39.468953 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b66dd5-7f2f-4369-aec6-20bb76ff35d4 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:39.607199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b66dd5-7f2f-4369-aec6-20bb76ff35d4 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:39.641357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:39.651044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f4805-9c7c-4023-a733-1e8e57eab8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:39.651582 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f4805-9c7c-4023-a733-1e8e57eab8f7 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:39.651886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f4805-9c7c-4023-a733-1e8e57eab8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:39.652164 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f4805-9c7c-4023-a733-1e8e57eab8f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:39.745740 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f4805-9c7c-4023-a733-1e8e57eab8f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:39.747238 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f4805-9c7c-4023-a733-1e8e57eab8f7 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:39.888766 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 98/206] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:29:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:39.894601 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f45ef-7328-46bd-921a-63982b5ab7cd None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:40.051177 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:40.101642 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f45ef-7328-46bd-921a-63982b5ab7cd None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:40.157709 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89d8c3-4b86-42a0-a3c9-41173eec031d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:40.158380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89d8c3-4b86-42a0-a3c9-41173eec031d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:40.158650 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89d8c3-4b86-42a0-a3c9-41173eec031d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:40.158920 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89d8c3-4b86-42a0-a3c9-41173eec031d None admin] PATH_INFO: `/v3/projects/f36f364f981e4cbb8bca50ac93a26b16` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:40.160141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89d8c3-4b86-42a0-a3c9-41173eec031d None admin] RBAC: Authorizing `identity:get_project(project_id=f36f364f981e4cbb8bca50ac93a26b16)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:40.161648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89d8c3-4b86-42a0-a3c9-41173eec031d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:40.163821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 109/207] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:29:39 2022] GET /identity/v3/projects/f36f364f981e4cbb8bca50ac93a26b16 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:40.172702 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f4805-9c7c-4023-a733-1e8e57eab8f7 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:40.207782 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:40.306352 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f4805-9c7c-4023-a733-1e8e57eab8f7 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:40.363375 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699096e9-3c7f-4bd1-9977-593da1f22c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:40.364042 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699096e9-3c7f-4bd1-9977-593da1f22c30 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:40.364316 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699096e9-3c7f-4bd1-9977-593da1f22c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:40.364587 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699096e9-3c7f-4bd1-9977-593da1f22c30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:40.365344 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699096e9-3c7f-4bd1-9977-593da1f22c30 None admin] RBAC: Adding query filter params (role.id=f003916a5d7249639775054051c6d3ab, scope.project.id=f36f364f981e4cbb8bca50ac93a26b16, user.id=77c61e6dbfbb4fd19b53a2d4fe69c378) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:40.365648 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699096e9-3c7f-4bd1-9977-593da1f22c30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:40.367184 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699096e9-3c7f-4bd1-9977-593da1f22c30 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:40.374379 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 99/208] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:29:40 2022] GET /identity/v3/role_assignments?user.id=77c61e6dbfbb4fd19b53a2d4fe69c378&scope.project.id=f36f364f981e4cbb8bca50ac93a26b16&role.id=f003916a5d7249639775054051c6d3ab => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:29:40.440503 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e33c2-edf3-4e78-ace9-598db9979295 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:40.440906 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e33c2-edf3-4e78-ace9-598db9979295 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:40.441139 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e33c2-edf3-4e78-ace9-598db9979295 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:40.442722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 110/209] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:29:40.448817 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c515a-23ba-462c-8b86-5cb9827f397d None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:40.449204 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c515a-23ba-462c-8b86-5cb9827f397d None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:40.449419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c515a-23ba-462c-8b86-5cb9827f397d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:40.485060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-633c515a-23ba-462c-8b86-5cb9827f397d None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:40.486304 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-633c515a-23ba-462c-8b86-5cb9827f397d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:40.590894 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 100/210] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:29:40.638169 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d991405-9ade-4da8-8833-106da45da197 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:40.639093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d991405-9ade-4da8-8833-106da45da197 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:40.639093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d991405-9ade-4da8-8833-106da45da197 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:40.640458 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 111/211] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:40.646335 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dba2f8-4c63-4fa4-a1f1-cebe745b48d3 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:40.646643 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dba2f8-4c63-4fa4-a1f1-cebe745b48d3 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:40.646881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dba2f8-4c63-4fa4-a1f1-cebe745b48d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:40.676946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-b3dba2f8-4c63-4fa4-a1f1-cebe745b48d3 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:40.678180 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b3dba2f8-4c63-4fa4-a1f1-cebe745b48d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:40.695316 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:40.781396 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 101/212] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:29:40.910586 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d991405-9ade-4da8-8833-106da45da197 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:41.046883 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d991405-9ade-4da8-8833-106da45da197 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:41.083295 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dba2f8-4c63-4fa4-a1f1-cebe745b48d3 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:41.096080 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076e9d0-ad6b-40ed-ab6a-4201b530dabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:41.097104 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076e9d0-ad6b-40ed-ab6a-4201b530dabe None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:41.097569 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076e9d0-ad6b-40ed-ab6a-4201b530dabe None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:41.098041 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076e9d0-ad6b-40ed-ab6a-4201b530dabe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:41.099625 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076e9d0-ad6b-40ed-ab6a-4201b530dabe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:41.101409 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076e9d0-ad6b-40ed-ab6a-4201b530dabe None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:41.106129 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 112/213] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:29:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:41.114850 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076e9d0-ad6b-40ed-ab6a-4201b530dabe None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:41.119452 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:41.241701 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dba2f8-4c63-4fa4-a1f1-cebe745b48d3 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:41.256103 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076e9d0-ad6b-40ed-ab6a-4201b530dabe None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:41.278218 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc189e54-9e4a-48e4-8991-0e80a2fb5320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:41.278864 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc189e54-9e4a-48e4-8991-0e80a2fb5320 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:41.279138 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc189e54-9e4a-48e4-8991-0e80a2fb5320 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:41.279406 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc189e54-9e4a-48e4-8991-0e80a2fb5320 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:41.290269 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc189e54-9e4a-48e4-8991-0e80a2fb5320 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:29:41.293780 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39296d80-0327-4bd3-898c-1f3e69d864f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:41.294408 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39296d80-0327-4bd3-898c-1f3e69d864f2 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:41.294785 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39296d80-0327-4bd3-898c-1f3e69d864f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:41.294940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39296d80-0327-4bd3-898c-1f3e69d864f2 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:41.295230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-cc189e54-9e4a-48e4-8991-0e80a2fb5320 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:29:41.295230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:41.295230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:41.295230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:41.295230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:41.295230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:41.295230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:41.295230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:41.295230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:41.295230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:41.295230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:41.295230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:41.295230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:29:41.295230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:29:41.295230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:29:41.295230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:29:41.298656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:29:41.298656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:29:41.298656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:29:41.298656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:29:41.298656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:41.298656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:41.298656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:41.298656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:41.298656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:41.298656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:41.298656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:41.298656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:41.298656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:41.298656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:41.298656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:41.298656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:41.300357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:41.300357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:41.300357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:41.300357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:41.300357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:29:41.300357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:29:41.300357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:29:41.300357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:29:41.300357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:29:41.300357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:29:41.300357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:29:41.300357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:29:41.301888 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39296d80-0327-4bd3-898c-1f3e69d864f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:41.301888 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39296d80-0327-4bd3-898c-1f3e69d864f2 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:41.302169 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 102/214] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:29:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:29:41.302871 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde281b5-9b6d-4bac-a79d-d85ef8621dda None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:41.303157 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde281b5-9b6d-4bac-a79d-d85ef8621dda None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:41.303485 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde281b5-9b6d-4bac-a79d-d85ef8621dda None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:41.307866 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 103/215] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:41.307866 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde281b5-9b6d-4bac-a79d-d85ef8621dda None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:41.335774 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 113/216] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 26 05:29:41 2022] POST /identity/v3/users => generated 297 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:29:41.335774 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d05565-690c-4ce7-9d17-7e91775d8e99 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:41.335774 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d05565-690c-4ce7-9d17-7e91775d8e99 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:41.336341 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d05565-690c-4ce7-9d17-7e91775d8e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:41.340419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:41.362779 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-27d05565-690c-4ce7-9d17-7e91775d8e99 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:41.364454 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-27d05565-690c-4ce7-9d17-7e91775d8e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:41.441393 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:41.475910 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 114/217] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:29:41.507668 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde281b5-9b6d-4bac-a79d-d85ef8621dda None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:41.549181 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7f6ba-3ed4-433f-91f5-edfef2335a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:41.549819 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7f6ba-3ed4-433f-91f5-edfef2335a1d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:41.550090 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7f6ba-3ed4-433f-91f5-edfef2335a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:41.550353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7f6ba-3ed4-433f-91f5-edfef2335a1d None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:41.551012 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7f6ba-3ed4-433f-91f5-edfef2335a1d None admin] RBAC: Adding query filter params (name=member) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:41.551303 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7f6ba-3ed4-433f-91f5-edfef2335a1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:41.552747 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7f6ba-3ed4-433f-91f5-edfef2335a1d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:41.562471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 104/218] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 26 05:29:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:41.568355 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d05565-690c-4ce7-9d17-7e91775d8e99 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:41.713622 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d05565-690c-4ce7-9d17-7e91775d8e99 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:41.752376 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de1101-2433-48fe-9b14-009b76d42d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:41.753048 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de1101-2433-48fe-9b14-009b76d42d5a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:41.753330 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de1101-2433-48fe-9b14-009b76d42d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:41.753601 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de1101-2433-48fe-9b14-009b76d42d5a None admin] PATH_INFO: `/v3/users/90e75ca8f5ea421db00e58acafb882ed` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:41.772533 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de1101-2433-48fe-9b14-009b76d42d5a None admin] RBAC: Authorizing `identity:get_user(user_id=90e75ca8f5ea421db00e58acafb882ed)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:41.774131 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de1101-2433-48fe-9b14-009b76d42d5a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:41.776276 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 115/219] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:29:41 2022] GET /identity/v3/users/90e75ca8f5ea421db00e58acafb882ed => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:29:41.782129 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7f6ba-3ed4-433f-91f5-edfef2335a1d None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:41.802114 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de1101-2433-48fe-9b14-009b76d42d5a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:41.863610 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:41.886127 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:41.931059 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7f6ba-3ed4-433f-91f5-edfef2335a1d None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:41.967472 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de1101-2433-48fe-9b14-009b76d42d5a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:41.981755 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8bb7ea-4fed-4efc-a825-bc007707a18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:41.982562 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bb7ea-4fed-4efc-a825-bc007707a18f None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:41.982946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bb7ea-4fed-4efc-a825-bc007707a18f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:41.983315 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bb7ea-4fed-4efc-a825-bc007707a18f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:42.072293 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b1f22a-6304-4720-912c-a4546b545435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:42.073025 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1f22a-6304-4720-912c-a4546b545435 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:42.073701 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1f22a-6304-4720-912c-a4546b545435 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:42.073983 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b1f22a-6304-4720-912c-a4546b545435 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:42.081231 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8bb7ea-4fed-4efc-a825-bc007707a18f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:42.083064 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8bb7ea-4fed-4efc-a825-bc007707a18f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:42.088909 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b1f22a-6304-4720-912c-a4546b545435 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:29:42.095164 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-38b1f22a-6304-4720-912c-a4546b545435 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:29:42.095164 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:42.095164 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:42.095164 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:42.095164 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:42.095164 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:42.095164 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:42.095164 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:42.095164 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:42.095164 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:42.095164 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:42.095164 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:42.095164 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:29:42.095164 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:29:42.095164 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:29:42.095164 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:29:42.096779 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:29:42.096779 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:29:42.096779 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:29:42.096779 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:29:42.096779 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:42.096779 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:42.096779 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:42.096779 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:42.096779 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:42.096779 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:42.096779 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:42.096779 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:42.096779 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:42.096779 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:42.096779 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:42.096779 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:42.098332 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:42.098332 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:42.098332 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:42.098332 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:42.098332 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:29:42.098332 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:29:42.098332 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:29:42.098332 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:29:42.098332 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:29:42.098332 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:29:42.098332 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:29:42.098332 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:29:42.098332 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 116/220] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:29:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:29:42.098332 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659c8ca-2d8c-4526-bc6a-06babba77d6d None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:42.099563 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659c8ca-2d8c-4526-bc6a-06babba77d6d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:42.099563 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659c8ca-2d8c-4526-bc6a-06babba77d6d None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:42.103920 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 117/221] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:42.105546 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659c8ca-2d8c-4526-bc6a-06babba77d6d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:42.182715 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:42.220678 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 105/222] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:29:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:42.222248 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff0136-da03-4f08-b018-5ba32b78ead1 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:42.222517 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff0136-da03-4f08-b018-5ba32b78ead1 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:42.222797 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff0136-da03-4f08-b018-5ba32b78ead1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:42.244745 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-7fff0136-da03-4f08-b018-5ba32b78ead1 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:42.246443 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-7fff0136-da03-4f08-b018-5ba32b78ead1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:42.298637 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659c8ca-2d8c-4526-bc6a-06babba77d6d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:42.309132 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:42.326322 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 106/223] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:29:42.327502 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff0136-da03-4f08-b018-5ba32b78ead1 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:42.351455 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d961ef-fb73-4f63-a59b-bb16426b7d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:42.352695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d961ef-fb73-4f63-a59b-bb16426b7d99 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:42.353227 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d961ef-fb73-4f63-a59b-bb16426b7d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:42.353986 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d961ef-fb73-4f63-a59b-bb16426b7d99 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:42.355178 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d961ef-fb73-4f63-a59b-bb16426b7d99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:42.355880 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d961ef-fb73-4f63-a59b-bb16426b7d99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:42.358112 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d961ef-fb73-4f63-a59b-bb16426b7d99 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:42.370587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 118/224] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:29:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:42.378274 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d961ef-fb73-4f63-a59b-bb16426b7d99 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:42.456353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff0136-da03-4f08-b018-5ba32b78ead1 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:42.458332 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:42.532651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1c552-aa18-4035-9230-9a6a14473ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:42.533543 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1c552-aa18-4035-9230-9a6a14473ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:42.533663 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1c552-aa18-4035-9230-9a6a14473ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:42.534021 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1c552-aa18-4035-9230-9a6a14473ff2 None admin] PATH_INFO: `/v3/projects/61304b31bc674654a80d1255b6e98ad3` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:42.535269 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de1c552-aa18-4035-9230-9a6a14473ff2 None admin] RBAC: Authorizing `identity:get_project(project_id=61304b31bc674654a80d1255b6e98ad3)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:42.536864 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de1c552-aa18-4035-9230-9a6a14473ff2 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:42.538827 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 107/225] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:29:42 2022] GET /identity/v3/projects/61304b31bc674654a80d1255b6e98ad3 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:42.544945 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1c552-aa18-4035-9230-9a6a14473ff2 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:42.591927 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d961ef-fb73-4f63-a59b-bb16426b7d99 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:42.635758 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd06012-245c-4762-8510-45c989f7b03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:42.636787 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd06012-245c-4762-8510-45c989f7b03a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:42.637267 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd06012-245c-4762-8510-45c989f7b03a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:42.637863 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd06012-245c-4762-8510-45c989f7b03a None admin] PATH_INFO: `/v3/users/713d7c7a73f14c70af055650ec8cd26c` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:42.639488 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd06012-245c-4762-8510-45c989f7b03a None admin] RBAC: Authorizing `identity:get_user(user_id=713d7c7a73f14c70af055650ec8cd26c)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:42.641316 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd06012-245c-4762-8510-45c989f7b03a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:42.643503 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 119/226] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:29:42 2022] GET /identity/v3/users/713d7c7a73f14c70af055650ec8cd26c => generated 283 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:29:42.649642 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd06012-245c-4762-8510-45c989f7b03a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:42.693318 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:42.745540 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1c552-aa18-4035-9230-9a6a14473ff2 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:42.780022 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd06012-245c-4762-8510-45c989f7b03a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:42.806238 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ba90f-23e5-43d5-8677-dd28b34c370a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:42.806810 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ba90f-23e5-43d5-8677-dd28b34c370a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:42.807261 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ba90f-23e5-43d5-8677-dd28b34c370a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:42.807699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ba90f-23e5-43d5-8677-dd28b34c370a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:42.808939 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ba90f-23e5-43d5-8677-dd28b34c370a None admin] RBAC: Adding query filter params (role.id=c5a02c4618d94f1da7257ef437b8ce9e, scope.project.id=61304b31bc674654a80d1255b6e98ad3, user.id=90e75ca8f5ea421db00e58acafb882ed) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:42.809426 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ba90f-23e5-43d5-8677-dd28b34c370a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:42.812192 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ba90f-23e5-43d5-8677-dd28b34c370a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:42.822143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 108/227] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:29:42 2022] GET /identity/v3/role_assignments?user.id=90e75ca8f5ea421db00e58acafb882ed&scope.project.id=61304b31bc674654a80d1255b6e98ad3&role.id=c5a02c4618d94f1da7257ef437b8ce9e => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:29:42.823506 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ba90f-23e5-43d5-8677-dd28b34c370a None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:42.825525 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3e058-9274-43ef-9320-ba31546283f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:42.826892 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3e058-9274-43ef-9320-ba31546283f8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:42.827372 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3e058-9274-43ef-9320-ba31546283f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:42.827897 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3e058-9274-43ef-9320-ba31546283f8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:42.841391 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3e058-9274-43ef-9320-ba31546283f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:29:42.847462 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-aba3e058-9274-43ef-9320-ba31546283f8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:29:42.847462 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:42.847462 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:42.847462 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:42.847462 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:42.847462 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:42.847462 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:42.847462 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:42.847462 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:42.847462 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:42.847462 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:42.847462 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:42.847462 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:29:42.847462 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:29:42.847462 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:29:42.847462 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:29:42.848475 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:29:42.848475 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:29:42.848475 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:29:42.848475 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:29:42.848475 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:42.848475 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:42.848475 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:42.848475 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:42.848475 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:42.848475 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:42.848475 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:42.848475 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:42.848475 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:42.848475 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:42.848475 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:42.848475 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:42.849265 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:42.849265 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:42.849265 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:42.849265 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:42.849265 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:29:42.849265 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:29:42.849265 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:29:42.849265 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:29:42.849265 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:29:42.849265 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:29:42.849265 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:29:42.849265 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:29:42.852055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 120/228] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 26 05:29:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:29:42.858274 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3e058-9274-43ef-9320-ba31546283f8 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:42.962935 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:42.987522 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3e058-9274-43ef-9320-ba31546283f8 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:43.020016 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:43.029321 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae7d48-5385-43ad-9e65-7234ea729932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:43.030332 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae7d48-5385-43ad-9e65-7234ea729932 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:43.030839 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae7d48-5385-43ad-9e65-7234ea729932 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:43.031301 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae7d48-5385-43ad-9e65-7234ea729932 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:43.032265 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae7d48-5385-43ad-9e65-7234ea729932 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:43.032795 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae7d48-5385-43ad-9e65-7234ea729932 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:43.034728 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae7d48-5385-43ad-9e65-7234ea729932 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:43.046037 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 121/229] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:29:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:29:43.056899 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae7d48-5385-43ad-9e65-7234ea729932 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:43.195492 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae7d48-5385-43ad-9e65-7234ea729932 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:43.198500 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ba90f-23e5-43d5-8677-dd28b34c370a None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:43.241356 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de25b35-a10a-4df6-83b7-0de89c7c5122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:43.242180 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de25b35-a10a-4df6-83b7-0de89c7c5122 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:43.242555 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de25b35-a10a-4df6-83b7-0de89c7c5122 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:43.242918 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de25b35-a10a-4df6-83b7-0de89c7c5122 None admin] PATH_INFO: `/v3/users/713d7c7a73f14c70af055650ec8cd26c` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:43.244428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de25b35-a10a-4df6-83b7-0de89c7c5122 None admin] RBAC: Authorizing `identity:get_user(user_id=713d7c7a73f14c70af055650ec8cd26c)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:43.245092 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc2389-a3ae-4629-a3a4-e94a1c03e2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:43.246003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc2389-a3ae-4629-a3a4-e94a1c03e2eb None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:43.246273 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de25b35-a10a-4df6-83b7-0de89c7c5122 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:43.246576 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc2389-a3ae-4629-a3a4-e94a1c03e2eb None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:43.246983 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc2389-a3ae-4629-a3a4-e94a1c03e2eb None admin] PATH_INFO: `/v3/projects/61304b31bc674654a80d1255b6e98ad3` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:43.248513 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc2389-a3ae-4629-a3a4-e94a1c03e2eb None admin] RBAC: Authorizing `identity:get_project(project_id=61304b31bc674654a80d1255b6e98ad3)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:43.248859 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 122/230] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:29:43 2022] GET /identity/v3/users/713d7c7a73f14c70af055650ec8cd26c => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:43.250391 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc2389-a3ae-4629-a3a4-e94a1c03e2eb None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:43.256706 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 109/231] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:29:42 2022] GET /identity/v3/projects/61304b31bc674654a80d1255b6e98ad3 => generated 302 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:43.258456 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de25b35-a10a-4df6-83b7-0de89c7c5122 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:43.264909 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc2389-a3ae-4629-a3a4-e94a1c03e2eb None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:43.294831 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:43.464173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc2389-a3ae-4629-a3a4-e94a1c03e2eb None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:43.480169 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:43.497801 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de25b35-a10a-4df6-83b7-0de89c7c5122 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:43.540088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b8e68-b648-47cc-9edd-6878eb9c51b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:43.541138 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b8e68-b648-47cc-9edd-6878eb9c51b0 None admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:43.541559 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b8e68-b648-47cc-9edd-6878eb9c51b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:43.541973 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b8e68-b648-47cc-9edd-6878eb9c51b0 None admin] PATH_INFO: `/v3/projects/61304b31bc674654a80d1255b6e98ad3/users/713d7c7a73f14c70af055650ec8cd26c/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:43.545489 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b8e68-b648-47cc-9edd-6878eb9c51b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=61304b31bc674654a80d1255b6e98ad3, user_id=713d7c7a73f14c70af055650ec8cd26c, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:43.548545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b8e68-b648-47cc-9edd-6878eb9c51b0 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:43.575841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 110/232] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 26 05:29:43 2022] PUT /identity/v3/projects/61304b31bc674654a80d1255b6e98ad3/users/713d7c7a73f14c70af055650ec8cd26c/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:43.614641 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d5e69-0826-47db-9158-5a8381bdd472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:43.615329 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d5e69-0826-47db-9158-5a8381bdd472 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:43.615609 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d5e69-0826-47db-9158-5a8381bdd472 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:43.615907 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d5e69-0826-47db-9158-5a8381bdd472 None admin] PATH_INFO: `/v3/projects/61304b31bc674654a80d1255b6e98ad3` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:43.620739 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d5e69-0826-47db-9158-5a8381bdd472 None admin] RBAC: Authorizing `identity:get_project(project_id=61304b31bc674654a80d1255b6e98ad3)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:43.622314 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d5e69-0826-47db-9158-5a8381bdd472 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:43.624357 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 123/233] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:29:43 2022] GET /identity/v3/projects/61304b31bc674654a80d1255b6e98ad3 => generated 302 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:29:43.631110 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b8e68-b648-47cc-9edd-6878eb9c51b0 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:43.840164 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b8e68-b648-47cc-9edd-6878eb9c51b0 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:43.901214 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643919e7-f3d1-433f-bd25-558e4298653d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:43.901928 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643919e7-f3d1-433f-bd25-558e4298653d None admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:43.902205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643919e7-f3d1-433f-bd25-558e4298653d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:43.902476 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643919e7-f3d1-433f-bd25-558e4298653d None admin] PATH_INFO: `/v3/projects/61304b31bc674654a80d1255b6e98ad3/users/713d7c7a73f14c70af055650ec8cd26c/roles/7cb00fff13fb4eefa6a734c91c0d59ea` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:43.904773 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643919e7-f3d1-433f-bd25-558e4298653d None admin] RBAC: Authorizing `identity:create_grant(project_id=61304b31bc674654a80d1255b6e98ad3, user_id=713d7c7a73f14c70af055650ec8cd26c, role_id=7cb00fff13fb4eefa6a734c91c0d59ea)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:43.906328 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643919e7-f3d1-433f-bd25-558e4298653d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:43.937110 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 111/234] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 26 05:29:43 2022] PUT /identity/v3/projects/61304b31bc674654a80d1255b6e98ad3/users/713d7c7a73f14c70af055650ec8cd26c/roles/7cb00fff13fb4eefa6a734c91c0d59ea => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:44.172858 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2edeaa-6493-47fe-ad91-30f4e85b822a None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:44.173382 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2edeaa-6493-47fe-ad91-30f4e85b822a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:44.173382 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2edeaa-6493-47fe-ad91-30f4e85b822a None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:44.175153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 124/235] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:44.181262 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5eaad-d38b-4d37-977a-3ed9d04f537e None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:44.181568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5eaad-d38b-4d37-977a-3ed9d04f537e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:44.181809 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5eaad-d38b-4d37-977a-3ed9d04f537e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:44.208016 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-51d5eaad-d38b-4d37-977a-3ed9d04f537e None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:44.209262 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-51d5eaad-d38b-4d37-977a-3ed9d04f537e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:44.231772 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:44.294686 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 112/236] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:29:44.497618 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675a45c-b751-4f04-abc6-ec69d44d9d7c None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:44.497870 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675a45c-b751-4f04-abc6-ec69d44d9d7c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:44.498175 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675a45c-b751-4f04-abc6-ec69d44d9d7c None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:44.499769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 125/237] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:44.505373 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146dbe2-a859-44df-b2ce-d3c44544a999 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:44.505699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146dbe2-a859-44df-b2ce-d3c44544a999 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:44.505952 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5146dbe2-a859-44df-b2ce-d3c44544a999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:44.525303 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-5146dbe2-a859-44df-b2ce-d3c44544a999 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:44.526512 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5146dbe2-a859-44df-b2ce-d3c44544a999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:44.598981 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 113/238] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:29:44.632463 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675a45c-b751-4f04-abc6-ec69d44d9d7c None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:44.805540 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:44.816407 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675a45c-b751-4f04-abc6-ec69d44d9d7c None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:44.853303 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81e415-39e8-4852-a7b0-cbdd41ce57ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:44.853941 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81e415-39e8-4852-a7b0-cbdd41ce57ab None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:44.854212 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81e415-39e8-4852-a7b0-cbdd41ce57ab None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:44.854491 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81e415-39e8-4852-a7b0-cbdd41ce57ab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:44.866235 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81e415-39e8-4852-a7b0-cbdd41ce57ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:29:44.871272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-be81e415-39e8-4852-a7b0-cbdd41ce57ab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:29:44.871272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:44.871272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:44.871272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:44.871272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:44.871272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:44.871272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:44.871272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:44.871272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:44.871272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:44.871272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:44.871272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:44.871272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:29:44.871272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:29:44.871272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:29:44.871272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:29:44.873421 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:29:44.873421 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:29:44.873421 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:29:44.873421 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:29:44.873421 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:44.873421 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:44.873421 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:44.873421 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:44.873421 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:44.873421 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:44.873421 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:44.873421 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:44.873421 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:44.873421 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:44.873421 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:44.873421 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:44.875089 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:44.875089 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:44.875089 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:44.875089 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:44.875089 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:29:44.875089 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:29:44.875089 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:29:44.875089 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:29:44.875089 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:29:44.875089 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:29:44.875089 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:29:44.875089 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:29:44.875089 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 126/239] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:29:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:29:44.878745 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146dbe2-a859-44df-b2ce-d3c44544a999 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:44.950823 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81e415-39e8-4852-a7b0-cbdd41ce57ab None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:44.999664 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:45.037817 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5146dbe2-a859-44df-b2ce-d3c44544a999 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:45.103354 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c2d5c-1eca-4958-8bab-116196e53783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:45.103925 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c2d5c-1eca-4958-8bab-116196e53783 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:45.104201 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c2d5c-1eca-4958-8bab-116196e53783 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:45.104493 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c2d5c-1eca-4958-8bab-116196e53783 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:45.105143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c2d5c-1eca-4958-8bab-116196e53783 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:45.105439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c2d5c-1eca-4958-8bab-116196e53783 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:45.106827 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c2d5c-1eca-4958-8bab-116196e53783 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:45.120677 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 114/240] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 26 05:29:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:45.126448 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c2d5c-1eca-4958-8bab-116196e53783 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:45.156725 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81e415-39e8-4852-a7b0-cbdd41ce57ab None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:45.234880 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c2d5c-1eca-4958-8bab-116196e53783 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:45.269436 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a93f9-0232-430d-8c31-b107a1d0ca7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:45.270078 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a93f9-0232-430d-8c31-b107a1d0ca7c None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:45.270356 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a93f9-0232-430d-8c31-b107a1d0ca7c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:45.270627 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a93f9-0232-430d-8c31-b107a1d0ca7c None admin] PATH_INFO: `/v3/users/75c7fb5f762b4e58a845985518d2cbd9` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:45.285486 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a93f9-0232-430d-8c31-b107a1d0ca7c None admin] RBAC: Authorizing `identity:get_user(user_id=75c7fb5f762b4e58a845985518d2cbd9)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:45.287041 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a93f9-0232-430d-8c31-b107a1d0ca7c None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:45.288834 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 115/241] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:29:45 2022] GET /identity/v3/users/75c7fb5f762b4e58a845985518d2cbd9 => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:29:45.294580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a93f9-0232-430d-8c31-b107a1d0ca7c None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:45.300562 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed4141-8abe-4269-910c-577d46252e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:45.301256 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed4141-8abe-4269-910c-577d46252e9a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:45.301531 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed4141-8abe-4269-910c-577d46252e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:45.301803 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed4141-8abe-4269-910c-577d46252e9a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:45.303035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed4141-8abe-4269-910c-577d46252e9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:45.304628 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed4141-8abe-4269-910c-577d46252e9a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:45.306424 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 127/242] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:29:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:29:45.306932 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:45.313713 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed4141-8abe-4269-910c-577d46252e9a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:45.358736 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:45.412310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a93f9-0232-430d-8c31-b107a1d0ca7c None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:45.450568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6cba0-577f-4d4f-af1b-1247603d32bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:45.451194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6cba0-577f-4d4f-af1b-1247603d32bd None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:45.451849 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6cba0-577f-4d4f-af1b-1247603d32bd None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:45.452122 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6cba0-577f-4d4f-af1b-1247603d32bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:45.539695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6cba0-577f-4d4f-af1b-1247603d32bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:45.542031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6cba0-577f-4d4f-af1b-1247603d32bd None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:45.545076 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:45.579065 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed4141-8abe-4269-910c-577d46252e9a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:45.625200 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380004f5-aae1-49b9-b975-62365621bd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:45.625741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380004f5-aae1-49b9-b975-62365621bd39 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:45.626023 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380004f5-aae1-49b9-b975-62365621bd39 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:45.626291 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380004f5-aae1-49b9-b975-62365621bd39 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:45.626969 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380004f5-aae1-49b9-b975-62365621bd39 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:45.632440 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380004f5-aae1-49b9-b975-62365621bd39 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:45.679060 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 128/243] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 26 05:29:45 2022] POST /identity/v3/users => generated 293 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:29:45.742807 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 116/244] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:29:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 26 05:29:45.748544 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380004f5-aae1-49b9-b975-62365621bd39 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:45.892764 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:45.927460 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380004f5-aae1-49b9-b975-62365621bd39 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:45.971668 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd6cf2-21a3-443c-b1af-e672ebda7a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:45.972364 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd6cf2-21a3-443c-b1af-e672ebda7a3b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:45.972638 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd6cf2-21a3-443c-b1af-e672ebda7a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:45.972905 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd6cf2-21a3-443c-b1af-e672ebda7a3b None admin] PATH_INFO: `/v3/projects/61304b31bc674654a80d1255b6e98ad3` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:45.974051 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd6cf2-21a3-443c-b1af-e672ebda7a3b None admin] RBAC: Authorizing `identity:get_project(project_id=61304b31bc674654a80d1255b6e98ad3)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:45.975588 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd6cf2-21a3-443c-b1af-e672ebda7a3b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:45.977704 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 129/245] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:29:45 2022] GET /identity/v3/projects/61304b31bc674654a80d1255b6e98ad3 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:45.983435 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6cba0-577f-4d4f-af1b-1247603d32bd None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:46.022791 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030247f8-a69a-4d25-9601-53521d09aee1 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:46.023098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030247f8-a69a-4d25-9601-53521d09aee1 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:46.023392 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030247f8-a69a-4d25-9601-53521d09aee1 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:46.025344 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 130/246] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:46.032585 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73739dd8-9c7b-4454-a5e8-91789b8e4cb5 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:46.032864 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73739dd8-9c7b-4454-a5e8-91789b8e4cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:46.033145 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73739dd8-9c7b-4454-a5e8-91789b8e4cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:46.052392 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-73739dd8-9c7b-4454-a5e8-91789b8e4cb5 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:46.053769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-73739dd8-9c7b-4454-a5e8-91789b8e4cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:46.110536 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6cba0-577f-4d4f-af1b-1247603d32bd None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:46.112739 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:46.149180 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 131/247] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:29:46.160777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292aa7fc-e78e-4774-a2a8-e01f33bec56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:46.161818 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292aa7fc-e78e-4774-a2a8-e01f33bec56a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:46.162288 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292aa7fc-e78e-4774-a2a8-e01f33bec56a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:46.162768 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292aa7fc-e78e-4774-a2a8-e01f33bec56a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:46.163836 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292aa7fc-e78e-4774-a2a8-e01f33bec56a None admin] RBAC: Adding query filter params (role.id=f003916a5d7249639775054051c6d3ab, scope.project.id=61304b31bc674654a80d1255b6e98ad3, user.id=75c7fb5f762b4e58a845985518d2cbd9) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:46.164342 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292aa7fc-e78e-4774-a2a8-e01f33bec56a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:46.165995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292aa7fc-e78e-4774-a2a8-e01f33bec56a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:46.173272 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 117/248] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:29:45 2022] GET /identity/v3/role_assignments?user.id=75c7fb5f762b4e58a845985518d2cbd9&scope.project.id=61304b31bc674654a80d1255b6e98ad3&role.id=f003916a5d7249639775054051c6d3ab => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:46.448423 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73739dd8-9c7b-4454-a5e8-91789b8e4cb5 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:46.543216 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:46.593994 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73739dd8-9c7b-4454-a5e8-91789b8e4cb5 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:46.635105 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca3205-d02d-4f82-aef4-ac941966a297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:46.635783 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca3205-d02d-4f82-aef4-ac941966a297 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:46.636067 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca3205-d02d-4f82-aef4-ac941966a297 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:46.636339 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca3205-d02d-4f82-aef4-ac941966a297 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:46.649644 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca3205-d02d-4f82-aef4-ac941966a297 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:29:46.654699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-30ca3205-d02d-4f82-aef4-ac941966a297 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:29:46.654699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:46.654699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:46.654699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:46.654699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:46.654699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:46.654699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:46.654699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:46.654699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:46.654699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:46.654699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:46.654699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:46.654699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:29:46.654699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:29:46.654699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:29:46.654699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:29:46.655713 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:29:46.655713 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:29:46.655713 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:29:46.655713 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:29:46.655713 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:46.655713 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:46.655713 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:46.655713 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:46.655713 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:46.655713 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:46.655713 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:46.655713 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:46.655713 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:46.655713 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:46.655713 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:46.655713 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:46.656762 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:46.656762 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:46.656762 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:46.656762 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:46.656762 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:29:46.656762 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:29:46.656762 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:29:46.656762 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:29:46.656762 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:29:46.656762 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:29:46.656762 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:29:46.656762 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:29:46.656762 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 132/249] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:29:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:29:46.663022 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292aa7fc-e78e-4774-a2a8-e01f33bec56a None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:46.847010 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292aa7fc-e78e-4774-a2a8-e01f33bec56a None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:46.915661 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a4d5f-88c3-4ce8-a83d-c922aa5b308e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:46.916735 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a4d5f-88c3-4ce8-a83d-c922aa5b308e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:46.917201 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a4d5f-88c3-4ce8-a83d-c922aa5b308e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:46.917645 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a4d5f-88c3-4ce8-a83d-c922aa5b308e None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:46.918859 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a4d5f-88c3-4ce8-a83d-c922aa5b308e None admin] RBAC: Adding query filter params (name=member) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:46.919383 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a4d5f-88c3-4ce8-a83d-c922aa5b308e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:46.921943 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a4d5f-88c3-4ce8-a83d-c922aa5b308e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:46.925647 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d25e7-da57-4a3e-ac82-48b6dd379789 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:46.926122 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d25e7-da57-4a3e-ac82-48b6dd379789 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:46.926586 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d25e7-da57-4a3e-ac82-48b6dd379789 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:46.933316 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 133/250] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:46 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:46.941638 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccdddc-04e5-498d-8d8e-296b0a537836 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:46.941932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccdddc-04e5-498d-8d8e-296b0a537836 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:46.942195 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fccdddc-04e5-498d-8d8e-296b0a537836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:46.949400 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 118/251] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 26 05:29:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:46.958104 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a4d5f-88c3-4ce8-a83d-c922aa5b308e None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:46.980333 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-1fccdddc-04e5-498d-8d8e-296b0a537836 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:46.981483 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1fccdddc-04e5-498d-8d8e-296b0a537836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:47.029319 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:47.118653 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 134/252] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:29:47.181595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a4d5f-88c3-4ce8-a83d-c922aa5b308e None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:47.242560 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0d54f-ac1a-488e-b250-ad500235344f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:47.243140 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0d54f-ac1a-488e-b250-ad500235344f None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:47.243415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0d54f-ac1a-488e-b250-ad500235344f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:47.243687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0d54f-ac1a-488e-b250-ad500235344f None admin] PATH_INFO: `/v3/users/90e75ca8f5ea421db00e58acafb882ed` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:47.246153 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0d54f-ac1a-488e-b250-ad500235344f None admin] RBAC: Authorizing `identity:get_user(user_id=90e75ca8f5ea421db00e58acafb882ed)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:47.247695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0d54f-ac1a-488e-b250-ad500235344f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:47.249796 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 119/253] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:29:46 2022] GET /identity/v3/users/90e75ca8f5ea421db00e58acafb882ed => generated 297 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:47.255501 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fccdddc-04e5-498d-8d8e-296b0a537836 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:47.369781 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:47.418009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fccdddc-04e5-498d-8d8e-296b0a537836 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:47.463889 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1529680-d557-44b8-9b97-38b56d160692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:47.465362 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1529680-d557-44b8-9b97-38b56d160692 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:47.465927 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1529680-d557-44b8-9b97-38b56d160692 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:47.466389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1529680-d557-44b8-9b97-38b56d160692 None admin] PATH_INFO: `/v3/projects/61304b31bc674654a80d1255b6e98ad3` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:47.472573 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1529680-d557-44b8-9b97-38b56d160692 None admin] RBAC: Authorizing `identity:get_project(project_id=61304b31bc674654a80d1255b6e98ad3)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:47.474412 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1529680-d557-44b8-9b97-38b56d160692 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:47.476924 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 135/254] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:29:47 2022] GET /identity/v3/projects/61304b31bc674654a80d1255b6e98ad3 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:47.482540 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0d54f-ac1a-488e-b250-ad500235344f None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:47.624626 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bc371-9efc-402d-91e4-c6ff17dbe8be None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:47.625232 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bc371-9efc-402d-91e4-c6ff17dbe8be None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:47.625696 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70bc371-9efc-402d-91e4-c6ff17dbe8be None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:47.628967 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 136/255] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:47.633876 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf570533-6442-43fb-bb9d-648f013e7305 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:47.634201 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf570533-6442-43fb-bb9d-648f013e7305 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:47.634431 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf570533-6442-43fb-bb9d-648f013e7305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:47.637355 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:47.647785 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0d54f-ac1a-488e-b250-ad500235344f None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:47.670312 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-cf570533-6442-43fb-bb9d-648f013e7305 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:47.676694 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-cf570533-6442-43fb-bb9d-648f013e7305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:47.727807 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152b1d1-4d6d-4df5-a1bc-8a8652ecb605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:47.729023 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152b1d1-4d6d-4df5-a1bc-8a8652ecb605 None admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:47.730437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152b1d1-4d6d-4df5-a1bc-8a8652ecb605 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:47.733943 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152b1d1-4d6d-4df5-a1bc-8a8652ecb605 None admin] PATH_INFO: `/v3/projects/61304b31bc674654a80d1255b6e98ad3/users/90e75ca8f5ea421db00e58acafb882ed/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:47.736415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152b1d1-4d6d-4df5-a1bc-8a8652ecb605 None admin] RBAC: Authorizing `identity:create_grant(project_id=61304b31bc674654a80d1255b6e98ad3, user_id=90e75ca8f5ea421db00e58acafb882ed, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:47.738145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152b1d1-4d6d-4df5-a1bc-8a8652ecb605 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:47.763572 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 120/256] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 26 05:29:47 2022] PUT /identity/v3/projects/61304b31bc674654a80d1255b6e98ad3/users/90e75ca8f5ea421db00e58acafb882ed/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:29:47.764931 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152b1d1-4d6d-4df5-a1bc-8a8652ecb605 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:47.858541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 137/257] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:29:47.939938 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152b1d1-4d6d-4df5-a1bc-8a8652ecb605 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:48.011620 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14c3e8-0d63-42ca-928b-8b67d569510c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:48.013298 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14c3e8-0d63-42ca-928b-8b67d569510c None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:48.014026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14c3e8-0d63-42ca-928b-8b67d569510c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:48.014728 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14c3e8-0d63-42ca-928b-8b67d569510c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:48.041318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14c3e8-0d63-42ca-928b-8b67d569510c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:29:48.052375 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-be14c3e8-0d63-42ca-928b-8b67d569510c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:29:48.052375 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:48.052375 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:48.052375 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:48.052375 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:48.052375 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:48.052375 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:48.052375 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:48.052375 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:48.052375 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:48.052375 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:48.052375 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:48.052375 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:29:48.052375 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:29:48.052375 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:29:48.052375 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:29:48.054387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:29:48.054387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:29:48.054387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:29:48.054387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:29:48.054387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:48.054387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:48.054387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:48.054387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:48.054387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:48.054387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:48.054387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:48.054387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:48.054387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:48.054387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:48.054387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:48.054387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:48.056202 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:48.056202 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:48.056202 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:48.056202 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:48.056202 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:29:48.056202 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:29:48.056202 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:29:48.056202 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:29:48.056202 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:29:48.056202 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:29:48.056202 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:29:48.056202 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:29:48.060006 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 121/258] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:29:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:29:48.077412 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf570533-6442-43fb-bb9d-648f013e7305 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:48.171081 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:48.221240 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf570533-6442-43fb-bb9d-648f013e7305 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:48.262054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef50b2-b80c-44d3-afa6-ffde35eaa722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:48.262689 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef50b2-b80c-44d3-afa6-ffde35eaa722 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:48.262958 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef50b2-b80c-44d3-afa6-ffde35eaa722 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:48.263224 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef50b2-b80c-44d3-afa6-ffde35eaa722 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:48.263931 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef50b2-b80c-44d3-afa6-ffde35eaa722 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:48.264233 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef50b2-b80c-44d3-afa6-ffde35eaa722 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:48.265663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef50b2-b80c-44d3-afa6-ffde35eaa722 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:48.275106 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 138/259] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:29:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:48.281760 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14c3e8-0d63-42ca-928b-8b67d569510c None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:48.329811 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:48.388412 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef50b2-b80c-44d3-afa6-ffde35eaa722 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:48.509120 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14c3e8-0d63-42ca-928b-8b67d569510c None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:48.586958 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef50b2-b80c-44d3-afa6-ffde35eaa722 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:48.617323 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2209a-874b-458a-872b-08fc702ba081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:48.618366 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2209a-874b-458a-872b-08fc702ba081 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:48.618838 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2209a-874b-458a-872b-08fc702ba081 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:48.619297 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2209a-874b-458a-872b-08fc702ba081 None admin] PATH_INFO: `/v3/users/713d7c7a73f14c70af055650ec8cd26c` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:48.620747 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2209a-874b-458a-872b-08fc702ba081 None admin] RBAC: Authorizing `identity:get_user(user_id=713d7c7a73f14c70af055650ec8cd26c)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:48.622447 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2209a-874b-458a-872b-08fc702ba081 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:48.624412 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 122/260] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:29:48 2022] GET /identity/v3/users/713d7c7a73f14c70af055650ec8cd26c => generated 283 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:48.633350 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2209a-874b-458a-872b-08fc702ba081 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:48.642401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:48.652635 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f062f-62ac-4751-851c-d4c6fa0141d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:48.653795 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f062f-62ac-4751-851c-d4c6fa0141d5 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:48.654276 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f062f-62ac-4751-851c-d4c6fa0141d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:48.654735 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f062f-62ac-4751-851c-d4c6fa0141d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:48.684183 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6f062f-62ac-4751-851c-d4c6fa0141d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:29:48.690428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-8e6f062f-62ac-4751-851c-d4c6fa0141d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:29:48.690428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:48.690428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:48.690428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:48.690428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:48.690428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:48.690428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:48.690428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:48.690428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:48.690428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:48.690428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:48.690428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:48.690428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:29:48.690428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:29:48.690428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:29:48.690428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:29:48.691373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:29:48.691373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:29:48.691373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:29:48.691373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:29:48.691373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:48.691373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:48.691373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:48.691373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:48.691373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:48.691373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:48.691373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:48.691373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:48.691373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:48.691373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:48.691373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:48.691373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:48.692231 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:48.692231 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:48.692231 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:48.692231 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:48.692231 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:29:48.692231 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:29:48.692231 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:29:48.692231 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:29:48.692231 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:29:48.692231 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:29:48.692231 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:29:48.692231 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:29:48.695889 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 139/261] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 26 05:29:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:29:48.709470 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f062f-62ac-4751-851c-d4c6fa0141d5 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:48.844216 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:48.872926 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2209a-874b-458a-872b-08fc702ba081 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:48.889998 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f062f-62ac-4751-851c-d4c6fa0141d5 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:48.933661 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65f482-f1ac-4c95-b542-d170b267beb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:48.934297 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65f482-f1ac-4c95-b542-d170b267beb2 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:48.934568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65f482-f1ac-4c95-b542-d170b267beb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:48.934835 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65f482-f1ac-4c95-b542-d170b267beb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:48.941209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b930a8-5501-4476-b421-84cd4fc6fe74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:48.941842 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b930a8-5501-4476-b421-84cd4fc6fe74 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:48.942117 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b930a8-5501-4476-b421-84cd4fc6fe74 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:48.942386 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b930a8-5501-4476-b421-84cd4fc6fe74 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:48.943058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b930a8-5501-4476-b421-84cd4fc6fe74 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:48.943362 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b930a8-5501-4476-b421-84cd4fc6fe74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:48.944884 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b930a8-5501-4476-b421-84cd4fc6fe74 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:48.954487 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 140/262] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:29:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:48.968852 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b930a8-5501-4476-b421-84cd4fc6fe74 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:49.035032 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c65f482-f1ac-4c95-b542-d170b267beb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:49.036768 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c65f482-f1ac-4c95-b542-d170b267beb2 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:49.063979 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:49.176710 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b930a8-5501-4476-b421-84cd4fc6fe74 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:49.180212 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:49.224208 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 123/263] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:29:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:49.230155 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65f482-f1ac-4c95-b542-d170b267beb2 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:49.273281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e264fe-a090-42ef-aae3-1ccd1d3b5ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:49.273935 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e264fe-a090-42ef-aae3-1ccd1d3b5ace None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:49.274269 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e264fe-a090-42ef-aae3-1ccd1d3b5ace None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:49.274541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e264fe-a090-42ef-aae3-1ccd1d3b5ace None admin] PATH_INFO: `/v3/users/713d7c7a73f14c70af055650ec8cd26c` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:49.276957 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e264fe-a090-42ef-aae3-1ccd1d3b5ace None admin] RBAC: Authorizing `identity:get_user(user_id=713d7c7a73f14c70af055650ec8cd26c)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:49.278443 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e264fe-a090-42ef-aae3-1ccd1d3b5ace None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:49.283565 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 141/264] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:29:48 2022] GET /identity/v3/users/713d7c7a73f14c70af055650ec8cd26c => generated 283 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:49.288326 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e264fe-a090-42ef-aae3-1ccd1d3b5ace None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:49.429164 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65f482-f1ac-4c95-b542-d170b267beb2 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:49.497871 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61228b18-13ad-4fb7-afa4-e37d2ce5dab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:49.498950 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61228b18-13ad-4fb7-afa4-e37d2ce5dab4 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:49.499426 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61228b18-13ad-4fb7-afa4-e37d2ce5dab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:49.499919 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61228b18-13ad-4fb7-afa4-e37d2ce5dab4 None admin] PATH_INFO: `/v3/projects/61304b31bc674654a80d1255b6e98ad3` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:49.504593 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61228b18-13ad-4fb7-afa4-e37d2ce5dab4 None admin] RBAC: Authorizing `identity:get_project(project_id=61304b31bc674654a80d1255b6e98ad3)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:49.506503 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61228b18-13ad-4fb7-afa4-e37d2ce5dab4 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:49.508956 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 124/265] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:29:49 2022] GET /identity/v3/projects/61304b31bc674654a80d1255b6e98ad3 => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:29:49.515155 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61228b18-13ad-4fb7-afa4-e37d2ce5dab4 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:49.518178 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e264fe-a090-42ef-aae3-1ccd1d3b5ace None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:49.559329 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:49.625667 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afff25-337a-4d7e-b7c7-13dedef4ef77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:49.626740 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afff25-337a-4d7e-b7c7-13dedef4ef77 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:49.627223 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afff25-337a-4d7e-b7c7-13dedef4ef77 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:49.628283 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afff25-337a-4d7e-b7c7-13dedef4ef77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:49.631990 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:49.775997 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61228b18-13ad-4fb7-afa4-e37d2ce5dab4 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:49.872386 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8e839-c46d-4cc0-9d19-06d6ce1006ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:49.873025 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8e839-c46d-4cc0-9d19-06d6ce1006ae None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:49.873296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8e839-c46d-4cc0-9d19-06d6ce1006ae None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:49.873557 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8e839-c46d-4cc0-9d19-06d6ce1006ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:49.874318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8e839-c46d-4cc0-9d19-06d6ce1006ae None admin] RBAC: Adding query filter params (role.id=cf58d66369044fb09fa65a4366dc7446, scope.project.id=61304b31bc674654a80d1255b6e98ad3, user.id=713d7c7a73f14c70af055650ec8cd26c) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:49.874616 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8e839-c46d-4cc0-9d19-06d6ce1006ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:49.876159 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8e839-c46d-4cc0-9d19-06d6ce1006ae None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:49.879187 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52afff25-337a-4d7e-b7c7-13dedef4ef77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:49.880786 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52afff25-337a-4d7e-b7c7-13dedef4ef77 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:49.894022 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 125/266] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:29:49 2022] GET /identity/v3/role_assignments?user.id=713d7c7a73f14c70af055650ec8cd26c&scope.project.id=61304b31bc674654a80d1255b6e98ad3&role.id=cf58d66369044fb09fa65a4366dc7446 => generated 608 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:49.895385 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783143a4-90ea-4d36-a182-2f160c8274dc None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:49.895696 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783143a4-90ea-4d36-a182-2f160c8274dc None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:49.895997 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783143a4-90ea-4d36-a182-2f160c8274dc None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:49.905491 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 126/267] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:49 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:49.910302 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450be69b-9884-46dd-9aca-accb9a24e08c None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:49.910626 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450be69b-9884-46dd-9aca-accb9a24e08c None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:49.910841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450be69b-9884-46dd-9aca-accb9a24e08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:49.952584 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-450be69b-9884-46dd-9aca-accb9a24e08c None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:49.953854 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-450be69b-9884-46dd-9aca-accb9a24e08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:50.123443 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 127/268] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:29:50.129421 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f16b62-9794-40d8-a306-8105c2e92d35 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:50.129757 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f16b62-9794-40d8-a306-8105c2e92d35 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:50.129970 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f16b62-9794-40d8-a306-8105c2e92d35 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:50.134638 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 128/269] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:50 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:50.139518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfa023-f368-4277-a948-5028574eb77a None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:50.139857 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfa023-f368-4277-a948-5028574eb77a None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:50.140181 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfa023-f368-4277-a948-5028574eb77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:50.167561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 142/270] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:29:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 880 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:50.175275 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afff25-337a-4d7e-b7c7-13dedef4ef77 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:50.185137 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-62bfa023-f368-4277-a948-5028574eb77a None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:50.186385 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-62bfa023-f368-4277-a948-5028574eb77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:50.213053 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:50.266121 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:50.353657 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 129/271] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:29:50.405083 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afff25-337a-4d7e-b7c7-13dedef4ef77 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:50.460830 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b7d58-715b-414a-a8c5-fad49680357a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:50.461973 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b7d58-715b-414a-a8c5-fad49680357a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:50.462476 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b7d58-715b-414a-a8c5-fad49680357a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:50.462962 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b7d58-715b-414a-a8c5-fad49680357a None admin] PATH_INFO: `/v3/projects/61304b31bc674654a80d1255b6e98ad3` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:50.464690 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b7d58-715b-414a-a8c5-fad49680357a None admin] RBAC: Authorizing `identity:get_project(project_id=61304b31bc674654a80d1255b6e98ad3)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:50.466607 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b7d58-715b-414a-a8c5-fad49680357a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:50.468809 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 143/272] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:29:50 2022] GET /identity/v3/projects/61304b31bc674654a80d1255b6e98ad3 => generated 302 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:29:50.475466 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bfa023-f368-4277-a948-5028574eb77a None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:50.483704 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b7d58-715b-414a-a8c5-fad49680357a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:50.627568 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:50.660948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b7d58-715b-414a-a8c5-fad49680357a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:50.694888 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bfa023-f368-4277-a948-5028574eb77a None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:50.727708 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa148fd-231d-4d69-b59e-5f67ca6837ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:50.728776 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa148fd-231d-4d69-b59e-5f67ca6837ed None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:50.729217 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa148fd-231d-4d69-b59e-5f67ca6837ed None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:50.729697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa148fd-231d-4d69-b59e-5f67ca6837ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:50.747781 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa148fd-231d-4d69-b59e-5f67ca6837ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:29:50.756286 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-ffa148fd-231d-4d69-b59e-5f67ca6837ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:29:50.756286 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:50.756286 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:50.756286 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:50.756286 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:50.756286 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:50.756286 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:50.756286 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:50.756286 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:50.756286 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:50.756286 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:50.756286 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:50.756286 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:29:50.756286 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:29:50.756286 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:29:50.756286 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:29:50.757388 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:29:50.757388 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:29:50.757388 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:29:50.757388 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:29:50.757388 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:50.757388 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:50.757388 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:50.757388 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:50.757388 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:50.757388 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:50.757388 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:50.757388 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:50.757388 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:50.757388 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:50.757388 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:50.757388 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:50.758198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:50.758198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:50.758198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:50.758198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:50.758198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:29:50.758198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:29:50.758198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:29:50.758198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:29:50.758198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:29:50.758198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:29:50.758198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:29:50.758198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:29:50.758876 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 144/273] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:29:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:29:50.761941 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b949c-80ed-4c2b-95a7-e9bf8ec6a82d None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:50.762379 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b949c-80ed-4c2b-95a7-e9bf8ec6a82d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:50.762856 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546b949c-80ed-4c2b-95a7-e9bf8ec6a82d None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:50.764131 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d69c4f-72a2-4000-98ab-e0d8d7d0b3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:50.765017 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d69c4f-72a2-4000-98ab-e0d8d7d0b3d6 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:50.765564 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d69c4f-72a2-4000-98ab-e0d8d7d0b3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:50.765767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 145/274] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:50.766510 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d69c4f-72a2-4000-98ab-e0d8d7d0b3d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:50.767126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b949c-80ed-4c2b-95a7-e9bf8ec6a82d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:50.767839 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d69c4f-72a2-4000-98ab-e0d8d7d0b3d6 None admin] RBAC: Adding query filter params (role.id=7cb00fff13fb4eefa6a734c91c0d59ea, scope.project.id=61304b31bc674654a80d1255b6e98ad3, user.id=713d7c7a73f14c70af055650ec8cd26c) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:50.768365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d69c4f-72a2-4000-98ab-e0d8d7d0b3d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:50.770142 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d69c4f-72a2-4000-98ab-e0d8d7d0b3d6 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:50.778870 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 130/275] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:29:50 2022] GET /identity/v3/role_assignments?user.id=713d7c7a73f14c70af055650ec8cd26c&scope.project.id=61304b31bc674654a80d1255b6e98ad3&role.id=7cb00fff13fb4eefa6a734c91c0d59ea => generated 608 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:50.780249 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d69c4f-72a2-4000-98ab-e0d8d7d0b3d6 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:50.845547 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:50.928435 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d69c4f-72a2-4000-98ab-e0d8d7d0b3d6 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:50.976909 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f537f733-9a8b-4da6-ae52-2481427b9f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:50.977978 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537f733-9a8b-4da6-ae52-2481427b9f47 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:50.978582 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537f733-9a8b-4da6-ae52-2481427b9f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:50.979065 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f537f733-9a8b-4da6-ae52-2481427b9f47 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:50.980094 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537f733-9a8b-4da6-ae52-2481427b9f47 None admin] RBAC: Adding query filter params (name=member) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:50.980671 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537f733-9a8b-4da6-ae52-2481427b9f47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:50.981465 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546b949c-80ed-4c2b-95a7-e9bf8ec6a82d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:50.982578 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f537f733-9a8b-4da6-ae52-2481427b9f47 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:50.994307 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 131/276] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 26 05:29:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:50.995972 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cfe31-caec-4909-bcee-543631027ae5 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:50.996472 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cfe31-caec-4909-bcee-543631027ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:50.996926 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cfe31-caec-4909-bcee-543631027ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:51.021901 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-ea5cfe31-caec-4909-bcee-543631027ae5 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:51.023562 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ea5cfe31-caec-4909-bcee-543631027ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:51.058848 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75aa00-cfa1-484c-8f40-92e5a3dec830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:51.059512 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75aa00-cfa1-484c-8f40-92e5a3dec830 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:51.059820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75aa00-cfa1-484c-8f40-92e5a3dec830 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:51.060100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75aa00-cfa1-484c-8f40-92e5a3dec830 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:51.073959 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75aa00-cfa1-484c-8f40-92e5a3dec830 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:29:51.079712 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-4f75aa00-cfa1-484c-8f40-92e5a3dec830 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:29:51.079712 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:51.079712 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:51.079712 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:51.079712 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:51.079712 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:51.079712 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:51.079712 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:51.079712 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:51.079712 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:51.079712 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:51.079712 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:51.079712 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:29:51.079712 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:29:51.079712 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:29:51.079712 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:29:51.081992 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:29:51.081992 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:29:51.081992 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:29:51.081992 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:29:51.081992 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:51.081992 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:51.081992 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:51.081992 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:51.081992 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:51.081992 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:51.081992 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:51.081992 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:51.081992 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:51.081992 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:51.081992 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:51.081992 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:51.083930 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:51.083930 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:51.083930 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:51.083930 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:51.083930 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:29:51.083930 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:29:51.083930 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:29:51.083930 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:29:51.083930 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:29:51.083930 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:29:51.083930 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:29:51.083930 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:29:51.083930 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 146/277] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:29:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:29:51.087344 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75aa00-cfa1-484c-8f40-92e5a3dec830 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:51.092513 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:51.178621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 132/278] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:29:51.181608 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cfe31-caec-4909-bcee-543631027ae5 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:51.237427 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75aa00-cfa1-484c-8f40-92e5a3dec830 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:51.241924 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:51.320959 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346fd73-f6aa-4d2a-9dfc-dde701a629ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:51.321938 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346fd73-f6aa-4d2a-9dfc-dde701a629ac None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:51.322350 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346fd73-f6aa-4d2a-9dfc-dde701a629ac None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:51.322760 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9346fd73-f6aa-4d2a-9dfc-dde701a629ac None admin] PATH_INFO: `/v3/users/d9b04d01e67d4f93b774ba789f7410e3` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:51.350423 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346fd73-f6aa-4d2a-9dfc-dde701a629ac None admin] RBAC: Authorizing `identity:get_user(user_id=d9b04d01e67d4f93b774ba789f7410e3)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:51.353301 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9346fd73-f6aa-4d2a-9dfc-dde701a629ac None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:51.356266 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 147/279] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:29:51 2022] GET /identity/v3/users/d9b04d01e67d4f93b774ba789f7410e3 => generated 293 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:51.366067 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346fd73-f6aa-4d2a-9dfc-dde701a629ac None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:51.388156 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cfe31-caec-4909-bcee-543631027ae5 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:51.454103 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de9987-f7d0-4a92-b76c-7a34aa19dc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:51.455064 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de9987-f7d0-4a92-b76c-7a34aa19dc4b None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:51.455547 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de9987-f7d0-4a92-b76c-7a34aa19dc4b None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:51.456081 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de9987-f7d0-4a92-b76c-7a34aa19dc4b None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:51.457280 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de9987-f7d0-4a92-b76c-7a34aa19dc4b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:51.457801 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de9987-f7d0-4a92-b76c-7a34aa19dc4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:51.460586 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de9987-f7d0-4a92-b76c-7a34aa19dc4b None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:51.480084 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 133/280] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 26 05:29:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:51.480084 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c24a2f-89a3-487b-80f1-8e82eb48dde6 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:51.480084 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c24a2f-89a3-487b-80f1-8e82eb48dde6 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:51.480084 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c24a2f-89a3-487b-80f1-8e82eb48dde6 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:51.481215 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:51.482612 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 134/281] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:51.484119 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c24a2f-89a3-487b-80f1-8e82eb48dde6 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:51.546841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9346fd73-f6aa-4d2a-9dfc-dde701a629ac None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:51.597289 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:51.601980 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b968991-f34b-45ae-93e7-30fa5046feb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:51.602873 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b968991-f34b-45ae-93e7-30fa5046feb0 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:51.603156 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b968991-f34b-45ae-93e7-30fa5046feb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:51.603432 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b968991-f34b-45ae-93e7-30fa5046feb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:51.604332 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b968991-f34b-45ae-93e7-30fa5046feb0 None admin] RBAC: Adding query filter params (role.id=c5a02c4618d94f1da7257ef437b8ce9e, user.id=d9b04d01e67d4f93b774ba789f7410e3, scope.system=all) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:51.604737 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b968991-f34b-45ae-93e7-30fa5046feb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:51.606601 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b968991-f34b-45ae-93e7-30fa5046feb0 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:51.606797 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c24a2f-89a3-487b-80f1-8e82eb48dde6 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:51.614796 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 148/282] 10.222.0.66 () {56 vars in 1308 bytes} [Mon Sep 26 05:29:51 2022] GET /identity/v3/role_assignments?user.id=d9b04d01e67d4f93b774ba789f7410e3&scope.system=all&role.id=c5a02c4618d94f1da7257ef437b8ce9e => generated 226 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:51.617411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8647051-a63b-4e2c-aa9f-2cc852eebe3f None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:51.618476 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8647051-a63b-4e2c-aa9f-2cc852eebe3f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:51.618476 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8647051-a63b-4e2c-aa9f-2cc852eebe3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:51.647952 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-a8647051-a63b-4e2c-aa9f-2cc852eebe3f None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:51.649808 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a8647051-a63b-4e2c-aa9f-2cc852eebe3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:51.656611 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68835ed6-a3a4-4133-9584-dd597aa2a3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:51.657484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68835ed6-a3a4-4133-9584-dd597aa2a3f8 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:51.657884 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68835ed6-a3a4-4133-9584-dd597aa2a3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:51.658282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68835ed6-a3a4-4133-9584-dd597aa2a3f8 None admin] PATH_INFO: `/v3/users/75c7fb5f762b4e58a845985518d2cbd9` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:51.659795 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68835ed6-a3a4-4133-9584-dd597aa2a3f8 None admin] RBAC: Authorizing `identity:get_user(user_id=75c7fb5f762b4e58a845985518d2cbd9)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:51.661422 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68835ed6-a3a4-4133-9584-dd597aa2a3f8 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:51.663430 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 135/283] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:29:51 2022] GET /identity/v3/users/75c7fb5f762b4e58a845985518d2cbd9 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:51.664843 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68835ed6-a3a4-4133-9584-dd597aa2a3f8 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:51.771183 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 149/284] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:29:51.773064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8647051-a63b-4e2c-aa9f-2cc852eebe3f None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:51.845744 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68835ed6-a3a4-4133-9584-dd597aa2a3f8 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:51.888221 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:51.907158 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eacfe8-4c32-4f49-b9ff-3d17cf7ac5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:51.908265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eacfe8-4c32-4f49-b9ff-3d17cf7ac5b3 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:51.908725 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eacfe8-4c32-4f49-b9ff-3d17cf7ac5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:51.909178 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eacfe8-4c32-4f49-b9ff-3d17cf7ac5b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:51.911100 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eacfe8-4c32-4f49-b9ff-3d17cf7ac5b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:51.913772 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eacfe8-4c32-4f49-b9ff-3d17cf7ac5b3 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:51.923706 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 136/285] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:29:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:51.925275 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eacfe8-4c32-4f49-b9ff-3d17cf7ac5b3 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:51.975700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8647051-a63b-4e2c-aa9f-2cc852eebe3f None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:51.995765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:52.051634 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a62ce9-a07c-4fb6-8712-5602d1fe1de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:52.052742 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a62ce9-a07c-4fb6-8712-5602d1fe1de9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:52.053221 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a62ce9-a07c-4fb6-8712-5602d1fe1de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:52.053796 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a62ce9-a07c-4fb6-8712-5602d1fe1de9 None admin] PATH_INFO: `/v3/projects/61304b31bc674654a80d1255b6e98ad3` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:52.055949 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a62ce9-a07c-4fb6-8712-5602d1fe1de9 None admin] RBAC: Authorizing `identity:get_project(project_id=61304b31bc674654a80d1255b6e98ad3)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:52.058775 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a62ce9-a07c-4fb6-8712-5602d1fe1de9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:52.062340 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 150/286] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:29:51 2022] GET /identity/v3/projects/61304b31bc674654a80d1255b6e98ad3 => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:52.072191 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a62ce9-a07c-4fb6-8712-5602d1fe1de9 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:52.131282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eacfe8-4c32-4f49-b9ff-3d17cf7ac5b3 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:52.207630 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d35291-b03d-49df-8f0a-2c27accdcd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:52.208664 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d35291-b03d-49df-8f0a-2c27accdcd36 None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:52.209154 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d35291-b03d-49df-8f0a-2c27accdcd36 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:52.209873 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d35291-b03d-49df-8f0a-2c27accdcd36 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:52.211177 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d35291-b03d-49df-8f0a-2c27accdcd36 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:52.214488 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d35291-b03d-49df-8f0a-2c27accdcd36 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:52.256753 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 137/287] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 26 05:29:51 2022] POST /identity/v3/users => generated 293 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:52.271068 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d35291-b03d-49df-8f0a-2c27accdcd36 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:52.285167 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a62ce9-a07c-4fb6-8712-5602d1fe1de9 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:52.334069 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:52.356761 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056b74b-76da-43a9-9891-96ac0532c0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:52.358313 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056b74b-76da-43a9-9891-96ac0532c0b1 None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:52.359104 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056b74b-76da-43a9-9891-96ac0532c0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:52.359890 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056b74b-76da-43a9-9891-96ac0532c0b1 None admin] PATH_INFO: `/v3/projects/61304b31bc674654a80d1255b6e98ad3/users/75c7fb5f762b4e58a845985518d2cbd9/roles/f003916a5d7249639775054051c6d3ab` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:52.364243 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056b74b-76da-43a9-9891-96ac0532c0b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=61304b31bc674654a80d1255b6e98ad3, user_id=75c7fb5f762b4e58a845985518d2cbd9, role_id=f003916a5d7249639775054051c6d3ab)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:52.367507 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056b74b-76da-43a9-9891-96ac0532c0b1 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:52.394135 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 151/288] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 26 05:29:52 2022] PUT /identity/v3/projects/61304b31bc674654a80d1255b6e98ad3/users/75c7fb5f762b4e58a845985518d2cbd9/roles/f003916a5d7249639775054051c6d3ab => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:29:52.450008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:52.479113 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d35291-b03d-49df-8f0a-2c27accdcd36 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:52.548193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d651606-a1a6-4572-8959-fb1bfc2525c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:52.549191 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d651606-a1a6-4572-8959-fb1bfc2525c0 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:52.549658 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d651606-a1a6-4572-8959-fb1bfc2525c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:52.550142 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d651606-a1a6-4572-8959-fb1bfc2525c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:52.570734 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d651606-a1a6-4572-8959-fb1bfc2525c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:29:52.580978 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-6d651606-a1a6-4572-8959-fb1bfc2525c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:29:52.580978 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:52.580978 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:52.580978 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:52.580978 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:52.580978 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:52.580978 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:52.580978 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:52.580978 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:52.580978 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:52.580978 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:52.580978 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:52.580978 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:29:52.580978 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:29:52.580978 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:29:52.580978 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:29:52.582699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:29:52.582699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:29:52.582699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:29:52.582699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:29:52.582699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:52.582699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:52.582699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:52.582699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:52.582699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:52.582699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:52.582699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:52.582699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:52.582699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:52.582699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:52.582699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:52.582699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:52.584239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:52.584239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:52.584239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:52.584239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:52.584239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:29:52.584239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:29:52.584239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:29:52.584239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:29:52.584239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:29:52.584239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:29:52.584239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:29:52.584239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:29:52.584239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 138/289] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:29:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:29:52.594645 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056b74b-76da-43a9-9891-96ac0532c0b1 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:52.810198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056b74b-76da-43a9-9891-96ac0532c0b1 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:52.876517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bfa72-f1bb-4de5-95c2-450d20f11a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:52.877156 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bfa72-f1bb-4de5-95c2-450d20f11a56 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:52.877424 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bfa72-f1bb-4de5-95c2-450d20f11a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:52.877750 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bfa72-f1bb-4de5-95c2-450d20f11a56 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:52.878445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bfa72-f1bb-4de5-95c2-450d20f11a56 None admin] RBAC: Adding query filter params (name=member) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:52.878735 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bfa72-f1bb-4de5-95c2-450d20f11a56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:52.880237 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bfa72-f1bb-4de5-95c2-450d20f11a56 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:52.895918 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 152/290] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 26 05:29:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:52.899217 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d651606-a1a6-4572-8959-fb1bfc2525c0 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:53.101707 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d651606-a1a6-4572-8959-fb1bfc2525c0 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:53.166287 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a6dbf-0b18-4b22-a509-d5c726df135f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:53.168004 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a6dbf-0b18-4b22-a509-d5c726df135f None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:53.168783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a6dbf-0b18-4b22-a509-d5c726df135f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:53.169554 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a6dbf-0b18-4b22-a509-d5c726df135f None admin] PATH_INFO: `/v3/users/90e75ca8f5ea421db00e58acafb882ed` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:53.172407 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a6dbf-0b18-4b22-a509-d5c726df135f None admin] RBAC: Authorizing `identity:get_user(user_id=90e75ca8f5ea421db00e58acafb882ed)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:53.175528 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a6dbf-0b18-4b22-a509-d5c726df135f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:53.179214 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 139/291] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:29:52 2022] GET /identity/v3/users/90e75ca8f5ea421db00e58acafb882ed => generated 297 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:53.185481 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bfa72-f1bb-4de5-95c2-450d20f11a56 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:53.266447 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:53.338359 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bfa72-f1bb-4de5-95c2-450d20f11a56 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:53.379642 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730a577-3e6f-42e7-a2de-8f0274093592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:53.380211 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730a577-3e6f-42e7-a2de-8f0274093592 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:53.380488 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730a577-3e6f-42e7-a2de-8f0274093592 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:53.380760 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730a577-3e6f-42e7-a2de-8f0274093592 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:53.458469 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730a577-3e6f-42e7-a2de-8f0274093592 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:53.460131 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730a577-3e6f-42e7-a2de-8f0274093592 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:53.529062 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:53.594944 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 153/292] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:29:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:29:53.597083 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a6dbf-0b18-4b22-a509-d5c726df135f None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:53.648465 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:53.804583 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a6dbf-0b18-4b22-a509-d5c726df135f None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:53.859439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704c2637-ec4e-45da-b9a8-0487cccdb7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:53.860247 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c2637-ec4e-45da-b9a8-0487cccdb7a0 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:53.860672 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c2637-ec4e-45da-b9a8-0487cccdb7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:53.861006 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c2637-ec4e-45da-b9a8-0487cccdb7a0 None admin] PATH_INFO: `/v3/projects/61304b31bc674654a80d1255b6e98ad3` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:53.862444 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c2637-ec4e-45da-b9a8-0487cccdb7a0 None admin] RBAC: Authorizing `identity:get_project(project_id=61304b31bc674654a80d1255b6e98ad3)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:53.864232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704c2637-ec4e-45da-b9a8-0487cccdb7a0 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:53.867391 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 140/293] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:29:53 2022] GET /identity/v3/projects/61304b31bc674654a80d1255b6e98ad3 => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:53.873867 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730a577-3e6f-42e7-a2de-8f0274093592 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:54.022311 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730a577-3e6f-42e7-a2de-8f0274093592 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:54.070820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a28dc-2eac-413b-bfda-f9ce27df87bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:54.071716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a28dc-2eac-413b-bfda-f9ce27df87bf None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:54.076234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a28dc-2eac-413b-bfda-f9ce27df87bf None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:54.077095 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a28dc-2eac-413b-bfda-f9ce27df87bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:54.078347 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a28dc-2eac-413b-bfda-f9ce27df87bf None admin] RBAC: Adding query filter params (role.id=c5a02c4618d94f1da7257ef437b8ce9e, scope.project.id=61304b31bc674654a80d1255b6e98ad3, user.id=90e75ca8f5ea421db00e58acafb882ed) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:54.078816 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a28dc-2eac-413b-bfda-f9ce27df87bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:54.080562 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a28dc-2eac-413b-bfda-f9ce27df87bf None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:54.088093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 154/294] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:29:53 2022] GET /identity/v3/role_assignments?user.id=90e75ca8f5ea421db00e58acafb882ed&scope.project.id=61304b31bc674654a80d1255b6e98ad3&role.id=c5a02c4618d94f1da7257ef437b8ce9e => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:54.935616 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba836849-6754-49d8-b2fc-45d6a9e37439 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:54.936723 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba836849-6754-49d8-b2fc-45d6a9e37439 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:54.937202 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba836849-6754-49d8-b2fc-45d6a9e37439 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:54.939058 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 141/295] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:54.945187 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3524f6-f723-4e3e-9f90-42212f0b8c3d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:54.946152 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3524f6-f723-4e3e-9f90-42212f0b8c3d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:54.946627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3524f6-f723-4e3e-9f90-42212f0b8c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:54.971949 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-0f3524f6-f723-4e3e-9f90-42212f0b8c3d None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:54.973514 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0f3524f6-f723-4e3e-9f90-42212f0b8c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:54.977263 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:55.086259 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 155/296] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:29:55.353419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba836849-6754-49d8-b2fc-45d6a9e37439 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:55.443519 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:55.464595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba836849-6754-49d8-b2fc-45d6a9e37439 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:55.499469 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399d687-d60c-4818-a1d5-d6f1cea839fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:55.500146 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399d687-d60c-4818-a1d5-d6f1cea839fb None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:55.500460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399d687-d60c-4818-a1d5-d6f1cea839fb None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:55.500704 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399d687-d60c-4818-a1d5-d6f1cea839fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:55.517098 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399d687-d60c-4818-a1d5-d6f1cea839fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:29:55.521980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-5399d687-d60c-4818-a1d5-d6f1cea839fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:29:55.521980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:55.521980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:55.521980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:55.521980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:55.521980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:55.521980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:55.521980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:55.521980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:55.521980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:55.521980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:55.521980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:55.521980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:29:55.521980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:29:55.521980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:29:55.521980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:29:55.523703 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:29:55.523703 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:29:55.523703 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:29:55.523703 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:29:55.523703 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:55.523703 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:55.523703 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:55.523703 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:55.523703 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:55.523703 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:55.523703 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:55.523703 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:55.523703 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:55.523703 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:55.523703 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:55.523703 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:55.525270 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:55.525270 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:55.525270 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:55.525270 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:55.525270 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:29:55.525270 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:29:55.525270 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:29:55.525270 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:29:55.525270 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:29:55.525270 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:29:55.525270 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:29:55.525270 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:29:55.525270 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 142/297] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:29:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:29:55.529593 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3524f6-f723-4e3e-9f90-42212f0b8c3d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:55.643466 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3524f6-f723-4e3e-9f90-42212f0b8c3d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:55.681703 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5df216-5634-4fac-bc64-89a6cae70a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:55.682327 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5df216-5634-4fac-bc64-89a6cae70a66 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:55.682592 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5df216-5634-4fac-bc64-89a6cae70a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:55.682851 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5df216-5634-4fac-bc64-89a6cae70a66 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:55.683574 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5df216-5634-4fac-bc64-89a6cae70a66 None admin] RBAC: Adding query filter params (name=member) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:55.683892 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5df216-5634-4fac-bc64-89a6cae70a66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:55.685288 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5df216-5634-4fac-bc64-89a6cae70a66 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:55.694937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 156/298] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 26 05:29:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:55.700741 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399d687-d60c-4818-a1d5-d6f1cea839fb None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:55.753693 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95233e-c796-442f-90d4-a158deeb55ba None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:55.754051 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95233e-c796-442f-90d4-a158deeb55ba None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:55.754305 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95233e-c796-442f-90d4-a158deeb55ba None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:55.755905 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 157/299] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:29:55.761908 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce545d06-c786-4b25-9da3-40966477c76e None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:55.762226 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce545d06-c786-4b25-9da3-40966477c76e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:55.762402 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce545d06-c786-4b25-9da3-40966477c76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:55.770083 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:55.788475 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-ce545d06-c786-4b25-9da3-40966477c76e None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:55.789974 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ce545d06-c786-4b25-9da3-40966477c76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:55.823340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399d687-d60c-4818-a1d5-d6f1cea839fb None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:55.864761 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c431665-7bc0-4b54-b87e-a94d5c1516e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:55.865540 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c431665-7bc0-4b54-b87e-a94d5c1516e6 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:55.865897 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c431665-7bc0-4b54-b87e-a94d5c1516e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:55.866419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c431665-7bc0-4b54-b87e-a94d5c1516e6 None admin] PATH_INFO: `/v3/users/d9b04d01e67d4f93b774ba789f7410e3` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:55.875988 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c431665-7bc0-4b54-b87e-a94d5c1516e6 None admin] RBAC: Authorizing `identity:get_user(user_id=d9b04d01e67d4f93b774ba789f7410e3)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:55.877477 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c431665-7bc0-4b54-b87e-a94d5c1516e6 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:55.879351 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 143/300] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:29:55 2022] GET /identity/v3/users/d9b04d01e67d4f93b774ba789f7410e3 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:29:55.885227 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c431665-7bc0-4b54-b87e-a94d5c1516e6 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:55.899110 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:55.900091 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 158/301] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:29:56.002624 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c431665-7bc0-4b54-b87e-a94d5c1516e6 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:56.045035 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d38e9-f3a9-4f48-bc4d-361ed7b7c628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:56.046212 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d38e9-f3a9-4f48-bc4d-361ed7b7c628 None admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:56.046754 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d38e9-f3a9-4f48-bc4d-361ed7b7c628 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:56.047245 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d38e9-f3a9-4f48-bc4d-361ed7b7c628 None admin] PATH_INFO: `/v3/system/users/d9b04d01e67d4f93b774ba789f7410e3/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:56.049164 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d38e9-f3a9-4f48-bc4d-361ed7b7c628 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d9b04d01e67d4f93b774ba789f7410e3, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:56.050910 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d38e9-f3a9-4f48-bc4d-361ed7b7c628 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:56.066963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 144/302] 10.222.0.66 () {58 vars in 1334 bytes} [Mon Sep 26 05:29:55 2022] PUT /identity/v3/system/users/d9b04d01e67d4f93b774ba789f7410e3/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:29:56.185300 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce545d06-c786-4b25-9da3-40966477c76e None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:56.312731 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce545d06-c786-4b25-9da3-40966477c76e None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:56.349755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:56.354982 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45161794-7715-475e-b74c-6b4cc5d02b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:56.356466 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45161794-7715-475e-b74c-6b4cc5d02b74 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:56.357415 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45161794-7715-475e-b74c-6b4cc5d02b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:56.358145 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45161794-7715-475e-b74c-6b4cc5d02b74 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:56.371505 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45161794-7715-475e-b74c-6b4cc5d02b74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:29:56.374752 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b690275-601b-4d5b-baf9-f2c30d0601a4 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:56.374752 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b690275-601b-4d5b-baf9-f2c30d0601a4 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:56.374752 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b690275-601b-4d5b-baf9-f2c30d0601a4 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:56.375464 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 145/303] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:29:56.376414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-45161794-7715-475e-b74c-6b4cc5d02b74 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:29:56.376414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:56.376414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:56.376414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:56.376414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:56.376414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:56.376414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:56.376414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:56.376414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:56.376414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:56.376414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:56.376414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:56.376414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:29:56.376414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:29:56.376414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:29:56.376414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:29:56.377895 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:29:56.377895 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:29:56.377895 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:29:56.377895 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:29:56.377895 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:56.377895 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:56.377895 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:56.377895 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:56.377895 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:56.377895 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:56.377895 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:56.377895 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:56.377895 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:56.377895 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:56.377895 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:56.377895 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:56.379346 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:56.379346 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:56.379346 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:56.379346 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:56.379346 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:29:56.379346 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:29:56.379346 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:29:56.379346 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:29:56.379346 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:29:56.379346 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:29:56.379346 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:29:56.379346 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:29:56.382604 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734f453-7816-47e5-b7d7-99d78dddb54f None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:56.382604 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734f453-7816-47e5-b7d7-99d78dddb54f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:56.382604 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d734f453-7816-47e5-b7d7-99d78dddb54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:56.383551 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 159/304] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:29:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:29:56.387079 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45161794-7715-475e-b74c-6b4cc5d02b74 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:56.405290 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-d734f453-7816-47e5-b7d7-99d78dddb54f None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:56.406670 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d734f453-7816-47e5-b7d7-99d78dddb54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:56.498002 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 146/305] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:29:56.499874 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df885b-de00-4182-9323-6e028b5124a3 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:56.500367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df885b-de00-4182-9323-6e028b5124a3 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:56.500807 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df885b-de00-4182-9323-6e028b5124a3 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:56.502598 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 147/306] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:29:56.509693 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652852f-0406-4f00-b73f-3210adfe5173 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:56.510259 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652852f-0406-4f00-b73f-3210adfe5173 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:56.510695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652852f-0406-4f00-b73f-3210adfe5173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:56.529173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:56.535023 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45161794-7715-475e-b74c-6b4cc5d02b74 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:56.539857 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-6652852f-0406-4f00-b73f-3210adfe5173 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:56.543231 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-6652852f-0406-4f00-b73f-3210adfe5173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:56.592228 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07260561-6bb5-4490-8fb0-854f1d26d6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:56.593302 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07260561-6bb5-4490-8fb0-854f1d26d6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:56.593686 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07260561-6bb5-4490-8fb0-854f1d26d6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:56.594247 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07260561-6bb5-4490-8fb0-854f1d26d6f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:56.595432 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07260561-6bb5-4490-8fb0-854f1d26d6f1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:56.596038 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07260561-6bb5-4490-8fb0-854f1d26d6f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:56.598227 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07260561-6bb5-4490-8fb0-854f1d26d6f1 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:56.614399 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 160/307] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 26 05:29:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:29:56.623307 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07260561-6bb5-4490-8fb0-854f1d26d6f1 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:56.650795 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 148/308] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:29:56.702407 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:56.768429 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07260561-6bb5-4490-8fb0-854f1d26d6f1 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:56.818061 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652852f-0406-4f00-b73f-3210adfe5173 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:56.822867 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b2b1a-71d7-4907-a3e0-e0d949f6d968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:56.823663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b2b1a-71d7-4907-a3e0-e0d949f6d968 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:56.824009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b2b1a-71d7-4907-a3e0-e0d949f6d968 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:56.824373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b2b1a-71d7-4907-a3e0-e0d949f6d968 None admin] PATH_INFO: `/v3/users/caacc4ab14b043538545944ae93af693` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:56.843328 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b2b1a-71d7-4907-a3e0-e0d949f6d968 None admin] RBAC: Authorizing `identity:get_user(user_id=caacc4ab14b043538545944ae93af693)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:56.848823 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b2b1a-71d7-4907-a3e0-e0d949f6d968 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:56.855867 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 161/309] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:29:56 2022] GET /identity/v3/users/caacc4ab14b043538545944ae93af693 => generated 293 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:56.858182 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b2b1a-71d7-4907-a3e0-e0d949f6d968 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:56.972603 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652852f-0406-4f00-b73f-3210adfe5173 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:57.009918 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b2b1a-71d7-4907-a3e0-e0d949f6d968 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:57.017611 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c4a8b-c050-435b-af37-745de9c692ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:57.018286 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c4a8b-c050-435b-af37-745de9c692ac None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:57.018606 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c4a8b-c050-435b-af37-745de9c692ac None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:57.018846 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c4a8b-c050-435b-af37-745de9c692ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:57.020144 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c4a8b-c050-435b-af37-745de9c692ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:57.021629 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c4a8b-c050-435b-af37-745de9c692ac None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:57.023581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 149/310] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:29:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:29:57.024246 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c4a8b-c050-435b-af37-745de9c692ac None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:57.027778 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:57.032437 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:57.061973 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026e6f9-a44e-4c78-85f6-cf78b06fc648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:57.063042 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026e6f9-a44e-4c78-85f6-cf78b06fc648 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:57.063642 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026e6f9-a44e-4c78-85f6-cf78b06fc648 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:57.064082 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026e6f9-a44e-4c78-85f6-cf78b06fc648 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:57.065699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026e6f9-a44e-4c78-85f6-cf78b06fc648 None admin] RBAC: Adding query filter params (role.id=f003916a5d7249639775054051c6d3ab, user.id=caacc4ab14b043538545944ae93af693, scope.system=all) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:57.066374 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026e6f9-a44e-4c78-85f6-cf78b06fc648 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:57.068038 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3026e6f9-a44e-4c78-85f6-cf78b06fc648 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:57.087913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 162/311] 10.222.0.66 () {56 vars in 1308 bytes} [Mon Sep 26 05:29:56 2022] GET /identity/v3/role_assignments?user.id=caacc4ab14b043538545944ae93af693&scope.system=all&role.id=f003916a5d7249639775054051c6d3ab => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:57.087913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026e6f9-a44e-4c78-85f6-cf78b06fc648 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:57.145933 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c4a8b-c050-435b-af37-745de9c692ac None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:57.186785 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad7250-09ba-46a9-883f-8db36df5543a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:57.187656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad7250-09ba-46a9-883f-8db36df5543a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:57.187940 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad7250-09ba-46a9-883f-8db36df5543a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:57.188303 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad7250-09ba-46a9-883f-8db36df5543a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:57.201354 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad7250-09ba-46a9-883f-8db36df5543a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:29:57.206882 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-f2ad7250-09ba-46a9-883f-8db36df5543a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:29:57.206882 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:57.206882 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:57.206882 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:57.206882 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:57.206882 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:57.206882 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:57.206882 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:57.206882 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:57.206882 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:57.206882 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:57.206882 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:57.206882 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:29:57.206882 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:29:57.206882 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:29:57.206882 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:29:57.208056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:29:57.208056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:29:57.208056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:29:57.208056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:29:57.208056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:57.208056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:57.208056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:57.208056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:57.208056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:57.208056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:57.208056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:57.208056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:57.208056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:57.208056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:57.208056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:57.208056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:57.209173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:57.209173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:57.209173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:57.209173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:57.209173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:29:57.209173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:29:57.209173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:29:57.209173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:29:57.209173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:29:57.209173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:29:57.209173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:29:57.209173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:29:57.210293 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 150/312] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:29:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:29:57.217130 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad7250-09ba-46a9-883f-8db36df5543a None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:57.246973 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3026e6f9-a44e-4c78-85f6-cf78b06fc648 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:57.293804 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef49e8-24ff-498a-88f3-d65844ebe155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:57.294336 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef49e8-24ff-498a-88f3-d65844ebe155 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:57.294609 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef49e8-24ff-498a-88f3-d65844ebe155 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:57.294875 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef49e8-24ff-498a-88f3-d65844ebe155 None admin] PATH_INFO: `/v3/groups` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:57.295517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef49e8-24ff-498a-88f3-d65844ebe155 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:57.297162 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:57.297404 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef49e8-24ff-498a-88f3-d65844ebe155 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:57.321573 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 163/313] 10.222.0.66 () {60 vars in 1134 bytes} [Mon Sep 26 05:29:57 2022] POST /identity/v3/groups => generated 229 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:29:57.363449 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad7250-09ba-46a9-883f-8db36df5543a None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:57.405539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cb926-b288-41ac-8765-e7d2485c6f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:57.406233 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cb926-b288-41ac-8765-e7d2485c6f58 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:57.406561 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cb926-b288-41ac-8765-e7d2485c6f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:57.406833 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cb926-b288-41ac-8765-e7d2485c6f58 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:57.407532 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cb926-b288-41ac-8765-e7d2485c6f58 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:57.407874 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cb926-b288-41ac-8765-e7d2485c6f58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:57.409316 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cb926-b288-41ac-8765-e7d2485c6f58 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:57.420162 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 151/314] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 26 05:29:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:29:57.426455 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef49e8-24ff-498a-88f3-d65844ebe155 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:57.475347 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:57.554398 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef49e8-24ff-498a-88f3-d65844ebe155 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:57.592451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a0c3d-2298-4bf9-b005-8d7d445b7588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:57.593107 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a0c3d-2298-4bf9-b005-8d7d445b7588 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:57.593381 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a0c3d-2298-4bf9-b005-8d7d445b7588 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:57.593649 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a0c3d-2298-4bf9-b005-8d7d445b7588 None admin] PATH_INFO: `/v3/users/75c7fb5f762b4e58a845985518d2cbd9` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:57.594840 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a0c3d-2298-4bf9-b005-8d7d445b7588 None admin] RBAC: Authorizing `identity:get_user(user_id=75c7fb5f762b4e58a845985518d2cbd9)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:57.596380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a0c3d-2298-4bf9-b005-8d7d445b7588 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:57.602783 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 164/315] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:29:57 2022] GET /identity/v3/users/75c7fb5f762b4e58a845985518d2cbd9 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:57.604552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cb926-b288-41ac-8765-e7d2485c6f58 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:57.763906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cb926-b288-41ac-8765-e7d2485c6f58 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:57.802750 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:57.819600 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059f45d-8cd1-4d6f-9158-6d2afe459e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:57.820799 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059f45d-8cd1-4d6f-9158-6d2afe459e47 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:57.821322 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059f45d-8cd1-4d6f-9158-6d2afe459e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:57.821789 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059f45d-8cd1-4d6f-9158-6d2afe459e47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:57.949256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059f45d-8cd1-4d6f-9158-6d2afe459e47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:57.952803 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5059f45d-8cd1-4d6f-9158-6d2afe459e47 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:58.147976 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 152/316] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:29:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 26 05:29:58.154168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a0c3d-2298-4bf9-b005-8d7d445b7588 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:58.342079 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a0c3d-2298-4bf9-b005-8d7d445b7588 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:58.347693 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:58.424629 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94fff2-89e4-4608-87e2-df044a622423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:58.427642 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94fff2-89e4-4608-87e2-df044a622423 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:58.427642 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94fff2-89e4-4608-87e2-df044a622423 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:58.427642 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94fff2-89e4-4608-87e2-df044a622423 None admin] PATH_INFO: `/v3/projects/61304b31bc674654a80d1255b6e98ad3` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:58.429223 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94fff2-89e4-4608-87e2-df044a622423 None admin] RBAC: Authorizing `identity:get_project(project_id=61304b31bc674654a80d1255b6e98ad3)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:58.432184 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94fff2-89e4-4608-87e2-df044a622423 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:58.435960 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 165/317] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:29:58 2022] GET /identity/v3/projects/61304b31bc674654a80d1255b6e98ad3 => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:58.445693 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059f45d-8cd1-4d6f-9158-6d2afe459e47 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:58.492669 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:58.507649 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc8812-b520-46d9-8504-259ce70e47b1 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:58.507973 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc8812-b520-46d9-8504-259ce70e47b1 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:58.508214 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc8812-b520-46d9-8504-259ce70e47b1 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:58.509877 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 166/318] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:29:58.517270 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f9587-3864-4ab1-b5f8-81188267ac71 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:58.518144 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f9587-3864-4ab1-b5f8-81188267ac71 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:58.518818 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f9587-3864-4ab1-b5f8-81188267ac71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:58.549512 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b77f9587-3864-4ab1-b5f8-81188267ac71 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:58.551975 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b77f9587-3864-4ab1-b5f8-81188267ac71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:58.625147 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059f45d-8cd1-4d6f-9158-6d2afe459e47 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:58.670296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb790a-a4c8-4681-a522-ba4f1ebb1e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:58.670924 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb790a-a4c8-4681-a522-ba4f1ebb1e49 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:58.671201 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb790a-a4c8-4681-a522-ba4f1ebb1e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:58.671462 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb790a-a4c8-4681-a522-ba4f1ebb1e49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:58.672314 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb790a-a4c8-4681-a522-ba4f1ebb1e49 None admin] RBAC: Adding query filter params (role.id=f003916a5d7249639775054051c6d3ab, scope.project.id=61304b31bc674654a80d1255b6e98ad3, user.id=75c7fb5f762b4e58a845985518d2cbd9) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:58.672624 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb790a-a4c8-4681-a522-ba4f1ebb1e49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:58.674573 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb790a-a4c8-4681-a522-ba4f1ebb1e49 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:58.683867 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 153/319] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:29:58 2022] GET /identity/v3/role_assignments?user.id=75c7fb5f762b4e58a845985518d2cbd9&scope.project.id=61304b31bc674654a80d1255b6e98ad3&role.id=f003916a5d7249639775054051c6d3ab => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:58.684786 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 167/320] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:29:59.176098 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb790a-a4c8-4681-a522-ba4f1ebb1e49 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:59.319466 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:59.340711 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb790a-a4c8-4681-a522-ba4f1ebb1e49 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:59.399937 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e96f7-74e5-4527-aacd-ec76e29aea73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:59.401048 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e96f7-74e5-4527-aacd-ec76e29aea73 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:59.401495 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e96f7-74e5-4527-aacd-ec76e29aea73 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:59.401944 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e96f7-74e5-4527-aacd-ec76e29aea73 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:59.422362 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e96f7-74e5-4527-aacd-ec76e29aea73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:29:59.431813 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-935e96f7-74e5-4527-aacd-ec76e29aea73 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:29:59.431813 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:29:59.431813 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:29:59.431813 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:29:59.431813 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:29:59.431813 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:29:59.431813 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:29:59.431813 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:29:59.431813 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:29:59.431813 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:29:59.431813 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:29:59.431813 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:29:59.431813 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:29:59.431813 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:29:59.431813 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:29:59.431813 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:29:59.432759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:29:59.432759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:29:59.432759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:29:59.432759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:29:59.432759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:29:59.432759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:29:59.432759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:29:59.432759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:29:59.432759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:29:59.432759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:29:59.432759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:29:59.432759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:29:59.432759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:29:59.432759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:29:59.432759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:29:59.432759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:29:59.433672 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:29:59.433672 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:29:59.433672 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:29:59.433672 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:29:59.433672 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:29:59.433672 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:29:59.433672 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:29:59.433672 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:29:59.433672 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:29:59.433672 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:29:59.433672 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:29:59.433672 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:29:59.434967 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 154/321] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:29:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:29:59.442450 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f9587-3864-4ab1-b5f8-81188267ac71 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:59.525995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7bd0f-71af-4e56-9026-871e469f944d None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:59.526251 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7bd0f-71af-4e56-9026-871e469f944d None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:59.526523 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7bd0f-71af-4e56-9026-871e469f944d None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:59.527912 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 155/322] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:29:59.533322 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ed095-913a-4297-9b70-ab60110ca3d1 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:59.533600 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ed095-913a-4297-9b70-ab60110ca3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:59.533913 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ed095-913a-4297-9b70-ab60110ca3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:59.554885 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-306ed095-913a-4297-9b70-ab60110ca3d1 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:29:59.556350 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-306ed095-913a-4297-9b70-ab60110ca3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:29:59.565733 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f9587-3864-4ab1-b5f8-81188267ac71 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:59.567453 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:59.609110 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c2bf4-9228-4da2-95dd-c14f6039027b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:59.609727 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c2bf4-9228-4da2-95dd-c14f6039027b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:59.609997 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c2bf4-9228-4da2-95dd-c14f6039027b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:59.610263 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c2bf4-9228-4da2-95dd-c14f6039027b None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:59.610924 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c2bf4-9228-4da2-95dd-c14f6039027b None admin] RBAC: Adding query filter params (name=member) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:29:59.611217 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c2bf4-9228-4da2-95dd-c14f6039027b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:59.612632 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c2bf4-9228-4da2-95dd-c14f6039027b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:59.623801 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 168/323] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 26 05:29:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:29:59.627558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c2bf4-9228-4da2-95dd-c14f6039027b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:59.644678 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 156/324] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:29:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:29:59.764054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c2bf4-9228-4da2-95dd-c14f6039027b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:29:59.826376 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9abeb-061d-4808-b190-cabddbcfee75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:29:59.827836 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9abeb-061d-4808-b190-cabddbcfee75 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:29:59.828338 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9abeb-061d-4808-b190-cabddbcfee75 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:29:59.828970 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9abeb-061d-4808-b190-cabddbcfee75 None admin] PATH_INFO: `/v3/users/d9b04d01e67d4f93b774ba789f7410e3` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:29:59.830907 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9abeb-061d-4808-b190-cabddbcfee75 None admin] RBAC: Authorizing `identity:get_user(user_id=d9b04d01e67d4f93b774ba789f7410e3)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:29:59.833673 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a9abeb-061d-4808-b190-cabddbcfee75 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:29:59.836954 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 169/325] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:29:59 2022] GET /identity/v3/users/d9b04d01e67d4f93b774ba789f7410e3 => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:29:59.845679 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ed095-913a-4297-9b70-ab60110ca3d1 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:59.908194 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9abeb-061d-4808-b190-cabddbcfee75 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:29:59.948018 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:59.956138 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:29:59.977785 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ed095-913a-4297-9b70-ab60110ca3d1 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:00.016271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b624a-848b-463f-8183-cf8f2b636293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:00.017428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b624a-848b-463f-8183-cf8f2b636293 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:00.017705 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b624a-848b-463f-8183-cf8f2b636293 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:00.017973 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b624a-848b-463f-8183-cf8f2b636293 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:00.018703 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b624a-848b-463f-8183-cf8f2b636293 None admin] RBAC: Adding query filter params (role.id=c5a02c4618d94f1da7257ef437b8ce9e, user.id=d9b04d01e67d4f93b774ba789f7410e3, scope.system=all) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:00.018998 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b624a-848b-463f-8183-cf8f2b636293 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:00.020619 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b624a-848b-463f-8183-cf8f2b636293 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:00.034221 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 157/326] 10.222.0.66 () {56 vars in 1308 bytes} [Mon Sep 26 05:29:59 2022] GET /identity/v3/role_assignments?user.id=d9b04d01e67d4f93b774ba789f7410e3&scope.system=all&role.id=c5a02c4618d94f1da7257ef437b8ce9e => generated 510 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:00.035482 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614fdfd-3c8a-446e-b720-d1a68a0019d9 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:00.035811 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614fdfd-3c8a-446e-b720-d1a68a0019d9 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:00.036040 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614fdfd-3c8a-446e-b720-d1a68a0019d9 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:00.037831 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 158/327] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:00.043877 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f388e06-fb61-40a4-9985-e317cc3c912e None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:00.044147 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f388e06-fb61-40a4-9985-e317cc3c912e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:00.044412 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f388e06-fb61-40a4-9985-e317cc3c912e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:00.063888 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-7f388e06-fb61-40a4-9985-e317cc3c912e None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:00.065108 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-7f388e06-fb61-40a4-9985-e317cc3c912e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:00.067000 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9abeb-061d-4808-b190-cabddbcfee75 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:00.113083 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279fc094-809d-4750-9076-caec2cec4630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:00.113771 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fc094-809d-4750-9076-caec2cec4630 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:00.114055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fc094-809d-4750-9076-caec2cec4630 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:00.114333 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279fc094-809d-4750-9076-caec2cec4630 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:00.127971 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279fc094-809d-4750-9076-caec2cec4630 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:30:00.133758 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-279fc094-809d-4750-9076-caec2cec4630 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:30:00.133758 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:00.133758 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:00.133758 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:00.133758 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:00.133758 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:00.133758 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:00.133758 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:00.133758 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:00.133758 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:00.133758 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:00.133758 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:00.133758 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:30:00.133758 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:30:00.133758 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:30:00.133758 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:30:00.134730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:30:00.134730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:30:00.134730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:30:00.134730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:30:00.134730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:00.134730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:00.134730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:00.134730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:00.134730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:00.134730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:00.134730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:00.134730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:00.134730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:00.134730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:00.134730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:00.134730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:00.135532 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:00.135532 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:00.135532 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:00.135532 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:00.135532 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:30:00.135532 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:30:00.135532 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:30:00.135532 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:30:00.135532 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:30:00.135532 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:30:00.135532 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:30:00.135532 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:00.135532 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 170/328] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:29:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:30:00.143647 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279fc094-809d-4750-9076-caec2cec4630 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:00.159823 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 159/329] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:30:00.249289 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:00.260511 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279fc094-809d-4750-9076-caec2cec4630 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:00.298893 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68b1ec-d8d6-4dc3-883c-58fb6b8693ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:00.299499 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68b1ec-d8d6-4dc3-883c-58fb6b8693ac None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:00.299790 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68b1ec-d8d6-4dc3-883c-58fb6b8693ac None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:00.300080 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68b1ec-d8d6-4dc3-883c-58fb6b8693ac None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:00.300748 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68b1ec-d8d6-4dc3-883c-58fb6b8693ac None admin] RBAC: Adding query filter params (name=reader) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:00.301043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68b1ec-d8d6-4dc3-883c-58fb6b8693ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:00.302468 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68b1ec-d8d6-4dc3-883c-58fb6b8693ac None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:00.315616 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 171/330] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 26 05:30:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:30:00.318418 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f388e06-fb61-40a4-9985-e317cc3c912e None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:00.391661 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:00.422197 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68b1ec-d8d6-4dc3-883c-58fb6b8693ac None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:00.427585 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f388e06-fb61-40a4-9985-e317cc3c912e None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:00.464005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402b33f-80ea-448b-8007-97c9ef36918b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:00.464644 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402b33f-80ea-448b-8007-97c9ef36918b None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:00.464915 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402b33f-80ea-448b-8007-97c9ef36918b None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:00.465179 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402b33f-80ea-448b-8007-97c9ef36918b None admin] PATH_INFO: `/v3/users/caacc4ab14b043538545944ae93af693` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:00.466328 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402b33f-80ea-448b-8007-97c9ef36918b None admin] RBAC: Authorizing `identity:get_user(user_id=caacc4ab14b043538545944ae93af693)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:00.467784 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402b33f-80ea-448b-8007-97c9ef36918b None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:00.469385 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 160/331] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:30:00 2022] GET /identity/v3/users/caacc4ab14b043538545944ae93af693 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:00.475097 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402b33f-80ea-448b-8007-97c9ef36918b None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:00.537574 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68b1ec-d8d6-4dc3-883c-58fb6b8693ac None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:00.571855 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf106d-5d5a-4580-b1f9-aebc263b57c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:00.572483 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf106d-5d5a-4580-b1f9-aebc263b57c9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:00.572752 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf106d-5d5a-4580-b1f9-aebc263b57c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:00.573019 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf106d-5d5a-4580-b1f9-aebc263b57c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:00.574125 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf106d-5d5a-4580-b1f9-aebc263b57c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:00.575595 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf106d-5d5a-4580-b1f9-aebc263b57c9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:00.577775 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 172/332] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:30:00.580961 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402b33f-80ea-448b-8007-97c9ef36918b None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:00.583584 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf106d-5d5a-4580-b1f9-aebc263b57c9 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:00.612349 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:00.622125 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9c485-5356-4fb7-87aa-9d007268c98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:00.622953 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9c485-5356-4fb7-87aa-9d007268c98f None admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:00.623224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9c485-5356-4fb7-87aa-9d007268c98f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:00.623486 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9c485-5356-4fb7-87aa-9d007268c98f None admin] PATH_INFO: `/v3/system/users/caacc4ab14b043538545944ae93af693/roles/f003916a5d7249639775054051c6d3ab` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:00.625156 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9c485-5356-4fb7-87aa-9d007268c98f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=caacc4ab14b043538545944ae93af693, role_id=f003916a5d7249639775054051c6d3ab)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:00.626578 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9c485-5356-4fb7-87aa-9d007268c98f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:00.628382 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:00.635694 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 161/333] 10.222.0.66 () {58 vars in 1334 bytes} [Mon Sep 26 05:30:00 2022] PUT /identity/v3/system/users/caacc4ab14b043538545944ae93af693/roles/f003916a5d7249639775054051c6d3ab => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:00.706854 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf106d-5d5a-4580-b1f9-aebc263b57c9 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:00.746238 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b98a64-017e-4935-802d-dd724e01cd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:00.746968 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b98a64-017e-4935-802d-dd724e01cd8c None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:00.747299 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b98a64-017e-4935-802d-dd724e01cd8c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:00.747623 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b98a64-017e-4935-802d-dd724e01cd8c None admin] PATH_INFO: `/v3/groups` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:00.748530 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b98a64-017e-4935-802d-dd724e01cd8c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:00.750097 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b98a64-017e-4935-802d-dd724e01cd8c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:00.768130 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 173/334] 10.222.0.66 () {60 vars in 1134 bytes} [Mon Sep 26 05:30:00 2022] POST /identity/v3/groups => generated 226 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:04.133933 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10266299-4e11-411c-b142-ae4eba0038d5 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:04.134432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10266299-4e11-411c-b142-ae4eba0038d5 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:04.134432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10266299-4e11-411c-b142-ae4eba0038d5 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:04.135773 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 162/335] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:04.148745 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a905a-ed8e-4e65-bbc3-67e74226833e None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:04.149749 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a905a-ed8e-4e65-bbc3-67e74226833e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:04.150235 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a905a-ed8e-4e65-bbc3-67e74226833e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:04.176512 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-e27a905a-ed8e-4e65-bbc3-67e74226833e None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:04.178153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e27a905a-ed8e-4e65-bbc3-67e74226833e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:04.258872 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb32ffe-7f8d-4828-aa9b-6b9f0ac872fd None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:04.259227 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb32ffe-7f8d-4828-aa9b-6b9f0ac872fd None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:04.259415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb32ffe-7f8d-4828-aa9b-6b9f0ac872fd None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:04.262449 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 163/336] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:04.267054 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbea15f-c3c9-4cbc-849b-158cc85421b1 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:04.267343 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbea15f-c3c9-4cbc-849b-158cc85421b1 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:04.267607 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbea15f-c3c9-4cbc-849b-158cc85421b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:04.269235 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 174/337] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:30:04.305757 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-bdbea15f-c3c9-4cbc-849b-158cc85421b1 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:04.306983 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-bdbea15f-c3c9-4cbc-849b-158cc85421b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:04.403175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 164/338] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:30:04.462039 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488440e-4007-45f9-b596-7045c3cbb7b6 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:04.462689 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488440e-4007-45f9-b596-7045c3cbb7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:04.463145 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488440e-4007-45f9-b596-7045c3cbb7b6 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:04.465066 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 175/339] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:04.470925 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7904ff7-8e19-4882-a4d5-20fbf14f1ad5 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:04.471256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7904ff7-8e19-4882-a4d5-20fbf14f1ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:04.471490 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7904ff7-8e19-4882-a4d5-20fbf14f1ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:04.495245 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-d7904ff7-8e19-4882-a4d5-20fbf14f1ad5 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:04.496485 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d7904ff7-8e19-4882-a4d5-20fbf14f1ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:04.588069 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 165/340] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:30:04.859851 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488440e-4007-45f9-b596-7045c3cbb7b6 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:04.876026 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:05.003036 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488440e-4007-45f9-b596-7045c3cbb7b6 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:05.028632 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7904ff7-8e19-4882-a4d5-20fbf14f1ad5 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:05.048126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c6136-14da-44d2-b28b-5a8058eea280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:05.049057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c6136-14da-44d2-b28b-5a8058eea280 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:05.049333 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c6136-14da-44d2-b28b-5a8058eea280 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:05.049598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c6136-14da-44d2-b28b-5a8058eea280 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:05.073509 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c6136-14da-44d2-b28b-5a8058eea280 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:30:05.078986 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-971c6136-14da-44d2-b28b-5a8058eea280 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:30:05.078986 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:05.078986 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:05.078986 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:05.078986 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:05.078986 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:05.078986 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:05.078986 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:05.078986 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:05.078986 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:05.078986 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:05.078986 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:05.078986 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:30:05.078986 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:30:05.078986 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:30:05.078986 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:30:05.079939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:30:05.079939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:30:05.079939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:30:05.079939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:30:05.079939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:05.079939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:05.079939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:05.079939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:05.079939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:05.079939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:05.079939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:05.079939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:05.079939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:05.079939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:05.079939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:05.079939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:05.080766 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:05.080766 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:05.080766 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:05.080766 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:05.080766 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:30:05.080766 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:30:05.080766 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:30:05.080766 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:30:05.080766 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:30:05.080766 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:30:05.080766 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 26 05:30:05.080766 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:05.080766 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 176/341] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:30:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:05.084741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c6136-14da-44d2-b28b-5a8058eea280 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:05.179901 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:05.205699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:05.219089 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c6136-14da-44d2-b28b-5a8058eea280 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:05.264184 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92217bf0-cbc3-4871-813a-a327aa70809e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:05.264736 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92217bf0-cbc3-4871-813a-a327aa70809e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:05.265012 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92217bf0-cbc3-4871-813a-a327aa70809e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:05.265282 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92217bf0-cbc3-4871-813a-a327aa70809e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:05.273829 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7904ff7-8e19-4882-a4d5-20fbf14f1ad5 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:05.279670 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92217bf0-cbc3-4871-813a-a327aa70809e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:30:05.285777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-92217bf0-cbc3-4871-813a-a327aa70809e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:30:05.285777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:05.285777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:05.285777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:05.285777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:05.285777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:05.285777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:05.285777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:05.285777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:05.285777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:05.285777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:05.285777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:05.285777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:30:05.285777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:30:05.285777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:30:05.285777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:30:05.286730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:30:05.286730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:30:05.286730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:30:05.286730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:30:05.286730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:05.286730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:05.286730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:05.286730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:05.286730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:05.286730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:05.286730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:05.286730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:05.286730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:05.286730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:05.286730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:05.286730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:05.287552 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:05.287552 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:05.287552 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:05.287552 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:05.287552 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:30:05.287552 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:30:05.287552 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:30:05.287552 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:30:05.287552 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:30:05.287552 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:30:05.287552 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:30:05.287552 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:05.288240 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 177/342] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 26 05:30:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:05.292062 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92217bf0-cbc3-4871-813a-a327aa70809e None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:05.333884 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a6ba3-77df-4ce7-a706-c6fa271a2f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:05.334884 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a6ba3-77df-4ce7-a706-c6fa271a2f02 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:05.335405 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a6ba3-77df-4ce7-a706-c6fa271a2f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:05.335889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a6ba3-77df-4ce7-a706-c6fa271a2f02 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:05.348539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a6ba3-77df-4ce7-a706-c6fa271a2f02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:30:05.354029 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-580a6ba3-77df-4ce7-a706-c6fa271a2f02 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:30:05.354029 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:05.354029 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:05.354029 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:05.354029 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:05.354029 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:05.354029 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:05.354029 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:05.354029 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:05.354029 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:05.354029 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:05.354029 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:05.354029 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:30:05.354029 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:30:05.354029 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:30:05.354029 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:30:05.354976 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:30:05.354976 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:30:05.354976 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:30:05.354976 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:30:05.354976 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:05.354976 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:05.354976 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:05.354976 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:05.354976 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:05.354976 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:05.354976 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:05.354976 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:05.354976 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:05.354976 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:05.354976 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:05.354976 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:05.355818 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:05.355818 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:05.355818 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:05.355818 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:05.355818 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:30:05.355818 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:30:05.355818 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:30:05.355818 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:30:05.355818 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:30:05.355818 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:30:05.355818 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:30:05.355818 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:05.358495 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 166/343] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:30:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:05.360643 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250a32b-ba55-41e7-b5da-ed4fde4104e6 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:05.361245 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250a32b-ba55-41e7-b5da-ed4fde4104e6 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:05.361713 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250a32b-ba55-41e7-b5da-ed4fde4104e6 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:05.363529 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 167/344] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:05.364484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250a32b-ba55-41e7-b5da-ed4fde4104e6 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:05.404418 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92217bf0-cbc3-4871-813a-a327aa70809e None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:05.440293 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:05.449264 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd400f86-b16b-455e-b80b-ed0f6d6fbea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:05.449931 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd400f86-b16b-455e-b80b-ed0f6d6fbea9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:05.450203 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd400f86-b16b-455e-b80b-ed0f6d6fbea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:05.450577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd400f86-b16b-455e-b80b-ed0f6d6fbea9 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:05.451422 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd400f86-b16b-455e-b80b-ed0f6d6fbea9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:05.451866 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd400f86-b16b-455e-b80b-ed0f6d6fbea9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:05.454348 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd400f86-b16b-455e-b80b-ed0f6d6fbea9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:05.465366 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 178/345] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 26 05:30:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:05.472997 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd400f86-b16b-455e-b80b-ed0f6d6fbea9 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:05.500728 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250a32b-ba55-41e7-b5da-ed4fde4104e6 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:05.526748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:05.556303 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f246aa-2835-4d1e-b40e-e24346207488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:05.557177 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f246aa-2835-4d1e-b40e-e24346207488 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:05.557578 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f246aa-2835-4d1e-b40e-e24346207488 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:05.557942 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f246aa-2835-4d1e-b40e-e24346207488 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:05.558894 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f246aa-2835-4d1e-b40e-e24346207488 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:05.559346 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f246aa-2835-4d1e-b40e-e24346207488 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:05.561135 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f246aa-2835-4d1e-b40e-e24346207488 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:05.572701 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 168/346] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:30:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:05.574097 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f8b13-ea53-4f17-b871-72a1cb5d6827 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:05.574391 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f8b13-ea53-4f17-b871-72a1cb5d6827 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:05.574638 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f8b13-ea53-4f17-b871-72a1cb5d6827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:05.606686 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-728f8b13-ea53-4f17-b871-72a1cb5d6827 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:05.607963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-728f8b13-ea53-4f17-b871-72a1cb5d6827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:05.639340 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd400f86-b16b-455e-b80b-ed0f6d6fbea9 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:05.697240 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d19be3-5703-4e50-b5d3-4308a3d2d208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:05.697957 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d19be3-5703-4e50-b5d3-4308a3d2d208 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:05.698234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d19be3-5703-4e50-b5d3-4308a3d2d208 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:05.698507 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d19be3-5703-4e50-b5d3-4308a3d2d208 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:05.699182 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d19be3-5703-4e50-b5d3-4308a3d2d208 None admin] RBAC: Adding query filter params (name=member) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:05.699482 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d19be3-5703-4e50-b5d3-4308a3d2d208 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:05.700966 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d19be3-5703-4e50-b5d3-4308a3d2d208 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:05.712138 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 179/347] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 26 05:30:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:05.713094 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d19be3-5703-4e50-b5d3-4308a3d2d208 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:05.729782 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 169/348] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:30:05.731024 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f8b13-ea53-4f17-b871-72a1cb5d6827 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:05.782945 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:05.838124 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d19be3-5703-4e50-b5d3-4308a3d2d208 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:05.849186 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f8b13-ea53-4f17-b871-72a1cb5d6827 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:05.860848 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:05.877208 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c9481-f521-488e-ab94-5fd3a4de255f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:05.878074 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c9481-f521-488e-ab94-5fd3a4de255f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:05.878352 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c9481-f521-488e-ab94-5fd3a4de255f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:05.878605 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c9481-f521-488e-ab94-5fd3a4de255f None admin] PATH_INFO: `/v3/users/caacc4ab14b043538545944ae93af693` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:05.879973 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c9481-f521-488e-ab94-5fd3a4de255f None admin] RBAC: Authorizing `identity:get_user(user_id=caacc4ab14b043538545944ae93af693)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:05.881464 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c9481-f521-488e-ab94-5fd3a4de255f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:05.883387 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 180/349] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:30:05 2022] GET /identity/v3/users/caacc4ab14b043538545944ae93af693 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:05.884206 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c9481-f521-488e-ab94-5fd3a4de255f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:05.888118 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f3793-219c-4e47-bba6-883d34cd330a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:05.888741 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f3793-219c-4e47-bba6-883d34cd330a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:05.889015 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f3793-219c-4e47-bba6-883d34cd330a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:05.889277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f3793-219c-4e47-bba6-883d34cd330a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:05.967579 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f3793-219c-4e47-bba6-883d34cd330a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:05.969989 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f3793-219c-4e47-bba6-883d34cd330a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:06.008926 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c9481-f521-488e-ab94-5fd3a4de255f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:06.043536 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:06.059118 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181f0e9-61e7-4079-b1d7-37ec15c3e66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:06.059866 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181f0e9-61e7-4079-b1d7-37ec15c3e66d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:06.060140 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181f0e9-61e7-4079-b1d7-37ec15c3e66d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:06.060524 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181f0e9-61e7-4079-b1d7-37ec15c3e66d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:06.098196 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 170/350] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:30:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:06.099595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e472e-adbb-4c89-b7ff-401f6d88f833 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:06.099895 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e472e-adbb-4c89-b7ff-401f6d88f833 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:06.100175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e472e-adbb-4c89-b7ff-401f6d88f833 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:06.101607 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 171/351] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:06.102371 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e472e-adbb-4c89-b7ff-401f6d88f833 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:06.115904 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:06.143220 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181f0e9-61e7-4079-b1d7-37ec15c3e66d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:06.144746 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181f0e9-61e7-4079-b1d7-37ec15c3e66d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:06.216580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e472e-adbb-4c89-b7ff-401f6d88f833 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:06.254967 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d40350-4c5a-4589-805f-94388e2eb390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:06.255681 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d40350-4c5a-4589-805f-94388e2eb390 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:06.256063 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d40350-4c5a-4589-805f-94388e2eb390 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:06.256425 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d40350-4c5a-4589-805f-94388e2eb390 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:06.257417 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d40350-4c5a-4589-805f-94388e2eb390 None admin] RBAC: Adding query filter params (role.id=f003916a5d7249639775054051c6d3ab, user.id=caacc4ab14b043538545944ae93af693, scope.system=all) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:06.257787 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d40350-4c5a-4589-805f-94388e2eb390 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:06.259290 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d40350-4c5a-4589-805f-94388e2eb390 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:06.262933 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 181/352] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:30:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:06.263804 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181f0e9-61e7-4079-b1d7-37ec15c3e66d None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:06.273256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 172/353] 10.222.0.66 () {56 vars in 1308 bytes} [Mon Sep 26 05:30:06 2022] GET /identity/v3/role_assignments?user.id=caacc4ab14b043538545944ae93af693&scope.system=all&role.id=f003916a5d7249639775054051c6d3ab => generated 510 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:06.274568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce67c3-e6c6-4107-a2af-d8c82be4fc04 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:06.274849 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce67c3-e6c6-4107-a2af-d8c82be4fc04 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:06.275116 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce67c3-e6c6-4107-a2af-d8c82be4fc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:06.292533 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:06.315483 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-adce67c3-e6c6-4107-a2af-d8c82be4fc04 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:06.325304 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-adce67c3-e6c6-4107-a2af-d8c82be4fc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:06.385570 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181f0e9-61e7-4079-b1d7-37ec15c3e66d None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:06.407721 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:06.417381 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 173/354] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:30:06.418387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce67c3-e6c6-4107-a2af-d8c82be4fc04 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:06.430026 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02df282-2ba9-4c34-b8ae-33036087c5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:06.430690 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02df282-2ba9-4c34-b8ae-33036087c5ec None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:06.430967 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02df282-2ba9-4c34-b8ae-33036087c5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:06.431219 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02df282-2ba9-4c34-b8ae-33036087c5ec None admin] PATH_INFO: `/v3/projects/f36f364f981e4cbb8bca50ac93a26b16` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:06.432600 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02df282-2ba9-4c34-b8ae-33036087c5ec None admin] RBAC: Authorizing `identity:get_project(project_id=f36f364f981e4cbb8bca50ac93a26b16)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:06.434281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02df282-2ba9-4c34-b8ae-33036087c5ec None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:06.436512 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 182/355] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:30:06 2022] GET /identity/v3/projects/f36f364f981e4cbb8bca50ac93a26b16 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:06.437329 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02df282-2ba9-4c34-b8ae-33036087c5ec None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:06.538928 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce67c3-e6c6-4107-a2af-d8c82be4fc04 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:06.549012 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:06.559895 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02df282-2ba9-4c34-b8ae-33036087c5ec None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:06.596256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a999a6f-eaa3-4385-a480-3b994397acb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:06.599774 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a999a6f-eaa3-4385-a480-3b994397acb2 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:06.599774 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a999a6f-eaa3-4385-a480-3b994397acb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:06.599774 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a999a6f-eaa3-4385-a480-3b994397acb2 None admin] PATH_INFO: `/v3/projects/f36f364f981e4cbb8bca50ac93a26b16` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:06.601583 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a999a6f-eaa3-4385-a480-3b994397acb2 None admin] RBAC: Authorizing `identity:get_project(project_id=f36f364f981e4cbb8bca50ac93a26b16)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:06.603133 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a999a6f-eaa3-4385-a480-3b994397acb2 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:06.608802 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 174/356] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:30:06 2022] GET /identity/v3/projects/f36f364f981e4cbb8bca50ac93a26b16 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:06.612094 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a999a6f-eaa3-4385-a480-3b994397acb2 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:06.613130 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe24c73-5e9f-4c7d-81a8-26cb8606e6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:06.614328 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe24c73-5e9f-4c7d-81a8-26cb8606e6ee None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:06.614588 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe24c73-5e9f-4c7d-81a8-26cb8606e6ee None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:06.614857 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe24c73-5e9f-4c7d-81a8-26cb8606e6ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:06.642157 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe24c73-5e9f-4c7d-81a8-26cb8606e6ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:30:06.647602 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-cbe24c73-5e9f-4c7d-81a8-26cb8606e6ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:30:06.647602 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:06.647602 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:06.647602 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:06.647602 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:06.647602 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:06.647602 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:06.647602 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:06.647602 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:06.647602 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:06.647602 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:06.647602 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:06.647602 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:30:06.647602 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:30:06.647602 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:30:06.647602 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:30:06.650841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:30:06.650841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:30:06.650841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:30:06.650841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:30:06.650841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:06.650841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:06.650841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:06.650841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:06.650841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:06.650841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:06.650841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:06.650841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:06.650841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:06.650841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:06.650841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:06.650841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:06.653807 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:06.653807 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:06.653807 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:06.653807 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:06.653807 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:30:06.653807 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:30:06.653807 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:30:06.653807 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:30:06.653807 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:30:06.653807 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:30:06.653807 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:30:06.653807 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:06.653807 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 183/357] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:30:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:06.653807 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe24c73-5e9f-4c7d-81a8-26cb8606e6ee None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:06.739836 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:06.802879 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a999a6f-eaa3-4385-a480-3b994397acb2 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:06.806883 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe24c73-5e9f-4c7d-81a8-26cb8606e6ee None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:06.854261 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9ac30-62a3-4fa4-b48f-972ff3c4183a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:06.855022 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9ac30-62a3-4fa4-b48f-972ff3c4183a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:06.855356 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9ac30-62a3-4fa4-b48f-972ff3c4183a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:06.855896 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9ac30-62a3-4fa4-b48f-972ff3c4183a None admin] PATH_INFO: `/v3/groups/3b24026319df42e2b5c91f7a05f62b56` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:06.862694 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9ac30-62a3-4fa4-b48f-972ff3c4183a None admin] RBAC: Authorizing `identity:get_group(group_id=3b24026319df42e2b5c91f7a05f62b56)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:06.864060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c553618-5597-4946-81a5-bc5152f62321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:06.864654 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9ac30-62a3-4fa4-b48f-972ff3c4183a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:06.865121 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c553618-5597-4946-81a5-bc5152f62321 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:06.865495 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c553618-5597-4946-81a5-bc5152f62321 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:06.865865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c553618-5597-4946-81a5-bc5152f62321 None admin] PATH_INFO: `/v3/groups/3b24026319df42e2b5c91f7a05f62b56` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:06.867384 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 184/358] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Sep 26 05:30:06 2022] GET /identity/v3/groups/3b24026319df42e2b5c91f7a05f62b56 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:06.867884 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c553618-5597-4946-81a5-bc5152f62321 None admin] RBAC: Authorizing `identity:get_group(group_id=3b24026319df42e2b5c91f7a05f62b56)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:06.869083 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69700873-31e7-4c48-9bab-cd6ae2ce8330 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:06.869526 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69700873-31e7-4c48-9bab-cd6ae2ce8330 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:06.869827 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c553618-5597-4946-81a5-bc5152f62321 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:06.870088 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69700873-31e7-4c48-9bab-cd6ae2ce8330 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:06.871834 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 185/359] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:06.872810 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69700873-31e7-4c48-9bab-cd6ae2ce8330 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:06.875926 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 175/360] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Sep 26 05:30:06 2022] GET /identity/v3/groups/3b24026319df42e2b5c91f7a05f62b56 => generated 226 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:06.878075 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c553618-5597-4946-81a5-bc5152f62321 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:06.894023 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:07.006380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69700873-31e7-4c48-9bab-cd6ae2ce8330 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:07.014376 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c553618-5597-4946-81a5-bc5152f62321 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:07.056229 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40bff9-ce52-4a3f-87e1-98d8d002dbcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:07.056867 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40bff9-ce52-4a3f-87e1-98d8d002dbcb None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:07.057292 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40bff9-ce52-4a3f-87e1-98d8d002dbcb None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:07.057438 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40bff9-ce52-4a3f-87e1-98d8d002dbcb None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:07.058146 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40bff9-ce52-4a3f-87e1-98d8d002dbcb None admin] RBAC: Adding query filter params (name=member) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:07.058355 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40bff9-ce52-4a3f-87e1-98d8d002dbcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:07.062499 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964321c6-4ac0-4d4c-b6a0-997713801c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:07.063132 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964321c6-4ac0-4d4c-b6a0-997713801c8d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:07.063289 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f40bff9-ce52-4a3f-87e1-98d8d002dbcb None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:07.063415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964321c6-4ac0-4d4c-b6a0-997713801c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:07.063661 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964321c6-4ac0-4d4c-b6a0-997713801c8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:07.064471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964321c6-4ac0-4d4c-b6a0-997713801c8d None admin] RBAC: Adding query filter params (group.id=3b24026319df42e2b5c91f7a05f62b56, role.id=c5a02c4618d94f1da7257ef437b8ce9e, scope.project.id=f36f364f981e4cbb8bca50ac93a26b16) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:07.065033 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964321c6-4ac0-4d4c-b6a0-997713801c8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:07.066485 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964321c6-4ac0-4d4c-b6a0-997713801c8d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:07.069166 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:07.074806 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 176/361] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Sep 26 05:30:06 2022] GET /identity/v3/role_assignments?group.id=3b24026319df42e2b5c91f7a05f62b56&scope.project.id=f36f364f981e4cbb8bca50ac93a26b16&role.id=c5a02c4618d94f1da7257ef437b8ce9e => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:07.076437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639b3ff-3d77-4c3e-9a80-e55d0c32f77f None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:07.077751 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639b3ff-3d77-4c3e-9a80-e55d0c32f77f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:07.078372 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639b3ff-3d77-4c3e-9a80-e55d0c32f77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:07.080164 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 186/362] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 26 05:30:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:07.083827 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40bff9-ce52-4a3f-87e1-98d8d002dbcb None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:07.103199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-f639b3ff-3d77-4c3e-9a80-e55d0c32f77f None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:07.104776 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f639b3ff-3d77-4c3e-9a80-e55d0c32f77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:07.207534 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 177/363] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:30:07.208560 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639b3ff-3d77-4c3e-9a80-e55d0c32f77f None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:07.231821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:07.277619 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f40bff9-ce52-4a3f-87e1-98d8d002dbcb None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:07.345530 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd72bf1-7c7e-432a-be9e-47f14d6735e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:07.346330 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd72bf1-7c7e-432a-be9e-47f14d6735e2 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:07.346615 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd72bf1-7c7e-432a-be9e-47f14d6735e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:07.346883 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd72bf1-7c7e-432a-be9e-47f14d6735e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:07.348068 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd72bf1-7c7e-432a-be9e-47f14d6735e2 None admin] RBAC: Adding query filter params (group.id=3b24026319df42e2b5c91f7a05f62b56, role.id=7cb00fff13fb4eefa6a734c91c0d59ea, scope.project.id=f36f364f981e4cbb8bca50ac93a26b16) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:07.348377 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd72bf1-7c7e-432a-be9e-47f14d6735e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:07.350485 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd72bf1-7c7e-432a-be9e-47f14d6735e2 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:07.362627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 187/364] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Sep 26 05:30:07 2022] GET /identity/v3/role_assignments?group.id=3b24026319df42e2b5c91f7a05f62b56&scope.project.id=f36f364f981e4cbb8bca50ac93a26b16&role.id=7cb00fff13fb4eefa6a734c91c0d59ea => generated 260 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:07.363426 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd72bf1-7c7e-432a-be9e-47f14d6735e2 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:07.392420 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639b3ff-3d77-4c3e-9a80-e55d0c32f77f None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:07.453304 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:07.473397 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00514b03-5170-42ad-b47d-b5d879c45a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:07.474978 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00514b03-5170-42ad-b47d-b5d879c45a84 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:07.475708 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00514b03-5170-42ad-b47d-b5d879c45a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:07.478209 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00514b03-5170-42ad-b47d-b5d879c45a84 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:07.500624 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00514b03-5170-42ad-b47d-b5d879c45a84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:30:07.510789 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-00514b03-5170-42ad-b47d-b5d879c45a84 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:30:07.510789 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:07.510789 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:07.510789 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:07.510789 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:07.510789 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:07.510789 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:07.510789 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:07.510789 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:07.510789 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:07.510789 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:07.510789 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:07.510789 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:30:07.510789 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:30:07.510789 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:30:07.510789 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:30:07.512595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:30:07.512595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:30:07.512595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:30:07.512595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:30:07.512595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:07.512595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:07.512595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:07.512595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:07.512595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:07.512595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:07.512595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:07.512595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:07.512595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:07.512595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:07.512595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:07.512595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:07.514118 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:07.514118 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:07.514118 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:07.514118 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:07.514118 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:30:07.514118 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:30:07.514118 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:30:07.514118 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:30:07.514118 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:30:07.514118 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:30:07.514118 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:30:07.514118 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:07.516792 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd72bf1-7c7e-432a-be9e-47f14d6735e2 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:07.519002 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 178/365] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 26 05:30:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:07.528995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00514b03-5170-42ad-b47d-b5d879c45a84 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:07.579108 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a23fa-1a6e-423b-902e-f3d36e194740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:07.579811 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a23fa-1a6e-423b-902e-f3d36e194740 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:07.580099 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a23fa-1a6e-423b-902e-f3d36e194740 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:07.580368 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a23fa-1a6e-423b-902e-f3d36e194740 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:07.600517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:07.687808 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a23fa-1a6e-423b-902e-f3d36e194740 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:07.690201 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a23fa-1a6e-423b-902e-f3d36e194740 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:07.775061 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00514b03-5170-42ad-b47d-b5d879c45a84 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:07.841309 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a047a7-6c1d-4e0f-bb6a-ed4f53c36597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:07.842494 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a047a7-6c1d-4e0f-bb6a-ed4f53c36597 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:07.845006 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a047a7-6c1d-4e0f-bb6a-ed4f53c36597 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:07.845006 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a047a7-6c1d-4e0f-bb6a-ed4f53c36597 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:07.845733 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a047a7-6c1d-4e0f-bb6a-ed4f53c36597 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:07.846331 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a047a7-6c1d-4e0f-bb6a-ed4f53c36597 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:07.852599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a047a7-6c1d-4e0f-bb6a-ed4f53c36597 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:07.864322 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 179/366] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:30:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:07.865499 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a047a7-6c1d-4e0f-bb6a-ed4f53c36597 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:07.892322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 188/367] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:30:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:07.892322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a23fa-1a6e-423b-902e-f3d36e194740 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:07.937020 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:07.968892 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:08.003875 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a047a7-6c1d-4e0f-bb6a-ed4f53c36597 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:08.045801 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a23fa-1a6e-423b-902e-f3d36e194740 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:08.051711 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a8c7f-ee8a-4a8e-9018-321a371932eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:08.052526 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a8c7f-ee8a-4a8e-9018-321a371932eb None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:08.052875 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a8c7f-ee8a-4a8e-9018-321a371932eb None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:08.053213 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a8c7f-ee8a-4a8e-9018-321a371932eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:08.073097 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a8c7f-ee8a-4a8e-9018-321a371932eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:30:08.078980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-ea8a8c7f-ee8a-4a8e-9018-321a371932eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:30:08.078980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:08.078980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:08.078980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:08.078980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:08.078980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:08.078980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:08.078980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:08.078980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:08.078980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:08.078980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:08.078980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:08.078980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:30:08.078980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:30:08.078980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:30:08.078980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:30:08.080166 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:30:08.080166 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:30:08.080166 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:30:08.080166 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:30:08.080166 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:08.080166 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:08.080166 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:08.080166 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:08.080166 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:08.080166 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:08.080166 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:08.080166 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:08.080166 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:08.080166 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:08.080166 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:08.080166 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:08.081624 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:08.081624 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:08.081624 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:08.081624 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:08.081624 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:30:08.081624 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:30:08.081624 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:30:08.081624 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:30:08.081624 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:30:08.081624 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:30:08.081624 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:30:08.081624 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:08.081624 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 180/368] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:30:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:08.081624 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a8c7f-ee8a-4a8e-9018-321a371932eb None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:08.113211 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bad1f8-a999-4d44-a54e-088156f20eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:08.114249 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bad1f8-a999-4d44-a54e-088156f20eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:08.114781 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bad1f8-a999-4d44-a54e-088156f20eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:08.116026 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bad1f8-a999-4d44-a54e-088156f20eb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:08.206389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bad1f8-a999-4d44-a54e-088156f20eb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:08.207953 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bad1f8-a999-4d44-a54e-088156f20eb3 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:08.233336 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a8c7f-ee8a-4a8e-9018-321a371932eb None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:08.249993 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:08.276458 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:08.282099 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea07f51-779c-4269-a12f-1df574034a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:08.283078 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea07f51-779c-4269-a12f-1df574034a62 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:08.283798 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea07f51-779c-4269-a12f-1df574034a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:08.284269 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea07f51-779c-4269-a12f-1df574034a62 None admin] PATH_INFO: `/v3/projects/61304b31bc674654a80d1255b6e98ad3` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:08.286159 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea07f51-779c-4269-a12f-1df574034a62 None admin] RBAC: Authorizing `identity:get_project(project_id=61304b31bc674654a80d1255b6e98ad3)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:08.288198 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea07f51-779c-4269-a12f-1df574034a62 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:08.290538 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 181/369] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:30:08 2022] GET /identity/v3/projects/61304b31bc674654a80d1255b6e98ad3 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:08.291843 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea07f51-779c-4269-a12f-1df574034a62 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:08.373292 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 189/370] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:30:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:08.375136 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bad1f8-a999-4d44-a54e-088156f20eb3 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:08.469151 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea07f51-779c-4269-a12f-1df574034a62 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:08.542797 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0491e4f-42ef-4d18-99fd-307295416efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:08.544080 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0491e4f-42ef-4d18-99fd-307295416efe None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:08.544544 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0491e4f-42ef-4d18-99fd-307295416efe None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:08.545128 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0491e4f-42ef-4d18-99fd-307295416efe None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:08.546983 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0491e4f-42ef-4d18-99fd-307295416efe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:08.549347 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0491e4f-42ef-4d18-99fd-307295416efe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:08.552312 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0491e4f-42ef-4d18-99fd-307295416efe None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:08.571540 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 182/371] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:30:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:08.573310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0491e4f-42ef-4d18-99fd-307295416efe None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:08.582558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bad1f8-a999-4d44-a54e-088156f20eb3 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:08.646159 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:08.669083 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d152e0-00d2-41b0-aef5-8c7aacef1a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:08.670357 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d152e0-00d2-41b0-aef5-8c7aacef1a63 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:08.670670 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d152e0-00d2-41b0-aef5-8c7aacef1a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:08.671104 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d152e0-00d2-41b0-aef5-8c7aacef1a63 None admin] PATH_INFO: `/v3/groups/3b24026319df42e2b5c91f7a05f62b56` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:08.673110 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d152e0-00d2-41b0-aef5-8c7aacef1a63 None admin] RBAC: Authorizing `identity:get_group(group_id=3b24026319df42e2b5c91f7a05f62b56)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:08.676310 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d152e0-00d2-41b0-aef5-8c7aacef1a63 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:08.680977 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 190/372] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Sep 26 05:30:08 2022] GET /identity/v3/groups/3b24026319df42e2b5c91f7a05f62b56 => generated 226 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:08.682719 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d152e0-00d2-41b0-aef5-8c7aacef1a63 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:08.703399 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:08.760798 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0491e4f-42ef-4d18-99fd-307295416efe None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:08.828115 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca652526-74a4-49ff-9f70-6172448d3131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:08.829792 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca652526-74a4-49ff-9f70-6172448d3131 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:08.830412 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca652526-74a4-49ff-9f70-6172448d3131 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:08.831036 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca652526-74a4-49ff-9f70-6172448d3131 None admin] PATH_INFO: `/v3/projects/61304b31bc674654a80d1255b6e98ad3` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:08.837010 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca652526-74a4-49ff-9f70-6172448d3131 None admin] RBAC: Authorizing `identity:get_project(project_id=61304b31bc674654a80d1255b6e98ad3)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:08.839979 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca652526-74a4-49ff-9f70-6172448d3131 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:08.840153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d152e0-00d2-41b0-aef5-8c7aacef1a63 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:08.844062 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 183/373] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:30:08 2022] GET /identity/v3/projects/61304b31bc674654a80d1255b6e98ad3 => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:08.845937 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca652526-74a4-49ff-9f70-6172448d3131 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:08.896351 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8ab64-39cf-42d4-bf90-fa2e0a9545e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:08.897394 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8ab64-39cf-42d4-bf90-fa2e0a9545e1 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:08.897923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8ab64-39cf-42d4-bf90-fa2e0a9545e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:08.898387 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8ab64-39cf-42d4-bf90-fa2e0a9545e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:08.974711 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca652526-74a4-49ff-9f70-6172448d3131 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:08.985626 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:09.012652 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8ab64-39cf-42d4-bf90-fa2e0a9545e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:09.014469 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8ab64-39cf-42d4-bf90-fa2e0a9545e1 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:09.015108 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad51001-15fc-4125-96e1-3370476b9366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:09.016129 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad51001-15fc-4125-96e1-3370476b9366 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:09.016603 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad51001-15fc-4125-96e1-3370476b9366 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:09.017074 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad51001-15fc-4125-96e1-3370476b9366 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:09.018115 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad51001-15fc-4125-96e1-3370476b9366 None admin] RBAC: Adding query filter params (group.id=3b24026319df42e2b5c91f7a05f62b56, role.id=c5a02c4618d94f1da7257ef437b8ce9e, scope.project.id=61304b31bc674654a80d1255b6e98ad3) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:09.018619 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad51001-15fc-4125-96e1-3370476b9366 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:09.020423 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad51001-15fc-4125-96e1-3370476b9366 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:09.027275 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 184/374] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Sep 26 05:30:08 2022] GET /identity/v3/role_assignments?group.id=3b24026319df42e2b5c91f7a05f62b56&scope.project.id=61304b31bc674654a80d1255b6e98ad3&role.id=c5a02c4618d94f1da7257ef437b8ce9e => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:09.028502 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad51001-15fc-4125-96e1-3370476b9366 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:09.039988 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:09.149493 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad51001-15fc-4125-96e1-3370476b9366 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:09.156276 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 191/375] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:30:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:09.162711 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8ab64-39cf-42d4-bf90-fa2e0a9545e1 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:09.191062 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63714b-a9be-4b8d-bb9c-36e8e3c7f1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:09.192926 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63714b-a9be-4b8d-bb9c-36e8e3c7f1c2 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:09.193829 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63714b-a9be-4b8d-bb9c-36e8e3c7f1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:09.194649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63714b-a9be-4b8d-bb9c-36e8e3c7f1c2 None admin] PATH_INFO: `/v3/groups/3b24026319df42e2b5c91f7a05f62b56` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:09.197799 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63714b-a9be-4b8d-bb9c-36e8e3c7f1c2 None admin] RBAC: Authorizing `identity:get_group(group_id=3b24026319df42e2b5c91f7a05f62b56)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:09.200133 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63714b-a9be-4b8d-bb9c-36e8e3c7f1c2 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:09.202686 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 185/376] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Sep 26 05:30:09 2022] GET /identity/v3/groups/3b24026319df42e2b5c91f7a05f62b56 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:09.211198 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63714b-a9be-4b8d-bb9c-36e8e3c7f1c2 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:09.311170 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:09.384273 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8ab64-39cf-42d4-bf90-fa2e0a9545e1 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:09.385603 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63714b-a9be-4b8d-bb9c-36e8e3c7f1c2 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:09.397153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:09.425961 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b800a8-9925-45c8-899e-e567c0f01e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:09.426625 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b800a8-9925-45c8-899e-e567c0f01e54 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:09.427230 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b800a8-9925-45c8-899e-e567c0f01e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:09.427230 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b800a8-9925-45c8-899e-e567c0f01e54 None admin] PATH_INFO: `/v3/projects/2c94348459484274ba0198cbad0a8ffb` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:09.428474 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b800a8-9925-45c8-899e-e567c0f01e54 None admin] RBAC: Authorizing `identity:get_project(project_id=2c94348459484274ba0198cbad0a8ffb)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:09.430018 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b800a8-9925-45c8-899e-e567c0f01e54 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:09.432061 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 192/377] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:30:09 2022] GET /identity/v3/projects/2c94348459484274ba0198cbad0a8ffb => generated 344 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:30:09.432909 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef67ad-8c74-4472-9c7a-4a1ef88045d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:09.433758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef67ad-8c74-4472-9c7a-4a1ef88045d4 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:09.434222 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef67ad-8c74-4472-9c7a-4a1ef88045d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:09.434677 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ef67ad-8c74-4472-9c7a-4a1ef88045d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:09.435684 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef67ad-8c74-4472-9c7a-4a1ef88045d4 None admin] RBAC: Adding query filter params (group.id=3b24026319df42e2b5c91f7a05f62b56, role.id=7cb00fff13fb4eefa6a734c91c0d59ea, scope.project.id=61304b31bc674654a80d1255b6e98ad3) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:09.436423 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef67ad-8c74-4472-9c7a-4a1ef88045d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:09.437550 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b800a8-9925-45c8-899e-e567c0f01e54 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:09.437664 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ef67ad-8c74-4472-9c7a-4a1ef88045d4 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:09.444793 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 186/378] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Sep 26 05:30:09 2022] GET /identity/v3/role_assignments?group.id=3b24026319df42e2b5c91f7a05f62b56&scope.project.id=61304b31bc674654a80d1255b6e98ad3&role.id=7cb00fff13fb4eefa6a734c91c0d59ea => generated 260 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:30:09.609826 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b800a8-9925-45c8-899e-e567c0f01e54 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:09.659025 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc4c35-274c-4c78-98cc-bc04d1039b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:09.659694 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc4c35-274c-4c78-98cc-bc04d1039b54 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:09.660004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc4c35-274c-4c78-98cc-bc04d1039b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:09.660267 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc4c35-274c-4c78-98cc-bc04d1039b54 None admin] PATH_INFO: `/v3/groups/45485a42ec484ca59c5dc2c94fd48ac3` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:09.668984 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc4c35-274c-4c78-98cc-bc04d1039b54 None admin] RBAC: Authorizing `identity:get_group(group_id=45485a42ec484ca59c5dc2c94fd48ac3)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:09.671894 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc4c35-274c-4c78-98cc-bc04d1039b54 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:09.679772 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 193/379] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Sep 26 05:30:09 2022] GET /identity/v3/groups/45485a42ec484ca59c5dc2c94fd48ac3 => generated 229 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:09.685732 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef67ad-8c74-4472-9c7a-4a1ef88045d4 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:09.838510 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ef67ad-8c74-4472-9c7a-4a1ef88045d4 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:09.841698 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:09.885611 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfa9fe-987d-4c3e-aa43-22d05f2d0324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:09.886659 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfa9fe-987d-4c3e-aa43-22d05f2d0324 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:09.887144 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfa9fe-987d-4c3e-aa43-22d05f2d0324 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:09.887648 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfa9fe-987d-4c3e-aa43-22d05f2d0324 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:09.888672 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bfa9fe-987d-4c3e-aa43-22d05f2d0324 None admin] RBAC: Adding query filter params (group.id=45485a42ec484ca59c5dc2c94fd48ac3, role.id=cf58d66369044fb09fa65a4366dc7446, scope.project.id=2c94348459484274ba0198cbad0a8ffb) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:09.889204 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bfa9fe-987d-4c3e-aa43-22d05f2d0324 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:09.890938 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bfa9fe-987d-4c3e-aa43-22d05f2d0324 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:09.900455 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 187/380] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Sep 26 05:30:09 2022] GET /identity/v3/role_assignments?group.id=45485a42ec484ca59c5dc2c94fd48ac3&scope.project.id=2c94348459484274ba0198cbad0a8ffb&role.id=cf58d66369044fb09fa65a4366dc7446 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:10.015563 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72e389-d3f4-4313-9ed8-56089e17ae7b None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:10.016271 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72e389-d3f4-4313-9ed8-56089e17ae7b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:10.016743 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d72e389-d3f4-4313-9ed8-56089e17ae7b None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:10.018781 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 194/381] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:10.024573 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caff412-f302-4a4b-8174-b1f6991733c7 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:10.025214 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caff412-f302-4a4b-8174-b1f6991733c7 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:10.025692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caff412-f302-4a4b-8174-b1f6991733c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:10.049770 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-0caff412-f302-4a4b-8174-b1f6991733c7 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:10.051348 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0caff412-f302-4a4b-8174-b1f6991733c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:10.140702 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 188/382] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:30:10.325659 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb7168-2b2b-4ec5-93a5-6d72df551894 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:10.326281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb7168-2b2b-4ec5-93a5-6d72df551894 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:10.326778 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb7168-2b2b-4ec5-93a5-6d72df551894 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:10.328880 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 195/383] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:10.335371 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc525d56-285a-4ecc-962e-06a013548724 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:10.336104 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc525d56-285a-4ecc-962e-06a013548724 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:10.336585 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc525d56-285a-4ecc-962e-06a013548724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:10.357769 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-bc525d56-285a-4ecc-962e-06a013548724 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:10.359340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-bc525d56-285a-4ecc-962e-06a013548724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:10.451059 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 189/384] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:30:10.478049 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb7168-2b2b-4ec5-93a5-6d72df551894 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:10.532167 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:10.606939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb7168-2b2b-4ec5-93a5-6d72df551894 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:10.655032 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e9079-2d88-432a-bf32-ec23176e9137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:10.655698 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e9079-2d88-432a-bf32-ec23176e9137 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:10.656041 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e9079-2d88-432a-bf32-ec23176e9137 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:10.656310 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e9079-2d88-432a-bf32-ec23176e9137 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:10.678014 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e9079-2d88-432a-bf32-ec23176e9137 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:30:10.683238 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-f59e9079-2d88-432a-bf32-ec23176e9137 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:30:10.683238 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:10.683238 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:10.683238 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:10.683238 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:10.683238 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:10.683238 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:10.683238 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:10.683238 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:10.683238 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:10.683238 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:10.683238 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:10.683238 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:30:10.683238 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:30:10.683238 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:30:10.683238 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:30:10.684251 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:30:10.684251 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:30:10.684251 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:30:10.684251 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:30:10.684251 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:10.684251 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:10.684251 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:10.684251 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:10.684251 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:10.684251 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:10.684251 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:10.684251 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:10.684251 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:10.684251 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:10.684251 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:10.684251 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:10.685064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:10.685064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:10.685064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:10.685064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:10.685064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:30:10.685064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:30:10.685064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:30:10.685064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:30:10.685064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:30:10.685064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:30:10.685064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:30:10.685064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:10.685064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 196/385] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:30:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:10.692701 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc525d56-285a-4ecc-962e-06a013548724 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:10.741776 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:10.795710 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e9079-2d88-432a-bf32-ec23176e9137 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:10.880621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc525d56-285a-4ecc-962e-06a013548724 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:10.951924 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e9079-2d88-432a-bf32-ec23176e9137 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:10.954585 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:10.974109 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8380bc-1932-4e20-9e00-416e9662dc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:10.975185 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8380bc-1932-4e20-9e00-416e9662dc3d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:10.975673 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8380bc-1932-4e20-9e00-416e9662dc3d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:10.976241 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8380bc-1932-4e20-9e00-416e9662dc3d None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:10.977484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8380bc-1932-4e20-9e00-416e9662dc3d None admin] RBAC: Adding query filter params (name=member) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:10.978024 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8380bc-1932-4e20-9e00-416e9662dc3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:10.980601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8380bc-1932-4e20-9e00-416e9662dc3d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:10.998116 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf03e29-2404-4007-8943-c1d3aecf72e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:10.998837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf03e29-2404-4007-8943-c1d3aecf72e7 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:10.999113 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf03e29-2404-4007-8943-c1d3aecf72e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:10.999380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf03e29-2404-4007-8943-c1d3aecf72e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:11.004750 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 190/386] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 26 05:30:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:30:11.012103 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf03e29-2404-4007-8943-c1d3aecf72e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:30:11.014969 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8380bc-1932-4e20-9e00-416e9662dc3d None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:11.017414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-3bf03e29-2404-4007-8943-c1d3aecf72e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:30:11.017414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:11.017414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:11.017414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:11.017414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:11.017414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:11.017414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:11.017414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:11.017414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:11.017414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:11.017414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:11.017414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:11.017414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:30:11.017414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:30:11.017414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:30:11.017414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:30:11.019428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:30:11.019428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:30:11.019428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:30:11.019428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:30:11.019428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:11.019428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:11.019428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:11.019428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:11.019428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:11.019428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:11.019428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:11.019428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:11.019428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:11.019428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:11.019428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:11.019428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:11.022932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:11.022932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:11.022932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:11.022932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:11.022932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:30:11.022932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:30:11.022932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:30:11.022932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:30:11.022932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:30:11.022932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:30:11.022932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:30:11.022932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:11.022932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 197/387] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 26 05:30:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:30:11.028859 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf03e29-2404-4007-8943-c1d3aecf72e7 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:11.149019 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf03e29-2404-4007-8943-c1d3aecf72e7 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:11.189728 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a585bcf-1183-4db1-965e-74ea13354647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:11.191065 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a585bcf-1183-4db1-965e-74ea13354647 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:11.191345 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a585bcf-1183-4db1-965e-74ea13354647 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:11.191619 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a585bcf-1183-4db1-965e-74ea13354647 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:11.192507 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a585bcf-1183-4db1-965e-74ea13354647 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:11.192998 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a585bcf-1183-4db1-965e-74ea13354647 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:11.194570 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a585bcf-1183-4db1-965e-74ea13354647 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:11.206115 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 198/388] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:30:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:30:11.213033 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a585bcf-1183-4db1-965e-74ea13354647 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:11.245847 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:11.341756 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a585bcf-1183-4db1-965e-74ea13354647 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:11.360122 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:11.382337 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1d272-9ef3-4af5-99b9-4e0a9b63d92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:11.383146 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1d272-9ef3-4af5-99b9-4e0a9b63d92c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:11.383426 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1d272-9ef3-4af5-99b9-4e0a9b63d92c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:11.383699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1d272-9ef3-4af5-99b9-4e0a9b63d92c None admin] PATH_INFO: `/v3/groups/3b24026319df42e2b5c91f7a05f62b56` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:11.384925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb1d272-9ef3-4af5-99b9-4e0a9b63d92c None admin] RBAC: Authorizing `identity:get_group(group_id=3b24026319df42e2b5c91f7a05f62b56)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:11.386476 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb1d272-9ef3-4af5-99b9-4e0a9b63d92c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:11.388682 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 199/389] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Sep 26 05:30:11 2022] GET /identity/v3/groups/3b24026319df42e2b5c91f7a05f62b56 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:11.394571 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1d272-9ef3-4af5-99b9-4e0a9b63d92c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:11.403502 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8380bc-1932-4e20-9e00-416e9662dc3d None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:11.502251 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:11.513279 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1d272-9ef3-4af5-99b9-4e0a9b63d92c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:11.533630 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a325c1-7697-442a-ad41-75725cf6e663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:11.534721 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a325c1-7697-442a-ad41-75725cf6e663 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:11.535190 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a325c1-7697-442a-ad41-75725cf6e663 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:11.535676 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a325c1-7697-442a-ad41-75725cf6e663 None admin] PATH_INFO: `/v3/groups/3b24026319df42e2b5c91f7a05f62b56` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:11.537479 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a325c1-7697-442a-ad41-75725cf6e663 None admin] RBAC: Authorizing `identity:get_group(group_id=3b24026319df42e2b5c91f7a05f62b56)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:11.540338 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a325c1-7697-442a-ad41-75725cf6e663 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:11.547367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 191/390] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Sep 26 05:30:11 2022] GET /identity/v3/groups/3b24026319df42e2b5c91f7a05f62b56 => generated 226 bytes in 531 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:11.550712 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b14632-9536-4fc5-8c4b-2022fdeebb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:11.551510 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b14632-9536-4fc5-8c4b-2022fdeebb32 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:11.551903 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b14632-9536-4fc5-8c4b-2022fdeebb32 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:11.552271 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b14632-9536-4fc5-8c4b-2022fdeebb32 None admin] PATH_INFO: `/v3/projects/f36f364f981e4cbb8bca50ac93a26b16` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:11.553367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a325c1-7697-442a-ad41-75725cf6e663 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:11.553658 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b14632-9536-4fc5-8c4b-2022fdeebb32 None admin] RBAC: Authorizing `identity:get_project(project_id=f36f364f981e4cbb8bca50ac93a26b16)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:11.555524 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b14632-9536-4fc5-8c4b-2022fdeebb32 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:11.562317 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 200/391] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:30:11 2022] GET /identity/v3/projects/f36f364f981e4cbb8bca50ac93a26b16 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:30:11.564851 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b14632-9536-4fc5-8c4b-2022fdeebb32 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:11.677077 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b14632-9536-4fc5-8c4b-2022fdeebb32 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:11.719373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec0aa7-8f83-495a-a910-0c81ac3e8ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:11.720346 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec0aa7-8f83-495a-a910-0c81ac3e8ffd None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:11.720694 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec0aa7-8f83-495a-a910-0c81ac3e8ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:11.721031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec0aa7-8f83-495a-a910-0c81ac3e8ffd None admin] PATH_INFO: `/v3/projects/f36f364f981e4cbb8bca50ac93a26b16/groups/3b24026319df42e2b5c91f7a05f62b56/roles/7cb00fff13fb4eefa6a734c91c0d59ea` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:11.723415 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec0aa7-8f83-495a-a910-0c81ac3e8ffd None admin] RBAC: Authorizing `identity:create_grant(project_id=f36f364f981e4cbb8bca50ac93a26b16, group_id=3b24026319df42e2b5c91f7a05f62b56, role_id=7cb00fff13fb4eefa6a734c91c0d59ea)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:11.725007 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec0aa7-8f83-495a-a910-0c81ac3e8ffd None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:11.750451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 201/392] 10.222.0.66 () {58 vars in 1442 bytes} [Mon Sep 26 05:30:11 2022] PUT /identity/v3/projects/f36f364f981e4cbb8bca50ac93a26b16/groups/3b24026319df42e2b5c91f7a05f62b56/roles/7cb00fff13fb4eefa6a734c91c0d59ea => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:30:11.917584 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a325c1-7697-442a-ad41-75725cf6e663 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:11.973927 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d305b4-db33-4046-950d-681813a7fe33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:11.975381 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d305b4-db33-4046-950d-681813a7fe33 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:11.976184 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d305b4-db33-4046-950d-681813a7fe33 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:11.976856 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d305b4-db33-4046-950d-681813a7fe33 None admin] PATH_INFO: `/v3/projects/f36f364f981e4cbb8bca50ac93a26b16` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:11.979240 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d305b4-db33-4046-950d-681813a7fe33 None admin] RBAC: Authorizing `identity:get_project(project_id=f36f364f981e4cbb8bca50ac93a26b16)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:11.982501 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d305b4-db33-4046-950d-681813a7fe33 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:11.986383 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 192/393] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:30:11 2022] GET /identity/v3/projects/f36f364f981e4cbb8bca50ac93a26b16 => generated 298 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:11.995773 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec0aa7-8f83-495a-a910-0c81ac3e8ffd None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:12.033165 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:12.119009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec0aa7-8f83-495a-a910-0c81ac3e8ffd None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:12.156333 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f8eba-7a98-4202-8808-4b1a8d61e56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:12.157024 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f8eba-7a98-4202-8808-4b1a8d61e56b None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:12.157301 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f8eba-7a98-4202-8808-4b1a8d61e56b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:12.157571 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f8eba-7a98-4202-8808-4b1a8d61e56b None admin] PATH_INFO: `/v3/projects/f36f364f981e4cbb8bca50ac93a26b16/groups/3b24026319df42e2b5c91f7a05f62b56/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:12.159547 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f8eba-7a98-4202-8808-4b1a8d61e56b None admin] RBAC: Authorizing `identity:create_grant(project_id=f36f364f981e4cbb8bca50ac93a26b16, group_id=3b24026319df42e2b5c91f7a05f62b56, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:12.161086 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f8eba-7a98-4202-8808-4b1a8d61e56b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:12.182879 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 202/394] 10.222.0.66 () {58 vars in 1442 bytes} [Mon Sep 26 05:30:11 2022] PUT /identity/v3/projects/f36f364f981e4cbb8bca50ac93a26b16/groups/3b24026319df42e2b5c91f7a05f62b56/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:30:12.320575 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1130d-3c74-4ea4-bab3-9c11e93605d9 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:12.320905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1130d-3c74-4ea4-bab3-9c11e93605d9 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:12.321256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1130d-3c74-4ea4-bab3-9c11e93605d9 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:12.323217 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 193/395] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:12.329170 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5745371-d771-4ab3-9158-6ab04280ae23 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:12.329506 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5745371-d771-4ab3-9158-6ab04280ae23 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:12.329719 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5745371-d771-4ab3-9158-6ab04280ae23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:12.350351 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-a5745371-d771-4ab3-9158-6ab04280ae23 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:12.351645 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a5745371-d771-4ab3-9158-6ab04280ae23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:12.385342 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76eed0-ffad-4edf-8ea1-39556e523a55 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:12.386137 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76eed0-ffad-4edf-8ea1-39556e523a55 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:12.386649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76eed0-ffad-4edf-8ea1-39556e523a55 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:12.390448 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 194/396] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:12.395964 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e6736-2e94-4ca5-9247-f770aa197f90 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:12.396781 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e6736-2e94-4ca5-9247-f770aa197f90 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:12.397449 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e6736-2e94-4ca5-9247-f770aa197f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:12.419425 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-392e6736-2e94-4ca5-9247-f770aa197f90 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:12.421837 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-392e6736-2e94-4ca5-9247-f770aa197f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:12.447596 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 203/397] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:30:12.476194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:12.583978 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 195/398] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:30:12.746771 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5745371-d771-4ab3-9158-6ab04280ae23 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:12.769596 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:12.981282 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5745371-d771-4ab3-9158-6ab04280ae23 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:13.032188 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e88b6-c1aa-41a7-89a5-5e0efbfd74d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:13.032943 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e88b6-c1aa-41a7-89a5-5e0efbfd74d4 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:13.033215 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e88b6-c1aa-41a7-89a5-5e0efbfd74d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:13.033480 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e88b6-c1aa-41a7-89a5-5e0efbfd74d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:13.055195 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e88b6-c1aa-41a7-89a5-5e0efbfd74d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:30:13.060178 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-203e88b6-c1aa-41a7-89a5-5e0efbfd74d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:30:13.060178 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:13.060178 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:13.060178 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:13.060178 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:13.060178 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:13.060178 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:13.060178 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:13.060178 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:13.060178 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:13.060178 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:13.060178 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:13.060178 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:30:13.060178 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:30:13.060178 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:30:13.060178 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:30:13.062814 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:30:13.062814 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:30:13.062814 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:30:13.062814 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:30:13.062814 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:13.062814 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:13.062814 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:13.062814 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:13.062814 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:13.062814 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:13.062814 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:13.062814 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:13.062814 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:13.062814 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:13.062814 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:13.062814 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:13.063620 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:13.063620 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:13.063620 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:13.063620 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:13.063620 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:30:13.063620 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:30:13.063620 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:30:13.063620 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:30:13.063620 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:30:13.063620 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:30:13.063620 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:30:13.063620 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:13.063620 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 204/399] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:30:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:13.069484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e6736-2e94-4ca5-9247-f770aa197f90 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:13.173278 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb1bb4-e9a4-46e0-b1ea-122d6afd30bb None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:13.173686 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb1bb4-e9a4-46e0-b1ea-122d6afd30bb None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:13.174084 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eb1bb4-e9a4-46e0-b1ea-122d6afd30bb None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:13.177832 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 205/400] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:30:13.184914 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37ce41-f0e7-48dc-95d1-7c67067c0ee1 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:13.185764 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37ce41-f0e7-48dc-95d1-7c67067c0ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:13.186286 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37ce41-f0e7-48dc-95d1-7c67067c0ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:13.211982 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e6736-2e94-4ca5-9247-f770aa197f90 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:13.212273 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-5c37ce41-f0e7-48dc-95d1-7c67067c0ee1 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:13.213816 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5c37ce41-f0e7-48dc-95d1-7c67067c0ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:13.254413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af2d48a-4890-42f7-bcbb-83fca5741c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:13.255381 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2d48a-4890-42f7-bcbb-83fca5741c6e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:13.255897 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2d48a-4890-42f7-bcbb-83fca5741c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:13.256441 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2d48a-4890-42f7-bcbb-83fca5741c6e None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:13.257529 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af2d48a-4890-42f7-bcbb-83fca5741c6e None admin] RBAC: Adding query filter params (name=member) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:13.258077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af2d48a-4890-42f7-bcbb-83fca5741c6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:13.259697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af2d48a-4890-42f7-bcbb-83fca5741c6e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:13.269924 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 196/401] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 26 05:30:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:13.271108 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af2d48a-4890-42f7-bcbb-83fca5741c6e None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:13.294413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:13.298280 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:13.311779 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 206/402] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:30:13.311779 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37ce41-f0e7-48dc-95d1-7c67067c0ee1 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:13.430678 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37ce41-f0e7-48dc-95d1-7c67067c0ee1 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:13.472716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c99239-28a2-4ef3-a9c9-a7af5a92a787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:13.474061 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c99239-28a2-4ef3-a9c9-a7af5a92a787 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:13.474764 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c99239-28a2-4ef3-a9c9-a7af5a92a787 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:13.475358 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c99239-28a2-4ef3-a9c9-a7af5a92a787 None admin] PATH_INFO: `/v3/groups/3b24026319df42e2b5c91f7a05f62b56` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:13.477700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c99239-28a2-4ef3-a9c9-a7af5a92a787 None admin] RBAC: Authorizing `identity:get_group(group_id=3b24026319df42e2b5c91f7a05f62b56)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:13.480438 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c99239-28a2-4ef3-a9c9-a7af5a92a787 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:13.482915 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af2d48a-4890-42f7-bcbb-83fca5741c6e None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:13.483635 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 207/403] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Sep 26 05:30:13 2022] GET /identity/v3/groups/3b24026319df42e2b5c91f7a05f62b56 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:13.513398 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c99239-28a2-4ef3-a9c9-a7af5a92a787 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:13.558849 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45003015-82a4-43bb-b72e-9825348dad42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:13.559512 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45003015-82a4-43bb-b72e-9825348dad42 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:13.559807 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45003015-82a4-43bb-b72e-9825348dad42 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:13.560081 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45003015-82a4-43bb-b72e-9825348dad42 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:13.580396 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45003015-82a4-43bb-b72e-9825348dad42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:30:13.585958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-45003015-82a4-43bb-b72e-9825348dad42 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:30:13.585958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:13.585958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:13.585958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:13.585958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:13.585958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:13.585958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:13.585958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:13.585958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:13.585958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:13.585958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:13.585958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:13.585958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:30:13.585958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:30:13.585958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:30:13.585958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:30:13.586946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:30:13.586946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:30:13.586946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:30:13.586946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:30:13.586946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:13.586946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:13.586946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:13.586946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:13.586946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:13.586946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:13.586946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:13.586946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:13.586946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:13.586946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:13.586946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:13.586946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:13.587774 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:13.587774 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:13.587774 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:13.587774 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:13.587774 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:30:13.587774 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:30:13.587774 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:30:13.587774 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:30:13.587774 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:30:13.587774 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:30:13.587774 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:30:13.587774 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:13.588517 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 197/404] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 26 05:30:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:13.598668 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45003015-82a4-43bb-b72e-9825348dad42 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:13.672156 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:13.693645 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:13.715865 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c99239-28a2-4ef3-a9c9-a7af5a92a787 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:13.725647 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45003015-82a4-43bb-b72e-9825348dad42 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:13.752889 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4f9bb-bce3-4787-92f4-5fe8ffa66895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:13.753538 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4f9bb-bce3-4787-92f4-5fe8ffa66895 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:13.753815 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4f9bb-bce3-4787-92f4-5fe8ffa66895 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:13.754083 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4f9bb-bce3-4787-92f4-5fe8ffa66895 None admin] PATH_INFO: `/v3/projects/61304b31bc674654a80d1255b6e98ad3` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:13.755298 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4f9bb-bce3-4787-92f4-5fe8ffa66895 None admin] RBAC: Authorizing `identity:get_project(project_id=61304b31bc674654a80d1255b6e98ad3)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:13.756863 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4f9bb-bce3-4787-92f4-5fe8ffa66895 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:13.763588 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 208/405] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:30:13 2022] GET /identity/v3/projects/61304b31bc674654a80d1255b6e98ad3 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:13.763588 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4f9bb-bce3-4787-92f4-5fe8ffa66895 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:13.774354 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76505a-910f-43ae-b7b0-2812ea04297d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:13.775381 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76505a-910f-43ae-b7b0-2812ea04297d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:13.775861 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76505a-910f-43ae-b7b0-2812ea04297d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:13.776308 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76505a-910f-43ae-b7b0-2812ea04297d None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:13.777157 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76505a-910f-43ae-b7b0-2812ea04297d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:13.777603 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76505a-910f-43ae-b7b0-2812ea04297d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:13.779375 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f76505a-910f-43ae-b7b0-2812ea04297d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:13.794224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 198/406] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:30:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:13.795523 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76505a-910f-43ae-b7b0-2812ea04297d None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:13.877459 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4f9bb-bce3-4787-92f4-5fe8ffa66895 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:13.916374 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20105e98-a339-4347-9a62-d6994e873817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:13.917216 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20105e98-a339-4347-9a62-d6994e873817 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:13.917335 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20105e98-a339-4347-9a62-d6994e873817 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:13.917544 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20105e98-a339-4347-9a62-d6994e873817 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:13.920725 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:13.921892 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76505a-910f-43ae-b7b0-2812ea04297d None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:13.931188 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20105e98-a339-4347-9a62-d6994e873817 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:30:13.936275 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-20105e98-a339-4347-9a62-d6994e873817 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:30:13.936275 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:13.936275 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:13.936275 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:13.936275 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:13.936275 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:13.936275 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:13.936275 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:13.936275 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:13.936275 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:13.936275 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:13.936275 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:13.936275 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:30:13.936275 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:30:13.936275 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:30:13.936275 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:30:13.937477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:30:13.937477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:30:13.937477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:30:13.937477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:30:13.937477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:13.937477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:13.937477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:13.937477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:13.937477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:13.937477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:13.937477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:13.937477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:13.937477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:13.937477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:13.937477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:13.937477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:13.938478 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:13.938478 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:13.938478 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:13.938478 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:13.938478 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:30:13.938478 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:30:13.938478 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:30:13.938478 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:30:13.938478 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:30:13.938478 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:30:13.938478 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:30:13.938478 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:13.938478 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 209/407] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:30:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:13.938478 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20105e98-a339-4347-9a62-d6994e873817 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:13.973827 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603749ad-e8f1-4ee2-b2b8-5186ad20c4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:13.974846 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603749ad-e8f1-4ee2-b2b8-5186ad20c4ff None admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:13.975305 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603749ad-e8f1-4ee2-b2b8-5186ad20c4ff None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:13.975721 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603749ad-e8f1-4ee2-b2b8-5186ad20c4ff None admin] PATH_INFO: `/v3/projects/61304b31bc674654a80d1255b6e98ad3/groups/3b24026319df42e2b5c91f7a05f62b56/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:13.978183 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603749ad-e8f1-4ee2-b2b8-5186ad20c4ff None admin] RBAC: Authorizing `identity:create_grant(project_id=61304b31bc674654a80d1255b6e98ad3, group_id=3b24026319df42e2b5c91f7a05f62b56, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:13.980002 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603749ad-e8f1-4ee2-b2b8-5186ad20c4ff None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:13.991931 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:13.999881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 199/408] 10.222.0.66 () {58 vars in 1442 bytes} [Mon Sep 26 05:30:13 2022] PUT /identity/v3/projects/61304b31bc674654a80d1255b6e98ad3/groups/3b24026319df42e2b5c91f7a05f62b56/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:14.001202 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603749ad-e8f1-4ee2-b2b8-5186ad20c4ff None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:14.081533 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20105e98-a339-4347-9a62-d6994e873817 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:14.121988 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603749ad-e8f1-4ee2-b2b8-5186ad20c4ff None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:14.122555 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86649dda-4a9e-4fa6-85b1-2136a8466bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:14.122690 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86649dda-4a9e-4fa6-85b1-2136a8466bec None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:14.122959 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86649dda-4a9e-4fa6-85b1-2136a8466bec None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:14.123230 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86649dda-4a9e-4fa6-85b1-2136a8466bec None admin] PATH_INFO: `/v3/groups/3b24026319df42e2b5c91f7a05f62b56` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:14.124541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86649dda-4a9e-4fa6-85b1-2136a8466bec None admin] RBAC: Authorizing `identity:get_group(group_id=3b24026319df42e2b5c91f7a05f62b56)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:14.126031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86649dda-4a9e-4fa6-85b1-2136a8466bec None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:14.131761 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 210/409] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Sep 26 05:30:13 2022] GET /identity/v3/groups/3b24026319df42e2b5c91f7a05f62b56 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:14.143166 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86649dda-4a9e-4fa6-85b1-2136a8466bec None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:14.169911 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74798123-296e-4ac4-8374-f9fbb7b76be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:14.170941 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74798123-296e-4ac4-8374-f9fbb7b76be7 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:14.171427 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74798123-296e-4ac4-8374-f9fbb7b76be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:14.172037 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74798123-296e-4ac4-8374-f9fbb7b76be7 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:14.172964 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74798123-296e-4ac4-8374-f9fbb7b76be7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:14.173470 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74798123-296e-4ac4-8374-f9fbb7b76be7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:14.175168 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74798123-296e-4ac4-8374-f9fbb7b76be7 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:14.185637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 200/410] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:30:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:14.192154 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74798123-296e-4ac4-8374-f9fbb7b76be7 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:14.263995 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:14.270293 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:14.317471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74798123-296e-4ac4-8374-f9fbb7b76be7 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:14.338529 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86649dda-4a9e-4fa6-85b1-2136a8466bec None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:14.357641 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6978121-6525-431a-b5db-ca42a1e64670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:14.358708 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6978121-6525-431a-b5db-ca42a1e64670 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:14.359177 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6978121-6525-431a-b5db-ca42a1e64670 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:14.359636 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6978121-6525-431a-b5db-ca42a1e64670 None admin] PATH_INFO: `/v3/groups/45485a42ec484ca59c5dc2c94fd48ac3` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:14.361039 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6978121-6525-431a-b5db-ca42a1e64670 None admin] RBAC: Authorizing `identity:get_group(group_id=45485a42ec484ca59c5dc2c94fd48ac3)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:14.362721 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6978121-6525-431a-b5db-ca42a1e64670 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:14.365276 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 201/411] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Sep 26 05:30:14 2022] GET /identity/v3/groups/45485a42ec484ca59c5dc2c94fd48ac3 => generated 229 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:14.371402 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6978121-6525-431a-b5db-ca42a1e64670 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:14.378749 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10db42-a40e-4f80-af01-4a1014a1510a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:14.378960 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10db42-a40e-4f80-af01-4a1014a1510a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:14.379194 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10db42-a40e-4f80-af01-4a1014a1510a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:14.379423 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae10db42-a40e-4f80-af01-4a1014a1510a None admin] PATH_INFO: `/v3/projects/61304b31bc674654a80d1255b6e98ad3` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:14.380616 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae10db42-a40e-4f80-af01-4a1014a1510a None admin] RBAC: Authorizing `identity:get_project(project_id=61304b31bc674654a80d1255b6e98ad3)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:14.382127 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae10db42-a40e-4f80-af01-4a1014a1510a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:14.384284 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 211/412] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:30:14 2022] GET /identity/v3/projects/61304b31bc674654a80d1255b6e98ad3 => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:14.390838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10db42-a40e-4f80-af01-4a1014a1510a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:14.580001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae10db42-a40e-4f80-af01-4a1014a1510a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:14.594412 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6978121-6525-431a-b5db-ca42a1e64670 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:14.644749 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:14.652324 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:14.655029 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917727d6-a3d7-4639-8d77-eb8f782aaea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:14.655787 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917727d6-a3d7-4639-8d77-eb8f782aaea1 None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:14.656065 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917727d6-a3d7-4639-8d77-eb8f782aaea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:14.656339 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917727d6-a3d7-4639-8d77-eb8f782aaea1 None admin] PATH_INFO: `/v3/projects/61304b31bc674654a80d1255b6e98ad3/groups/3b24026319df42e2b5c91f7a05f62b56/roles/7cb00fff13fb4eefa6a734c91c0d59ea` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:14.659516 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917727d6-a3d7-4639-8d77-eb8f782aaea1 None admin] RBAC: Authorizing `identity:create_grant(project_id=61304b31bc674654a80d1255b6e98ad3, group_id=3b24026319df42e2b5c91f7a05f62b56, role_id=7cb00fff13fb4eefa6a734c91c0d59ea)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:14.661026 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917727d6-a3d7-4639-8d77-eb8f782aaea1 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:14.667515 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c6c57-d1a9-498b-b653-b565ba9f6790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:14.668204 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c6c57-d1a9-498b-b653-b565ba9f6790 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:14.668477 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c6c57-d1a9-498b-b653-b565ba9f6790 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:14.668744 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c6c57-d1a9-498b-b653-b565ba9f6790 None admin] PATH_INFO: `/v3/projects/2c94348459484274ba0198cbad0a8ffb` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:14.669944 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c6c57-d1a9-498b-b653-b565ba9f6790 None admin] RBAC: Authorizing `identity:get_project(project_id=2c94348459484274ba0198cbad0a8ffb)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:14.671473 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c6c57-d1a9-498b-b653-b565ba9f6790 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:14.674255 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 202/413] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:30:14 2022] GET /identity/v3/projects/2c94348459484274ba0198cbad0a8ffb => generated 344 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:30:14.680924 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c6c57-d1a9-498b-b653-b565ba9f6790 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:14.717051 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 212/414] 10.222.0.66 () {58 vars in 1442 bytes} [Mon Sep 26 05:30:14 2022] PUT /identity/v3/projects/61304b31bc674654a80d1255b6e98ad3/groups/3b24026319df42e2b5c91f7a05f62b56/roles/7cb00fff13fb4eefa6a734c91c0d59ea => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:14.842989 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c6c57-d1a9-498b-b653-b565ba9f6790 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:14.894417 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44e986-c74f-4167-ab95-43bfd9de6204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:14.895036 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44e986-c74f-4167-ab95-43bfd9de6204 None admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:14.895314 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44e986-c74f-4167-ab95-43bfd9de6204 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:14.895587 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44e986-c74f-4167-ab95-43bfd9de6204 None admin] PATH_INFO: `/v3/projects/2c94348459484274ba0198cbad0a8ffb/groups/45485a42ec484ca59c5dc2c94fd48ac3/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:14.897906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44e986-c74f-4167-ab95-43bfd9de6204 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c94348459484274ba0198cbad0a8ffb, group_id=45485a42ec484ca59c5dc2c94fd48ac3, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:14.899543 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac44e986-c74f-4167-ab95-43bfd9de6204 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:14.924759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 203/415] 10.222.0.66 () {58 vars in 1442 bytes} [Mon Sep 26 05:30:14 2022] PUT /identity/v3/projects/2c94348459484274ba0198cbad0a8ffb/groups/45485a42ec484ca59c5dc2c94fd48ac3/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:15.035048 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef925ea7-7102-45a4-9de9-43161dbb38ec None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:15.035614 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef925ea7-7102-45a4-9de9-43161dbb38ec None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:15.035614 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef925ea7-7102-45a4-9de9-43161dbb38ec None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:15.037231 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 213/416] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:15.043828 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc536697-6126-47f2-affd-8c57f0d0d0a8 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:15.044501 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc536697-6126-47f2-affd-8c57f0d0d0a8 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:15.044984 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc536697-6126-47f2-affd-8c57f0d0d0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:15.072616 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-dc536697-6126-47f2-affd-8c57f0d0d0a8 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:15.074268 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-dc536697-6126-47f2-affd-8c57f0d0d0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:15.192109 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:15.220495 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 204/417] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:30:15.275098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949f4c2-e579-4e42-b478-fd8fe2e5b1b1 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:15.275712 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949f4c2-e579-4e42-b478-fd8fe2e5b1b1 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:15.276226 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b949f4c2-e579-4e42-b478-fd8fe2e5b1b1 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:15.278107 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 214/418] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:30:15.283653 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64f40c-887c-43a5-9d30-3c5b7390e618 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:15.284010 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64f40c-887c-43a5-9d30-3c5b7390e618 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:15.284240 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64f40c-887c-43a5-9d30-3c5b7390e618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:15.307159 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-4d64f40c-887c-43a5-9d30-3c5b7390e618 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:15.308617 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4d64f40c-887c-43a5-9d30-3c5b7390e618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:15.394293 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 205/419] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:30:15.512902 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949f4c2-e579-4e42-b478-fd8fe2e5b1b1 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:15.629247 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b949f4c2-e579-4e42-b478-fd8fe2e5b1b1 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:15.669338 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7052a71-86bf-4c32-9829-9106b0ab9b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:15.669991 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7052a71-86bf-4c32-9829-9106b0ab9b90 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:15.670266 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7052a71-86bf-4c32-9829-9106b0ab9b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:15.670550 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7052a71-86bf-4c32-9829-9106b0ab9b90 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:15.689926 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7052a71-86bf-4c32-9829-9106b0ab9b90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:30:15.695055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-b7052a71-86bf-4c32-9829-9106b0ab9b90 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:30:15.695055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:15.695055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:15.695055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:15.695055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:15.695055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:15.695055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:15.695055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:15.695055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:15.695055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:15.695055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:15.695055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:15.695055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:30:15.695055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:30:15.695055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:30:15.695055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:30:15.696031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:30:15.696031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:30:15.696031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:30:15.696031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:30:15.696031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:15.696031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:15.696031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:15.696031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:15.696031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:15.696031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:15.696031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:15.696031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:15.696031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:15.696031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:15.696031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:15.696031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:15.696831 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:15.696831 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:15.696831 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:15.696831 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:15.696831 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:30:15.696831 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:30:15.696831 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:30:15.696831 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:30:15.696831 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:30:15.696831 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:30:15.696831 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:30:15.696831 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:15.696831 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 215/420] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:30:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:15.705041 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64f40c-887c-43a5-9d30-3c5b7390e618 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:15.738407 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7052a71-86bf-4c32-9829-9106b0ab9b90 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:15.804350 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:15.921101 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7052a71-86bf-4c32-9829-9106b0ab9b90 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:15.966058 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64f40c-887c-43a5-9d30-3c5b7390e618 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:15.967452 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c65b2-59ec-4b80-9a05-66966a9bcbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:15.976997 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c65b2-59ec-4b80-9a05-66966a9bcbff None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:15.977325 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c65b2-59ec-4b80-9a05-66966a9bcbff None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:15.977542 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c65b2-59ec-4b80-9a05-66966a9bcbff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:15.988713 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:15.997535 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c65b2-59ec-4b80-9a05-66966a9bcbff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:30:16.002671 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-945c65b2-59ec-4b80-9a05-66966a9bcbff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:30:16.002671 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:16.002671 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:16.002671 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:16.002671 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:16.002671 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:16.002671 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:16.002671 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:16.002671 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:16.002671 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:16.002671 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:16.002671 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:16.002671 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:30:16.002671 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:30:16.002671 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:30:16.002671 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:30:16.003623 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:30:16.003623 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:30:16.003623 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:30:16.003623 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:30:16.003623 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:16.003623 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:16.003623 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:16.003623 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:16.003623 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:16.003623 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:16.003623 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:16.003623 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:16.003623 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:16.003623 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:16.003623 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:16.003623 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:16.004486 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:16.004486 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:16.004486 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:16.004486 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:16.004486 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:30:16.004486 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:30:16.004486 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:30:16.004486 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:30:16.004486 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:30:16.004486 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:30:16.004486 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:30:16.004486 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:16.011921 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 216/421] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 26 05:30:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:30:16.012885 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c65b2-59ec-4b80-9a05-66966a9bcbff None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:16.021167 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a43c1c-4aaa-4873-bcaa-cf48df962f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:16.021803 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a43c1c-4aaa-4873-bcaa-cf48df962f7b None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:16.022075 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a43c1c-4aaa-4873-bcaa-cf48df962f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:16.022342 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a43c1c-4aaa-4873-bcaa-cf48df962f7b None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:16.023099 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a43c1c-4aaa-4873-bcaa-cf48df962f7b None admin] RBAC: Adding query filter params (name=member) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:16.023395 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a43c1c-4aaa-4873-bcaa-cf48df962f7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:16.024831 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a43c1c-4aaa-4873-bcaa-cf48df962f7b None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:16.051960 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 206/422] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 26 05:30:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:16.052995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a43c1c-4aaa-4873-bcaa-cf48df962f7b None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:16.221673 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a43c1c-4aaa-4873-bcaa-cf48df962f7b None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:16.261437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7cf45-7160-4a91-ac96-82203c2ab2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:16.262402 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7cf45-7160-4a91-ac96-82203c2ab2ea None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:16.262862 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7cf45-7160-4a91-ac96-82203c2ab2ea None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:16.263466 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7cf45-7160-4a91-ac96-82203c2ab2ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:16.282735 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c65b2-59ec-4b80-9a05-66966a9bcbff None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:16.314611 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:16.337679 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:16.360176 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43551f1-5922-4164-ba79-afc385427af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:16.361151 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43551f1-5922-4164-ba79-afc385427af1 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:16.361751 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43551f1-5922-4164-ba79-afc385427af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:16.363283 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43551f1-5922-4164-ba79-afc385427af1 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:16.364139 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43551f1-5922-4164-ba79-afc385427af1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:16.365293 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43551f1-5922-4164-ba79-afc385427af1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:16.366937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43551f1-5922-4164-ba79-afc385427af1 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:16.380062 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7cf45-7160-4a91-ac96-82203c2ab2ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:16.381795 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7cf45-7160-4a91-ac96-82203c2ab2ea None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:16.387339 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 217/423] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:30:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:16.393366 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43551f1-5922-4164-ba79-afc385427af1 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:16.580918 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 207/424] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:30:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:16.581449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43551f1-5922-4164-ba79-afc385427af1 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:16.586887 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7cf45-7160-4a91-ac96-82203c2ab2ea None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:16.628765 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded98615-1cbb-4d9f-ada4-b4456be727cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:16.629749 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded98615-1cbb-4d9f-ada4-b4456be727cd None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:16.630245 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded98615-1cbb-4d9f-ada4-b4456be727cd None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:16.630707 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded98615-1cbb-4d9f-ada4-b4456be727cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:16.677902 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:16.717974 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded98615-1cbb-4d9f-ada4-b4456be727cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:16.719666 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded98615-1cbb-4d9f-ada4-b4456be727cd None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:16.828501 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 218/425] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:30:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 26 05:30:16.834326 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded98615-1cbb-4d9f-ada4-b4456be727cd None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:16.861340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:16.880198 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7cf45-7160-4a91-ac96-82203c2ab2ea None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:16.927770 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf95a7a-37df-4eab-b1d7-566ee42cd23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:16.927770 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf95a7a-37df-4eab-b1d7-566ee42cd23e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:16.927770 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf95a7a-37df-4eab-b1d7-566ee42cd23e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:16.927770 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf95a7a-37df-4eab-b1d7-566ee42cd23e None admin] PATH_INFO: `/v3/projects/f36f364f981e4cbb8bca50ac93a26b16` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:16.928190 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf95a7a-37df-4eab-b1d7-566ee42cd23e None admin] RBAC: Authorizing `identity:get_project(project_id=f36f364f981e4cbb8bca50ac93a26b16)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:16.930476 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf95a7a-37df-4eab-b1d7-566ee42cd23e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:16.932799 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 208/426] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:30:16 2022] GET /identity/v3/projects/f36f364f981e4cbb8bca50ac93a26b16 => generated 298 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:30:16.937932 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf95a7a-37df-4eab-b1d7-566ee42cd23e None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:17.041988 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:17.066927 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf95a7a-37df-4eab-b1d7-566ee42cd23e None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:17.070276 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded98615-1cbb-4d9f-ada4-b4456be727cd None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:17.108608 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef9a7a-c232-4e79-b9d9-1dea8d9151bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:17.109492 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef9a7a-c232-4e79-b9d9-1dea8d9151bd None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:17.109903 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef9a7a-c232-4e79-b9d9-1dea8d9151bd None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:17.110306 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef9a7a-c232-4e79-b9d9-1dea8d9151bd None admin] PATH_INFO: `/v3/projects/f36f364f981e4cbb8bca50ac93a26b16` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:17.111721 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef9a7a-c232-4e79-b9d9-1dea8d9151bd None admin] RBAC: Authorizing `identity:get_project(project_id=f36f364f981e4cbb8bca50ac93a26b16)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:17.113895 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef9a7a-c232-4e79-b9d9-1dea8d9151bd None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:17.115084 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50baa55-4660-4834-91f3-a7ca436213e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:17.115881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50baa55-4660-4834-91f3-a7ca436213e0 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:17.116159 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50baa55-4660-4834-91f3-a7ca436213e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:17.116425 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50baa55-4660-4834-91f3-a7ca436213e0 None admin] PATH_INFO: `/v3/groups/3b24026319df42e2b5c91f7a05f62b56` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:17.117109 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 219/427] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:30:16 2022] GET /identity/v3/projects/f36f364f981e4cbb8bca50ac93a26b16 => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:17.117699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50baa55-4660-4834-91f3-a7ca436213e0 None admin] RBAC: Authorizing `identity:get_group(group_id=3b24026319df42e2b5c91f7a05f62b56)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:17.118855 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9bd3a-ab4f-4eb9-98ba-375fa7762e82 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:17.119274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50baa55-4660-4834-91f3-a7ca436213e0 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:17.119544 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9bd3a-ab4f-4eb9-98ba-375fa7762e82 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:17.120041 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9bd3a-ab4f-4eb9-98ba-375fa7762e82 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:17.121342 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 209/428] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Sep 26 05:30:16 2022] GET /identity/v3/groups/3b24026319df42e2b5c91f7a05f62b56 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:30:17.123184 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50baa55-4660-4834-91f3-a7ca436213e0 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:17.126784 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 220/429] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:17.127776 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9bd3a-ab4f-4eb9-98ba-375fa7762e82 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:17.147352 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:17.245609 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50baa55-4660-4834-91f3-a7ca436213e0 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:17.261257 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9bd3a-ab4f-4eb9-98ba-375fa7762e82 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:17.284764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0a195-5a97-47df-9e54-0b52bd978504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:17.285442 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0a195-5a97-47df-9e54-0b52bd978504 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:17.285707 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0a195-5a97-47df-9e54-0b52bd978504 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:17.285968 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0a195-5a97-47df-9e54-0b52bd978504 None admin] PATH_INFO: `/v3/groups/3b24026319df42e2b5c91f7a05f62b56` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:17.287446 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d0a195-5a97-47df-9e54-0b52bd978504 None admin] RBAC: Authorizing `identity:get_group(group_id=3b24026319df42e2b5c91f7a05f62b56)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:17.289349 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d0a195-5a97-47df-9e54-0b52bd978504 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:17.291612 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 210/430] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Sep 26 05:30:17 2022] GET /identity/v3/groups/3b24026319df42e2b5c91f7a05f62b56 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:17.293099 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576fac8-8dcb-43a6-a4bc-3e83c2789020 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:17.293621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576fac8-8dcb-43a6-a4bc-3e83c2789020 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:17.294088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576fac8-8dcb-43a6-a4bc-3e83c2789020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:17.302828 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fdfe85-7170-4dc6-877c-61966415d444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:17.303437 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdfe85-7170-4dc6-877c-61966415d444 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:17.303969 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdfe85-7170-4dc6-877c-61966415d444 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:17.304459 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fdfe85-7170-4dc6-877c-61966415d444 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:17.305389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fdfe85-7170-4dc6-877c-61966415d444 None admin] RBAC: Adding query filter params (group.id=3b24026319df42e2b5c91f7a05f62b56, role.id=c5a02c4618d94f1da7257ef437b8ce9e, scope.project.id=f36f364f981e4cbb8bca50ac93a26b16) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:17.305874 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fdfe85-7170-4dc6-877c-61966415d444 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:17.307521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fdfe85-7170-4dc6-877c-61966415d444 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:17.314476 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-3576fac8-8dcb-43a6-a4bc-3e83c2789020 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:17.316381 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-3576fac8-8dcb-43a6-a4bc-3e83c2789020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:17.320066 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 221/431] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Sep 26 05:30:17 2022] GET /identity/v3/role_assignments?group.id=3b24026319df42e2b5c91f7a05f62b56&scope.project.id=f36f364f981e4cbb8bca50ac93a26b16&role.id=c5a02c4618d94f1da7257ef437b8ce9e => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:17.321114 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fdfe85-7170-4dc6-877c-61966415d444 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:17.335056 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:17.428747 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 211/432] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:30:17.516148 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fdfe85-7170-4dc6-877c-61966415d444 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:17.572536 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7f6c4-b7ae-4166-bb21-9fec9248080a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:17.573425 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7f6c4-b7ae-4166-bb21-9fec9248080a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:17.573822 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7f6c4-b7ae-4166-bb21-9fec9248080a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:17.574219 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7f6c4-b7ae-4166-bb21-9fec9248080a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:17.575356 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7f6c4-b7ae-4166-bb21-9fec9248080a None admin] RBAC: Adding query filter params (group.id=3b24026319df42e2b5c91f7a05f62b56, role.id=7cb00fff13fb4eefa6a734c91c0d59ea, scope.project.id=f36f364f981e4cbb8bca50ac93a26b16) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:17.575826 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7f6c4-b7ae-4166-bb21-9fec9248080a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:17.578441 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7f6c4-b7ae-4166-bb21-9fec9248080a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:17.590886 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 222/433] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Sep 26 05:30:17 2022] GET /identity/v3/role_assignments?group.id=3b24026319df42e2b5c91f7a05f62b56&scope.project.id=f36f364f981e4cbb8bca50ac93a26b16&role.id=7cb00fff13fb4eefa6a734c91c0d59ea => generated 611 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:17.745008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd3073-b7e1-42da-8648-9c5dc8e220dd None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:17.745375 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd3073-b7e1-42da-8648-9c5dc8e220dd None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:17.745550 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd3073-b7e1-42da-8648-9c5dc8e220dd None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:17.747461 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 212/434] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:17.753989 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae23413-e7eb-406c-96d4-0b4ec1040544 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:17.754350 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae23413-e7eb-406c-96d4-0b4ec1040544 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:17.754551 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae23413-e7eb-406c-96d4-0b4ec1040544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:17.775140 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd3073-b7e1-42da-8648-9c5dc8e220dd None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:17.784882 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-cae23413-e7eb-406c-96d4-0b4ec1040544 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:17.787096 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-cae23413-e7eb-406c-96d4-0b4ec1040544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:17.804398 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:17.935887 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:17.944763 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 223/435] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:30:17.950788 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd3073-b7e1-42da-8648-9c5dc8e220dd None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:17.992397 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b16f17-2afb-4967-a495-c8517b2ef270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:17.993420 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b16f17-2afb-4967-a495-c8517b2ef270 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:17.993892 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b16f17-2afb-4967-a495-c8517b2ef270 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:17.994366 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b16f17-2afb-4967-a495-c8517b2ef270 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:18.006952 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b16f17-2afb-4967-a495-c8517b2ef270 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:30:18.012517 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-04b16f17-2afb-4967-a495-c8517b2ef270 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:30:18.012517 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:18.012517 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:18.012517 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:18.012517 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:18.012517 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:18.012517 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:18.012517 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:18.012517 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:18.012517 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:18.012517 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:18.012517 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:18.012517 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:30:18.012517 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:30:18.012517 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:30:18.012517 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:30:18.013474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:30:18.013474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:30:18.013474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:30:18.013474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:30:18.013474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:18.013474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:18.013474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:18.013474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:18.013474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:18.013474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:18.013474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:18.013474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:18.013474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:18.013474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:18.013474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:18.013474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:18.014357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:18.014357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:18.014357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:18.014357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:18.014357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:30:18.014357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:30:18.014357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:30:18.014357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:30:18.014357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:30:18.014357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:30:18.014357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 26 05:30:18.014357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:18.017140 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 213/436] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:30:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:18.023236 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae23413-e7eb-406c-96d4-0b4ec1040544 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:18.176784 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae23413-e7eb-406c-96d4-0b4ec1040544 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:18.232143 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdf0ef-66ac-4855-8f23-572fe0fb5e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:18.232847 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdf0ef-66ac-4855-8f23-572fe0fb5e30 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:18.233124 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdf0ef-66ac-4855-8f23-572fe0fb5e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:18.233389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdf0ef-66ac-4855-8f23-572fe0fb5e30 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:18.234246 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fdf0ef-66ac-4855-8f23-572fe0fb5e30 None admin] RBAC: Adding query filter params (name=member) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:18.234731 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fdf0ef-66ac-4855-8f23-572fe0fb5e30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:18.236551 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fdf0ef-66ac-4855-8f23-572fe0fb5e30 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:18.246572 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b16f17-2afb-4967-a495-c8517b2ef270 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:18.251706 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 224/437] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 26 05:30:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:18.258254 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdf0ef-66ac-4855-8f23-572fe0fb5e30 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:18.365091 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:18.367624 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:18.404535 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b16f17-2afb-4967-a495-c8517b2ef270 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:18.458823 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdf0ef-66ac-4855-8f23-572fe0fb5e30 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:18.468341 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ded0d0-d31e-4052-8df2-52ed34400379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:18.469399 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ded0d0-d31e-4052-8df2-52ed34400379 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:18.469856 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ded0d0-d31e-4052-8df2-52ed34400379 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:18.470348 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ded0d0-d31e-4052-8df2-52ed34400379 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:18.489214 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ded0d0-d31e-4052-8df2-52ed34400379 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:30:18.495197 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-e3ded0d0-d31e-4052-8df2-52ed34400379 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:30:18.495197 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:18.495197 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:18.495197 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:18.495197 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:18.495197 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:18.495197 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:18.495197 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:18.495197 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:18.495197 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:18.495197 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:18.495197 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:18.495197 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:30:18.495197 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:30:18.495197 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:30:18.495197 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:30:18.497007 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:30:18.497007 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:30:18.497007 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:30:18.497007 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:30:18.497007 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:18.497007 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:18.497007 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:18.497007 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:18.497007 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:18.497007 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:18.497007 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:18.497007 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:18.497007 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:18.497007 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:18.497007 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:18.497007 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:18.498618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:18.498618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:18.498618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:18.498618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:18.498618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:30:18.498618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:30:18.498618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:30:18.498618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:30:18.498618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:30:18.498618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:30:18.498618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:30:18.498618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:18.498618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 214/438] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:30:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:30:18.498618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a82ba-16ff-4217-b0cb-7a8c40abdef0 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:18.500024 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a82ba-16ff-4217-b0cb-7a8c40abdef0 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:18.500024 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a82ba-16ff-4217-b0cb-7a8c40abdef0 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:18.503808 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 215/439] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:18.505916 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89358342-fe48-4c5f-ba4f-caa295b9dd18 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:18.506195 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89358342-fe48-4c5f-ba4f-caa295b9dd18 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:18.506461 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89358342-fe48-4c5f-ba4f-caa295b9dd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:18.512529 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bd5d3-b028-4ccd-bb0e-32f20abd63c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:18.513201 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bd5d3-b028-4ccd-bb0e-32f20abd63c3 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:18.513474 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bd5d3-b028-4ccd-bb0e-32f20abd63c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:18.513742 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bd5d3-b028-4ccd-bb0e-32f20abd63c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:18.526323 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-89358342-fe48-4c5f-ba4f-caa295b9dd18 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:18.527546 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-89358342-fe48-4c5f-ba4f-caa295b9dd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:18.600912 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 216/440] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:30:18.601677 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89358342-fe48-4c5f-ba4f-caa295b9dd18 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:18.601937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28bd5d3-b028-4ccd-bb0e-32f20abd63c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:18.604624 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28bd5d3-b028-4ccd-bb0e-32f20abd63c3 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:18.693829 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:18.705294 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:18.759868 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 225/441] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:30:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:18.763310 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bd5d3-b028-4ccd-bb0e-32f20abd63c3 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:18.772948 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89358342-fe48-4c5f-ba4f-caa295b9dd18 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:18.819273 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd379c-1639-44a4-a747-d73390c559e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:18.820033 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd379c-1639-44a4-a747-d73390c559e9 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:18.820308 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd379c-1639-44a4-a747-d73390c559e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:18.820577 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd379c-1639-44a4-a747-d73390c559e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:18.821245 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd379c-1639-44a4-a747-d73390c559e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:18.821540 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd379c-1639-44a4-a747-d73390c559e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:18.823266 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd379c-1639-44a4-a747-d73390c559e9 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:18.833348 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 217/442] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:30:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:18.839051 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd379c-1639-44a4-a747-d73390c559e9 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:18.908362 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bd5d3-b028-4ccd-bb0e-32f20abd63c3 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:18.964684 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f648c92-d383-4cec-9172-9e16609eb882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:18.965339 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f648c92-d383-4cec-9172-9e16609eb882 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:18.965608 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f648c92-d383-4cec-9172-9e16609eb882 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:18.965876 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f648c92-d383-4cec-9172-9e16609eb882 None admin] PATH_INFO: `/v3/projects/61304b31bc674654a80d1255b6e98ad3` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:18.967074 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f648c92-d383-4cec-9172-9e16609eb882 None admin] RBAC: Authorizing `identity:get_project(project_id=61304b31bc674654a80d1255b6e98ad3)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:18.969811 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f648c92-d383-4cec-9172-9e16609eb882 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:18.970165 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 226/443] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:30:18 2022] GET /identity/v3/projects/61304b31bc674654a80d1255b6e98ad3 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:30:18.975685 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f648c92-d383-4cec-9172-9e16609eb882 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:19.013958 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:19.025943 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd379c-1639-44a4-a747-d73390c559e9 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:19.064016 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:19.076329 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfa6c3-f081-4d85-abaf-f65419236336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:19.077063 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfa6c3-f081-4d85-abaf-f65419236336 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:19.077692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfa6c3-f081-4d85-abaf-f65419236336 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:19.077961 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfa6c3-f081-4d85-abaf-f65419236336 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:19.125881 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f648c92-d383-4cec-9172-9e16609eb882 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:19.172893 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e3f6a-3776-4ddd-863a-d7b9025c208f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:19.173459 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e3f6a-3776-4ddd-863a-d7b9025c208f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:19.173724 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e3f6a-3776-4ddd-863a-d7b9025c208f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:19.173996 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146e3f6a-3776-4ddd-863a-d7b9025c208f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:19.174952 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfa6c3-f081-4d85-abaf-f65419236336 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:19.176453 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfa6c3-f081-4d85-abaf-f65419236336 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:19.191539 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146e3f6a-3776-4ddd-863a-d7b9025c208f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:30:19.199054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-146e3f6a-3776-4ddd-863a-d7b9025c208f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:30:19.199054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:19.199054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:19.199054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:19.199054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:19.199054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:19.199054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:19.199054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:19.199054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:19.199054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:19.199054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:19.199054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:19.199054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:30:19.199054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:30:19.199054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:30:19.199054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:30:19.200209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:30:19.200209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:30:19.200209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:30:19.200209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:30:19.200209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:19.200209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:19.200209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:19.200209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:19.200209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:19.200209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:19.200209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:19.200209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:19.200209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:19.200209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:19.200209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:19.200209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:19.201880 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:19.201880 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:19.201880 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:19.201880 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:19.201880 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:30:19.201880 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:30:19.201880 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:30:19.201880 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:30:19.201880 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:30:19.201880 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:30:19.201880 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:30:19.201880 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:19.201880 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 227/444] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 26 05:30:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:19.202920 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e3f6a-3776-4ddd-863a-d7b9025c208f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:19.309249 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 218/445] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:30:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 26 05:30:19.313338 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfa6c3-f081-4d85-abaf-f65419236336 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:19.346341 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:19.350715 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:19.360690 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146e3f6a-3776-4ddd-863a-d7b9025c208f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:19.395654 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eedc1a1-7a3f-4227-8f60-929ad1f5cff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:19.396556 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedc1a1-7a3f-4227-8f60-929ad1f5cff2 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:19.396556 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedc1a1-7a3f-4227-8f60-929ad1f5cff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:19.396842 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedc1a1-7a3f-4227-8f60-929ad1f5cff2 None admin] PATH_INFO: `/v3/groups/3b24026319df42e2b5c91f7a05f62b56` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:19.398060 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eedc1a1-7a3f-4227-8f60-929ad1f5cff2 None admin] RBAC: Authorizing `identity:get_group(group_id=3b24026319df42e2b5c91f7a05f62b56)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:19.399529 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eedc1a1-7a3f-4227-8f60-929ad1f5cff2 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:19.401402 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 228/446] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Sep 26 05:30:19 2022] GET /identity/v3/groups/3b24026319df42e2b5c91f7a05f62b56 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:19.402234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eedc1a1-7a3f-4227-8f60-929ad1f5cff2 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:19.449861 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfa6c3-f081-4d85-abaf-f65419236336 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:19.492108 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb4590-7122-4788-ae11-fd4f58751d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:19.493046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb4590-7122-4788-ae11-fd4f58751d96 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:19.493474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb4590-7122-4788-ae11-fd4f58751d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:19.493931 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb4590-7122-4788-ae11-fd4f58751d96 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:19.494995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeb4590-7122-4788-ae11-fd4f58751d96 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:19.495463 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeb4590-7122-4788-ae11-fd4f58751d96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:19.497807 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeb4590-7122-4788-ae11-fd4f58751d96 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:19.508775 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 219/447] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:30:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:19.509919 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb4590-7122-4788-ae11-fd4f58751d96 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:19.527690 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eedc1a1-7a3f-4227-8f60-929ad1f5cff2 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:19.565510 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e4707-53ca-41fe-99f9-294ea8aca198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:19.566277 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e4707-53ca-41fe-99f9-294ea8aca198 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:19.566617 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e4707-53ca-41fe-99f9-294ea8aca198 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:19.566981 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e4707-53ca-41fe-99f9-294ea8aca198 None admin] PATH_INFO: `/v3/projects/2c94348459484274ba0198cbad0a8ffb` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:19.568367 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e4707-53ca-41fe-99f9-294ea8aca198 None admin] RBAC: Authorizing `identity:get_project(project_id=2c94348459484274ba0198cbad0a8ffb)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:19.570135 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1e4707-53ca-41fe-99f9-294ea8aca198 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:19.572140 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 229/448] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:30:19 2022] GET /identity/v3/projects/2c94348459484274ba0198cbad0a8ffb => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:19.573112 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e4707-53ca-41fe-99f9-294ea8aca198 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:19.602516 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:19.611524 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:19.625644 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb4590-7122-4788-ae11-fd4f58751d96 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:19.662127 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb884c88-46ff-4158-8fd1-c169a0a36083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:19.662836 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb884c88-46ff-4158-8fd1-c169a0a36083 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:19.663109 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb884c88-46ff-4158-8fd1-c169a0a36083 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:19.663375 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb884c88-46ff-4158-8fd1-c169a0a36083 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:19.664174 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb884c88-46ff-4158-8fd1-c169a0a36083 None admin] RBAC: Adding query filter params (group.id=3b24026319df42e2b5c91f7a05f62b56, role.id=c5a02c4618d94f1da7257ef437b8ce9e, scope.project.id=61304b31bc674654a80d1255b6e98ad3) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:19.664471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb884c88-46ff-4158-8fd1-c169a0a36083 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:19.665947 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb884c88-46ff-4158-8fd1-c169a0a36083 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:19.672443 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 220/449] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Sep 26 05:30:19 2022] GET /identity/v3/role_assignments?group.id=3b24026319df42e2b5c91f7a05f62b56&scope.project.id=61304b31bc674654a80d1255b6e98ad3&role.id=c5a02c4618d94f1da7257ef437b8ce9e => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:19.673259 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb884c88-46ff-4158-8fd1-c169a0a36083 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:19.697874 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e4707-53ca-41fe-99f9-294ea8aca198 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:19.749674 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3352ecf-1758-474c-a2f6-65bb0daa28e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:19.750389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3352ecf-1758-474c-a2f6-65bb0daa28e8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:19.750711 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3352ecf-1758-474c-a2f6-65bb0daa28e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:19.750910 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3352ecf-1758-474c-a2f6-65bb0daa28e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:19.821782 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb884c88-46ff-4158-8fd1-c169a0a36083 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:19.869206 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3352ecf-1758-474c-a2f6-65bb0daa28e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:19.870908 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3352ecf-1758-474c-a2f6-65bb0daa28e8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:19.874549 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc87c5-f047-4ed6-875f-507468172b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:19.875222 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc87c5-f047-4ed6-875f-507468172b72 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:19.875505 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc87c5-f047-4ed6-875f-507468172b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:19.876462 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc87c5-f047-4ed6-875f-507468172b72 None admin] PATH_INFO: `/v3/groups/45485a42ec484ca59c5dc2c94fd48ac3` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:19.876968 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc87c5-f047-4ed6-875f-507468172b72 None admin] RBAC: Authorizing `identity:get_group(group_id=45485a42ec484ca59c5dc2c94fd48ac3)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:19.878428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc87c5-f047-4ed6-875f-507468172b72 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:19.880337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 221/450] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Sep 26 05:30:19 2022] GET /identity/v3/groups/45485a42ec484ca59c5dc2c94fd48ac3 => generated 229 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:19.886675 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc87c5-f047-4ed6-875f-507468172b72 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:19.915783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:19.916756 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:20.041465 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 230/451] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:30:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:20.052084 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3352ecf-1758-474c-a2f6-65bb0daa28e8 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:20.052275 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc87c5-f047-4ed6-875f-507468172b72 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:20.099501 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda828a4-c5e1-493c-8d30-359e353aa6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:20.100428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda828a4-c5e1-493c-8d30-359e353aa6dd None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:20.100709 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda828a4-c5e1-493c-8d30-359e353aa6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:20.101017 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda828a4-c5e1-493c-8d30-359e353aa6dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:20.101796 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda828a4-c5e1-493c-8d30-359e353aa6dd None admin] RBAC: Adding query filter params (group.id=45485a42ec484ca59c5dc2c94fd48ac3, role.id=cf58d66369044fb09fa65a4366dc7446, scope.project.id=2c94348459484274ba0198cbad0a8ffb) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:20.102100 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda828a4-c5e1-493c-8d30-359e353aa6dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:20.103566 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda828a4-c5e1-493c-8d30-359e353aa6dd None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:20.111609 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 222/452] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Sep 26 05:30:19 2022] GET /identity/v3/role_assignments?group.id=45485a42ec484ca59c5dc2c94fd48ac3&scope.project.id=2c94348459484274ba0198cbad0a8ffb&role.id=cf58d66369044fb09fa65a4366dc7446 => generated 611 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:30:20.190644 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3352ecf-1758-474c-a2f6-65bb0daa28e8 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:20.221601 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:20.232395 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ffbc1-2bf5-429d-87b4-3f88c0d05354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:20.233061 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ffbc1-2bf5-429d-87b4-3f88c0d05354 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:20.233321 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ffbc1-2bf5-429d-87b4-3f88c0d05354 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:20.233588 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ffbc1-2bf5-429d-87b4-3f88c0d05354 None admin] PATH_INFO: `/v3/projects/61304b31bc674654a80d1255b6e98ad3` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:20.234799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ffbc1-2bf5-429d-87b4-3f88c0d05354 None admin] RBAC: Authorizing `identity:get_project(project_id=61304b31bc674654a80d1255b6e98ad3)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:20.236428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ffbc1-2bf5-429d-87b4-3f88c0d05354 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:20.238342 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 231/453] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:30:20 2022] GET /identity/v3/projects/61304b31bc674654a80d1255b6e98ad3 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:30:20.246696 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda828a4-c5e1-493c-8d30-359e353aa6dd None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:20.366051 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:20.384049 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda828a4-c5e1-493c-8d30-359e353aa6dd None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:20.421492 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac298b0a-3b04-4a09-9260-685ba67fc89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:20.422148 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac298b0a-3b04-4a09-9260-685ba67fc89a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:20.422428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac298b0a-3b04-4a09-9260-685ba67fc89a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:20.422701 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac298b0a-3b04-4a09-9260-685ba67fc89a None admin] PATH_INFO: `/v3/groups/3b24026319df42e2b5c91f7a05f62b56` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:20.423893 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac298b0a-3b04-4a09-9260-685ba67fc89a None admin] RBAC: Authorizing `identity:get_group(group_id=3b24026319df42e2b5c91f7a05f62b56)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:20.425326 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac298b0a-3b04-4a09-9260-685ba67fc89a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:20.426936 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 223/454] 10.222.0.66 () {56 vars in 1180 bytes} [Mon Sep 26 05:30:20 2022] GET /identity/v3/groups/3b24026319df42e2b5c91f7a05f62b56 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:20.435770 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ffbc1-2bf5-429d-87b4-3f88c0d05354 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:20.545384 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ffbc1-2bf5-429d-87b4-3f88c0d05354 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:20.580627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a354e6-6c79-464f-a8f8-abe9471e4811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:20.581229 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a354e6-6c79-464f-a8f8-abe9471e4811 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:20.581499 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a354e6-6c79-464f-a8f8-abe9471e4811 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:20.581764 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a354e6-6c79-464f-a8f8-abe9471e4811 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:20.582489 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a354e6-6c79-464f-a8f8-abe9471e4811 None admin] RBAC: Adding query filter params (group.id=3b24026319df42e2b5c91f7a05f62b56, role.id=7cb00fff13fb4eefa6a734c91c0d59ea, scope.project.id=61304b31bc674654a80d1255b6e98ad3) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:20.582790 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a354e6-6c79-464f-a8f8-abe9471e4811 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:20.584273 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a354e6-6c79-464f-a8f8-abe9471e4811 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:20.590707 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 232/455] 10.222.0.66 () {56 vars in 1376 bytes} [Mon Sep 26 05:30:20 2022] GET /identity/v3/role_assignments?group.id=3b24026319df42e2b5c91f7a05f62b56&scope.project.id=61304b31bc674654a80d1255b6e98ad3&role.id=7cb00fff13fb4eefa6a734c91c0d59ea => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:23.604109 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded797a-dd50-4335-a44d-20e16677f28b None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:23.605194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded797a-dd50-4335-a44d-20e16677f28b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:23.605672 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded797a-dd50-4335-a44d-20e16677f28b None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:23.607543 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 224/456] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:23.613087 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2e9b0-9c0c-4214-a0f8-42dd3c4a1dad None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:23.614078 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2e9b0-9c0c-4214-a0f8-42dd3c4a1dad None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:23.614558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a2e9b0-9c0c-4214-a0f8-42dd3c4a1dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:23.624356 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0216daf-89d7-4864-a04c-8a9ceb3c194d None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:23.624982 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0216daf-89d7-4864-a04c-8a9ceb3c194d None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:23.625452 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0216daf-89d7-4864-a04c-8a9ceb3c194d None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:23.628487 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 225/457] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:23.639337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7e41b-6e6b-47bc-a734-4891c0fb3cb6 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:23.640021 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7e41b-6e6b-47bc-a734-4891c0fb3cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:23.640494 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7e41b-6e6b-47bc-a734-4891c0fb3cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:23.643168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-f9a2e9b0-9c0c-4214-a0f8-42dd3c4a1dad None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:23.644701 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f9a2e9b0-9c0c-4214-a0f8-42dd3c4a1dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:23.682361 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-caf7e41b-6e6b-47bc-a734-4891c0fb3cb6 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:23.685415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-caf7e41b-6e6b-47bc-a734-4891c0fb3cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:23.764126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:23.798901 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 233/458] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:30:23.826599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 226/459] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:30:24.191656 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2e9b0-9c0c-4214-a0f8-42dd3c4a1dad None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:24.234691 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7e41b-6e6b-47bc-a734-4891c0fb3cb6 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:24.337621 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a2e9b0-9c0c-4214-a0f8-42dd3c4a1dad None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:24.348629 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:24.374689 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7e41b-6e6b-47bc-a734-4891c0fb3cb6 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:24.384400 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3f562-c9b0-47b6-956e-d84b63726297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:24.385316 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3f562-c9b0-47b6-956e-d84b63726297 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:24.385837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3f562-c9b0-47b6-956e-d84b63726297 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:24.386573 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3f562-c9b0-47b6-956e-d84b63726297 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:24.399082 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3f562-c9b0-47b6-956e-d84b63726297 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:24.400641 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa3f562-c9b0-47b6-956e-d84b63726297 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:24.420104 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cab88-4ac1-4d11-a387-cdae343a5868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:24.420758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cab88-4ac1-4d11-a387-cdae343a5868 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:24.421029 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cab88-4ac1-4d11-a387-cdae343a5868 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:24.421598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-1fa3f562-c9b0-47b6-956e-d84b63726297 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:24.421598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:24.421598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:24.421598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:24.421598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:24.421598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:24.421598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:24.421598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:24.421598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:24.421598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:24.421598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:24.421598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:24.421598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:24.421598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:24.421598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:24.421598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:24.422493 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:24.422493 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:24.422493 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:24.422493 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:24.422493 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:24.422493 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:24.422493 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:24.422493 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:24.422493 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:24.422493 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:24.422493 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:24.422493 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:24.422493 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:24.422493 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:24.422493 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:24.422493 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:24.422493 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:24.423388 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:24.423388 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:24.423388 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:24.423553 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cab88-4ac1-4d11-a387-cdae343a5868 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:24.423633 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 234/460] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:24.424267 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36654b-a30c-4822-9398-6da4fd779f7a None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:24.424502 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36654b-a30c-4822-9398-6da4fd779f7a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:24.424753 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36654b-a30c-4822-9398-6da4fd779f7a None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:24.426315 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 235/461] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:24.433183 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f65076-4af9-4205-b6d6-cf438d95d756 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:24.433512 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f65076-4af9-4205-b6d6-cf438d95d756 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:24.433724 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f65076-4af9-4205-b6d6-cf438d95d756 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:24.439401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 236/462] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:24.439401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f65076-4af9-4205-b6d6-cf438d95d756 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:24.451633 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cab88-4ac1-4d11-a387-cdae343a5868 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:24.453638 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cab88-4ac1-4d11-a387-cdae343a5868 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:24.474330 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-a91cab88-4ac1-4d11-a387-cdae343a5868 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:24.474330 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:24.474330 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:24.474330 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:24.474330 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:24.474330 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:24.474330 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:24.474330 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:24.474330 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:24.474330 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:24.474330 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:24.474330 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:24.474330 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:24.474330 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:24.474330 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:24.474330 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:24.475284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:24.475284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:24.475284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:24.475284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:24.475284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:24.475284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:24.475284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:24.475284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:24.475284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:24.475284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:24.475284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:24.475284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:24.475284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:24.475284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:24.475284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:24.475284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:24.475284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:24.476333 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:24.476333 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:24.476333 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:24.478335 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 227/463] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:24.480334 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd795aa-027e-4340-b65b-66f64e92e76f None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:24.480818 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd795aa-027e-4340-b65b-66f64e92e76f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:24.481263 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd795aa-027e-4340-b65b-66f64e92e76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:24.502989 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-1fd795aa-027e-4340-b65b-66f64e92e76f None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:24.503619 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:24.505513 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1fd795aa-027e-4340-b65b-66f64e92e76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:24.575046 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f65076-4af9-4205-b6d6-cf438d95d756 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:24.607959 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 228/464] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:30:24.609501 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052419f5-ea32-48a3-9e92-9021c900509e None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:24.609809 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052419f5-ea32-48a3-9e92-9021c900509e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:24.610078 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052419f5-ea32-48a3-9e92-9021c900509e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:24.633629 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-052419f5-ea32-48a3-9e92-9021c900509e None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:24.634847 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-052419f5-ea32-48a3-9e92-9021c900509e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:24.693845 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bad173-4a98-424b-a55a-c5006af0d573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:24.694622 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bad173-4a98-424b-a55a-c5006af0d573 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:24.695039 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bad173-4a98-424b-a55a-c5006af0d573 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:24.695193 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bad173-4a98-424b-a55a-c5006af0d573 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:24.695889 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bad173-4a98-424b-a55a-c5006af0d573 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:24.696195 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bad173-4a98-424b-a55a-c5006af0d573 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:24.697788 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bad173-4a98-424b-a55a-c5006af0d573 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:24.739377 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 237/465] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:24.742693 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bad173-4a98-424b-a55a-c5006af0d573 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:24.826523 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:24.851046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 229/466] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:30:24.852378 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052419f5-ea32-48a3-9e92-9021c900509e None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:24.920725 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:24.926952 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bad173-4a98-424b-a55a-c5006af0d573 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:25.012018 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957851c-52ce-4e0a-98a0-2318c5986144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:25.012572 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957851c-52ce-4e0a-98a0-2318c5986144 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:25.012840 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957851c-52ce-4e0a-98a0-2318c5986144 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:25.013101 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957851c-52ce-4e0a-98a0-2318c5986144 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:25.013770 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957851c-52ce-4e0a-98a0-2318c5986144 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:25.014066 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957851c-52ce-4e0a-98a0-2318c5986144 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:25.015543 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957851c-52ce-4e0a-98a0-2318c5986144 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:25.040862 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 238/467] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:25.041586 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957851c-52ce-4e0a-98a0-2318c5986144 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:25.071179 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052419f5-ea32-48a3-9e92-9021c900509e None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:25.120391 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad944fe7-086f-422e-88dc-70746b1b8320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:25.120991 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad944fe7-086f-422e-88dc-70746b1b8320 None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:25.121260 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad944fe7-086f-422e-88dc-70746b1b8320 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:25.121529 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad944fe7-086f-422e-88dc-70746b1b8320 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:25.122184 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad944fe7-086f-422e-88dc-70746b1b8320 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:25.123900 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad944fe7-086f-422e-88dc-70746b1b8320 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:25.164270 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 230/468] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 26 05:30:24 2022] POST /identity/v3/users => generated 248 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:25.165270 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad944fe7-086f-422e-88dc-70746b1b8320 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:25.189307 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957851c-52ce-4e0a-98a0-2318c5986144 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:25.240927 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63139e95-04c3-4a59-bab2-2e74ad66fa6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:25.242236 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63139e95-04c3-4a59-bab2-2e74ad66fa6f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:25.242753 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63139e95-04c3-4a59-bab2-2e74ad66fa6f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:25.243482 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:25.243951 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63139e95-04c3-4a59-bab2-2e74ad66fa6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:25.264013 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63139e95-04c3-4a59-bab2-2e74ad66fa6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:25.266590 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63139e95-04c3-4a59-bab2-2e74ad66fa6f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:25.289838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-63139e95-04c3-4a59-bab2-2e74ad66fa6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:25.289838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:25.289838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:25.289838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:25.289838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:25.289838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:25.289838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:25.289838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:25.289838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:25.289838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:25.289838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:25.289838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:25.289838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:25.289838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:25.289838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:25.289838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:25.290862 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:25.290862 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:25.290862 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:25.290862 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:25.290862 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:25.290862 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:25.290862 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:25.290862 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:25.290862 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:25.290862 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:25.290862 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:25.290862 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:25.290862 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:25.290862 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:25.290862 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:25.290862 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:25.290862 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:25.291711 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:25.291711 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:25.291711 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:25.294209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 239/469] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:25.296034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3cc82-a45a-4b69-9f35-32d4638137fa None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:25.296676 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3cc82-a45a-4b69-9f35-32d4638137fa None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:25.300314 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3cc82-a45a-4b69-9f35-32d4638137fa None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:25.307620 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 240/470] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:25.309198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3cc82-a45a-4b69-9f35-32d4638137fa None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:25.315006 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad944fe7-086f-422e-88dc-70746b1b8320 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:25.329670 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:25.357711 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c2dfb-187e-4f65-b12e-20bfe3fcb8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:25.358322 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c2dfb-187e-4f65-b12e-20bfe3fcb8dd None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:25.358603 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c2dfb-187e-4f65-b12e-20bfe3fcb8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:25.358936 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c2dfb-187e-4f65-b12e-20bfe3fcb8dd None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:25.359630 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c2dfb-187e-4f65-b12e-20bfe3fcb8dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:25.361516 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c2dfb-187e-4f65-b12e-20bfe3fcb8dd None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:25.389161 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 231/471] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 26 05:30:25 2022] POST /identity/v3/users => generated 246 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:25.391035 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1720d1-59d0-485d-8a03-197c5a8103d8 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:25.391557 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1720d1-59d0-485d-8a03-197c5a8103d8 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:25.392064 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1720d1-59d0-485d-8a03-197c5a8103d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:25.413833 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-fc1720d1-59d0-485d-8a03-197c5a8103d8 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:25.415894 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-fc1720d1-59d0-485d-8a03-197c5a8103d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:25.453005 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3cc82-a45a-4b69-9f35-32d4638137fa None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:25.499884 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650e52d-5692-4a34-8c61-760a6eeedf11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:25.500541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650e52d-5692-4a34-8c61-760a6eeedf11 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:25.500817 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650e52d-5692-4a34-8c61-760a6eeedf11 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:25.501086 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650e52d-5692-4a34-8c61-760a6eeedf11 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:25.501919 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650e52d-5692-4a34-8c61-760a6eeedf11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:25.502269 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650e52d-5692-4a34-8c61-760a6eeedf11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:25.504973 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650e52d-5692-4a34-8c61-760a6eeedf11 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:25.523609 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 241/472] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:25.524613 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650e52d-5692-4a34-8c61-760a6eeedf11 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:25.538467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 232/473] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:30:25.539587 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1720d1-59d0-485d-8a03-197c5a8103d8 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:25.587050 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:25.679009 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1720d1-59d0-485d-8a03-197c5a8103d8 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:25.691448 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:25.742724 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650e52d-5692-4a34-8c61-760a6eeedf11 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:25.763001 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a624a98-28a4-4c97-a3cd-e50496434ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:25.764098 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a624a98-28a4-4c97-a3cd-e50496434ef5 None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:25.764761 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a624a98-28a4-4c97-a3cd-e50496434ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:25.765437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a624a98-28a4-4c97-a3cd-e50496434ef5 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:25.766719 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a624a98-28a4-4c97-a3cd-e50496434ef5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:25.770887 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a624a98-28a4-4c97-a3cd-e50496434ef5 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:25.812033 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 233/474] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 26 05:30:25 2022] POST /identity/v3/users => generated 248 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:25.832093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a27d0-7713-4977-942d-ea8e06eb620f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:25.833483 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a27d0-7713-4977-942d-ea8e06eb620f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:25.834163 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a27d0-7713-4977-942d-ea8e06eb620f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:25.834772 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a27d0-7713-4977-942d-ea8e06eb620f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:25.860571 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a27d0-7713-4977-942d-ea8e06eb620f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:25.864110 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a27d0-7713-4977-942d-ea8e06eb620f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:25.888401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-1e7a27d0-7713-4977-942d-ea8e06eb620f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:25.888401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:25.888401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:25.888401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:25.888401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:25.888401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:25.888401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:25.888401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:25.888401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:25.888401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:25.888401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:25.888401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:25.888401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:25.888401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:25.888401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:25.888401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:25.890436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:25.890436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:25.890436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:25.890436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:25.890436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:25.890436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:25.890436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:25.890436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:25.890436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:25.890436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:25.890436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:25.890436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:25.890436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:25.890436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:25.890436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:25.890436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:25.890436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:25.892518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:25.892518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:25.892518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:25.892518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 242/475] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:25.898804 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a27d0-7713-4977-942d-ea8e06eb620f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:25.899078 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a624a98-28a4-4c97-a3cd-e50496434ef5 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:26.113560 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a27d0-7713-4977-942d-ea8e06eb620f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:26.118123 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:26.133152 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a624a98-28a4-4c97-a3cd-e50496434ef5 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:26.152004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:26.171860 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce1bec-72d5-47a2-a16b-8d84a52eafd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:26.172944 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce1bec-72d5-47a2-a16b-8d84a52eafd2 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:26.173415 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce1bec-72d5-47a2-a16b-8d84a52eafd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:26.173857 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce1bec-72d5-47a2-a16b-8d84a52eafd2 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:26.174711 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce1bec-72d5-47a2-a16b-8d84a52eafd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:26.175235 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce1bec-72d5-47a2-a16b-8d84a52eafd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:26.177031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce1bec-72d5-47a2-a16b-8d84a52eafd2 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:26.186130 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f58bfa-fc33-4755-a66c-39d562351746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:26.187080 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f58bfa-fc33-4755-a66c-39d562351746 None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:26.187543 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f58bfa-fc33-4755-a66c-39d562351746 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:26.188102 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f58bfa-fc33-4755-a66c-39d562351746 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:26.189185 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f58bfa-fc33-4755-a66c-39d562351746 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:26.190862 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f58bfa-fc33-4755-a66c-39d562351746 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:26.192612 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 243/476] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:26.199299 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce1bec-72d5-47a2-a16b-8d84a52eafd2 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:26.208546 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.sql.core [None req-e8f58bfa-fc33-4755-a66c-39d562351746 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 26 05:30:26.208546 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 26 05:30:26.208546 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [parameters: {'id': 'd6b49c61ea4843acb0972df7a8e7a06e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 26 05:30:26.208546 dv-cinder-836083-14-smb devstack@keystone.service[81682]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81682) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 26 05:30:26.227707 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-e8f58bfa-fc33-4755-a66c-39d562351746 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 26 05:30:26.227707 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:26.227707 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 05:30:26.227707 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 05:30:26.227707 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 05:30:26.227707 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 05:30:26.227707 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 05:30:26.227707 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 05:30:26.227707 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 05:30:26.227707 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application conn.query(q) Sep 26 05:30:26.227707 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 05:30:26.227707 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 05:30:26.227707 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 05:30:26.227707 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application result.read() Sep 26 05:30:26.227707 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 05:30:26.228920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 05:30:26.228920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 05:30:26.228920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 05:30:26.228920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 05:30:26.228920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 05:30:26.228920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 05:30:26.228920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 05:30:26.228920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 26 05:30:26.228920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:26.228920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 26 05:30:26.228920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:26.228920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:26.228920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 26 05:30:26.228920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 26 05:30:26.228920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 26 05:30:26.228920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return ref.to_dict() Sep 26 05:30:26.228920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 05:30:26.228920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application next(self.gen) Sep 26 05:30:26.230112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 26 05:30:26.230112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application yield resource Sep 26 05:30:26.230112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 05:30:26.230112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application next(self.gen) Sep 26 05:30:26.230112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 26 05:30:26.230112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self.session.rollback() Sep 26 05:30:26.230112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 26 05:30:26.230112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self.force_reraise() Sep 26 05:30:26.230112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 26 05:30:26.230112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise self.value Sep 26 05:30:26.230112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 26 05:30:26.230112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 26 05:30:26.230112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 26 05:30:26.230112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application session.commit() Sep 26 05:30:26.230112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 26 05:30:26.230112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 26 05:30:26.230112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 26 05:30:26.231244 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._prepare_impl() Sep 26 05:30:26.231244 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 26 05:30:26.231244 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self.session.flush() Sep 26 05:30:26.231244 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 26 05:30:26.231244 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._flush(objects) Sep 26 05:30:26.231244 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 26 05:30:26.231244 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 26 05:30:26.231244 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 26 05:30:26.231244 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application compat.raise_( Sep 26 05:30:26.231244 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 05:30:26.231244 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception Sep 26 05:30:26.231244 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 26 05:30:26.231244 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application flush_context.execute() Sep 26 05:30:26.231244 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 26 05:30:26.231244 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rec.execute(self) Sep 26 05:30:26.231244 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 26 05:30:26.231244 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 26 05:30:26.232391 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 26 05:30:26.232391 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 26 05:30:26.232391 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 26 05:30:26.232391 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 26 05:30:26.232391 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 26 05:30:26.232391 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 26 05:30:26.232391 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 26 05:30:26.232391 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 26 05:30:26.232391 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 26 05:30:26.232391 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 26 05:30:26.232391 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 26 05:30:26.232391 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 26 05:30:26.232391 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 26 05:30:26.232391 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 26 05:30:26.232391 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 05:30:26.232391 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception Sep 26 05:30:26.233428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 05:30:26.233428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 05:30:26.233428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 05:30:26.233428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 05:30:26.233428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 05:30:26.233428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 05:30:26.233428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 05:30:26.233428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application conn.query(q) Sep 26 05:30:26.233428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 05:30:26.233428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 05:30:26.233428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 05:30:26.233428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application result.read() Sep 26 05:30:26.233428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 05:30:26.233428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 05:30:26.233428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 05:30:26.233428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 05:30:26.234401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 05:30:26.234401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 05:30:26.234401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 05:30:26.234401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 05:30:26.234401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 26 05:30:26.234401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 26 05:30:26.234401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [parameters: {'id': 'd6b49c61ea4843acb0972df7a8e7a06e', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 26 05:30:26.234401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 26 05:30:26.234401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:26.234401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:30:26.234401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:26.234401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:26.234401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:26.234401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:26.234401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:26.234401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:26.235439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:26.235439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:26.235439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:26.235439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:26.235439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:26.235439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:26.235439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 26 05:30:26.235439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 26 05:30:26.235439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:26.235439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:26.235439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 26 05:30:26.235439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 26 05:30:26.235439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 26 05:30:26.235439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 26 05:30:26.235439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 26 05:30:26.235439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:26.239364 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 234/477] 10.222.0.66 () {60 vars in 1131 bytes} [Mon Sep 26 05:30:25 2022] POST /identity/v3/roles => generated 144 bytes in 350 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:26.248710 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f58bfa-fc33-4755-a66c-39d562351746 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:26.345208 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce1bec-72d5-47a2-a16b-8d84a52eafd2 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:26.391549 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e9f2f-fb71-4c7b-81a0-96f505d68df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:26.392426 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e9f2f-fb71-4c7b-81a0-96f505d68df8 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:26.392842 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e9f2f-fb71-4c7b-81a0-96f505d68df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:26.393265 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e9f2f-fb71-4c7b-81a0-96f505d68df8 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:26.394072 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e9f2f-fb71-4c7b-81a0-96f505d68df8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:26.399557 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e9f2f-fb71-4c7b-81a0-96f505d68df8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:26.445261 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f58bfa-fc33-4755-a66c-39d562351746 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:26.454387 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 244/478] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 26 05:30:26 2022] POST /identity/v3/users => generated 249 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:26.523549 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac4d54-2c36-45b7-909c-a07de535d076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:26.524570 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac4d54-2c36-45b7-909c-a07de535d076 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:26.524996 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac4d54-2c36-45b7-909c-a07de535d076 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:26.525409 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac4d54-2c36-45b7-909c-a07de535d076 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:26.543781 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac4d54-2c36-45b7-909c-a07de535d076 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:30:26.549783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-31ac4d54-2c36-45b7-909c-a07de535d076 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:30:26.549783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:26.549783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:26.549783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:26.549783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:26.549783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:26.549783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:26.549783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:26.549783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:26.549783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:26.549783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:26.549783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:26.549783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:30:26.549783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:30:26.549783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:30:26.549783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:30:26.550762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:30:26.550762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:30:26.550762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:30:26.550762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:30:26.550762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:26.550762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:26.550762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:26.550762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:26.550762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:26.550762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:26.550762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:26.550762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:26.550762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:26.550762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:26.550762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:26.550762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:26.551582 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:26.551582 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:26.551582 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:26.551582 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:26.551582 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:30:26.551582 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:30:26.551582 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:30:26.551582 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:30:26.551582 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:30:26.551582 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:30:26.551582 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 26 05:30:26.551582 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:26.562387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 235/479] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 26 05:30:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:26.573170 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e9f2f-fb71-4c7b-81a0-96f505d68df8 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:26.654445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:26.775313 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e9f2f-fb71-4c7b-81a0-96f505d68df8 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:26.814548 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a68b560-28b7-424b-b05d-515d1e6b938b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:26.815455 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68b560-28b7-424b-b05d-515d1e6b938b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:26.815913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68b560-28b7-424b-b05d-515d1e6b938b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:26.816397 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a68b560-28b7-424b-b05d-515d1e6b938b None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:26.817271 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68b560-28b7-424b-b05d-515d1e6b938b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:26.817696 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68b560-28b7-424b-b05d-515d1e6b938b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:26.819293 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a68b560-28b7-424b-b05d-515d1e6b938b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:26.830330 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 245/480] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:30:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:27.933471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd955f-fe09-499f-8ec5-f1162ada3cbf None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:27.934020 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd955f-fe09-499f-8ec5-f1162ada3cbf None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:27.934418 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd955f-fe09-499f-8ec5-f1162ada3cbf None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:27.939858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 236/481] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:27.949330 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bf192-d737-4af2-94f5-7b35d3ba786f None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:27.949330 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bf192-d737-4af2-94f5-7b35d3ba786f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:27.949330 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45bf192-d737-4af2-94f5-7b35d3ba786f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:27.980876 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-e45bf192-d737-4af2-94f5-7b35d3ba786f None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:27.982456 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e45bf192-d737-4af2-94f5-7b35d3ba786f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:28.174456 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 246/482] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:30:28.531781 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd955f-fe09-499f-8ec5-f1162ada3cbf None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:28.569574 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:28.712616 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd955f-fe09-499f-8ec5-f1162ada3cbf None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:28.752985 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719be558-8556-4393-8d23-320ec9110faf None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:28.753648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719be558-8556-4393-8d23-320ec9110faf None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:28.754142 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719be558-8556-4393-8d23-320ec9110faf None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:28.756050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 247/483] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:28.762116 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ca3e7-5522-498b-8feb-ea81cd23d4db None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:28.762706 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ca3e7-5522-498b-8feb-ea81cd23d4db None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:28.763168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ca3e7-5522-498b-8feb-ea81cd23d4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:28.823854 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-bc9ca3e7-5522-498b-8feb-ea81cd23d4db None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:28.827758 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-bc9ca3e7-5522-498b-8feb-ea81cd23d4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:28.839768 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11cdfca-4504-4cad-a277-8b0849e98b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:28.843770 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11cdfca-4504-4cad-a277-8b0849e98b76 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:28.843770 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11cdfca-4504-4cad-a277-8b0849e98b76 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:28.843770 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11cdfca-4504-4cad-a277-8b0849e98b76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:28.879782 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11cdfca-4504-4cad-a277-8b0849e98b76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:30:28.891766 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-d11cdfca-4504-4cad-a277-8b0849e98b76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:30:28.891766 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:28.891766 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:28.891766 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:28.891766 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:28.891766 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:28.891766 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:28.891766 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:28.891766 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:28.891766 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:28.891766 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:28.891766 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:28.891766 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:30:28.891766 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:30:28.891766 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:30:28.891766 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:30:28.892748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:30:28.892748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:30:28.892748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:30:28.892748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:30:28.892748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:28.892748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:28.892748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:28.892748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:28.892748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:28.892748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:28.892748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:28.892748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:28.892748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:28.892748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:28.892748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:28.892748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:28.893539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:28.893539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:28.893539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:28.893539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:28.893539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:30:28.893539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:30:28.893539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:30:28.893539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:30:28.893539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:30:28.893539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:30:28.893539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:30:28.893539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:28.894154 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 237/484] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 26 05:30:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:28.900554 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11cdfca-4504-4cad-a277-8b0849e98b76 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:28.920205 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:29.014163 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 248/485] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:30:29.110524 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:29.168315 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11cdfca-4504-4cad-a277-8b0849e98b76 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:29.236584 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d9652-d31c-4564-bf43-acc832938feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:29.237225 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d9652-d31c-4564-bf43-acc832938feb None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:29.239773 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d9652-d31c-4564-bf43-acc832938feb None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:29.239773 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d9652-d31c-4564-bf43-acc832938feb None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:29.239773 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d9652-d31c-4564-bf43-acc832938feb None admin] RBAC: Adding query filter params (name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:29.239773 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d9652-d31c-4564-bf43-acc832938feb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:29.240264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d9652-d31c-4564-bf43-acc832938feb None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:29.250055 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 238/486] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 26 05:30:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:29.256715 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ca3e7-5522-498b-8feb-ea81cd23d4db None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:29.330397 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b3674-d160-473a-8c35-5a83a75dc9d1 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:29.331039 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b3674-d160-473a-8c35-5a83a75dc9d1 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:29.331505 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b3674-d160-473a-8c35-5a83a75dc9d1 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:29.333444 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 239/487] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:29.341349 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b531b0e-56c4-4633-8f53-ad12c6da71a7 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:29.341953 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b531b0e-56c4-4633-8f53-ad12c6da71a7 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:29.342418 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b531b0e-56c4-4633-8f53-ad12c6da71a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:29.378359 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-2b531b0e-56c4-4633-8f53-ad12c6da71a7 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:29.380777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2b531b0e-56c4-4633-8f53-ad12c6da71a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:29.472550 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ca3e7-5522-498b-8feb-ea81cd23d4db None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:29.531148 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 240/488] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:30:29.533025 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b531b0e-56c4-4633-8f53-ad12c6da71a7 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:29.570517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751d122-d524-4341-91b7-42345457f13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:29.570517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751d122-d524-4341-91b7-42345457f13b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:29.570517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751d122-d524-4341-91b7-42345457f13b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:29.570517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751d122-d524-4341-91b7-42345457f13b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:29.607764 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751d122-d524-4341-91b7-42345457f13b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:29.607963 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751d122-d524-4341-91b7-42345457f13b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:29.655846 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-b751d122-d524-4341-91b7-42345457f13b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:29.655846 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:29.655846 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:29.655846 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:29.655846 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:29.655846 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:29.655846 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:29.655846 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:29.655846 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:29.655846 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:29.655846 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:29.655846 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:29.655846 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:29.655846 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:29.655846 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:29.655846 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:29.656780 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:29.656780 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:29.656780 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:29.656780 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:29.656780 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:29.656780 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:29.656780 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:29.656780 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:29.656780 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:29.656780 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:29.656780 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:29.656780 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:29.656780 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:29.656780 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:29.656780 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:29.656780 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:29.656780 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:29.657658 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:29.657658 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:29.657658 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:29.659617 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 249/489] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 404 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:30:29.661934 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751d122-d524-4341-91b7-42345457f13b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:29.703914 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:29.720437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:29.795558 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b531b0e-56c4-4633-8f53-ad12c6da71a7 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:29.857661 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c66ec-8119-4075-9b52-24c8a0deb73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:29.859216 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c66ec-8119-4075-9b52-24c8a0deb73c None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:29.860182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c66ec-8119-4075-9b52-24c8a0deb73c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:29.860655 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c66ec-8119-4075-9b52-24c8a0deb73c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:29.876198 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c66ec-8119-4075-9b52-24c8a0deb73c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:30:29.886283 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751d122-d524-4341-91b7-42345457f13b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:29.888257 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-486c66ec-8119-4075-9b52-24c8a0deb73c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:30:29.888257 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:29.888257 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:29.888257 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:29.888257 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:29.888257 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:29.888257 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:29.888257 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:29.888257 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:29.888257 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:29.888257 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:29.888257 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:29.888257 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:30:29.888257 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:30:29.888257 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:30:29.888257 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:30:29.889764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:30:29.889764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:30:29.889764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:30:29.889764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:30:29.889764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:29.889764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:29.889764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:29.889764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:29.889764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:29.889764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:29.889764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:29.889764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:29.889764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:29.889764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:29.889764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:29.889764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:29.891142 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:29.891142 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:29.891142 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:29.891142 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:29.891142 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:30:29.891142 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:30:29.891142 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:30:29.891142 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:30:29.891142 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:30:29.891142 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:30:29.891142 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:30:29.891142 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:29.901909 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 241/490] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 26 05:30:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:29.901909 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d169e-3914-4aaf-9e33-c685589c885e None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:29.901909 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d169e-3914-4aaf-9e33-c685589c885e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:29.901909 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d169e-3914-4aaf-9e33-c685589c885e None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:29.901909 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 242/491] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:29.901909 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d169e-3914-4aaf-9e33-c685589c885e None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:29.959300 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c4bef-f0c0-4404-8304-9939258dfc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:29.960664 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c4bef-f0c0-4404-8304-9939258dfc4b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:29.960949 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c4bef-f0c0-4404-8304-9939258dfc4b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:29.961519 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c4bef-f0c0-4404-8304-9939258dfc4b None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:29.962446 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c4bef-f0c0-4404-8304-9939258dfc4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:29.963002 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c4bef-f0c0-4404-8304-9939258dfc4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:29.967782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c4bef-f0c0-4404-8304-9939258dfc4b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:29.990309 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 250/492] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:29.992024 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c4bef-f0c0-4404-8304-9939258dfc4b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:30.110626 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d169e-3914-4aaf-9e33-c685589c885e None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:30.163233 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:30.165189 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:30.181448 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567df6bd-52b4-4b91-bd59-514ac289c2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:30.182590 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567df6bd-52b4-4b91-bd59-514ac289c2cd None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:30.183191 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567df6bd-52b4-4b91-bd59-514ac289c2cd None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:30.183911 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567df6bd-52b4-4b91-bd59-514ac289c2cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:30.205648 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567df6bd-52b4-4b91-bd59-514ac289c2cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:30:30.216471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-567df6bd-52b4-4b91-bd59-514ac289c2cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:30:30.216471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:30.216471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:30.216471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:30.216471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:30.216471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:30.216471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:30.216471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:30.216471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:30.216471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:30.216471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:30.216471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:30.216471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:30:30.216471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:30:30.216471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:30:30.216471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:30:30.218175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:30:30.218175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:30:30.218175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:30:30.218175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:30:30.218175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:30.218175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:30.218175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:30.218175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:30.218175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:30.218175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:30.218175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:30.218175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:30.218175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:30.218175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:30.218175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:30.218175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:30.219685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:30.219685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:30.219685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:30.219685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:30.219685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:30:30.219685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:30:30.219685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:30:30.219685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:30:30.219685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:30:30.219685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:30:30.219685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:30:30.219685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:30.219685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 243/493] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 26 05:30:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:30.222578 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9965fc5-0786-4684-927b-97d3bb911864 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:30.222578 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9965fc5-0786-4684-927b-97d3bb911864 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:30.222578 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9965fc5-0786-4684-927b-97d3bb911864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:30.241115 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c4bef-f0c0-4404-8304-9939258dfc4b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:30.259455 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-c9965fc5-0786-4684-927b-97d3bb911864 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:30.261842 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c9965fc5-0786-4684-927b-97d3bb911864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:30.337320 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a68438-61cf-4e96-8b11-96603bd2d0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:30.338118 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a68438-61cf-4e96-8b11-96603bd2d0c5 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:30.338480 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a68438-61cf-4e96-8b11-96603bd2d0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:30.338854 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a68438-61cf-4e96-8b11-96603bd2d0c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:30.339561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a68438-61cf-4e96-8b11-96603bd2d0c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:30.339914 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a68438-61cf-4e96-8b11-96603bd2d0c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:30.342349 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a68438-61cf-4e96-8b11-96603bd2d0c5 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:30.362327 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 251/494] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 26 05:30:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:30.363564 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a68438-61cf-4e96-8b11-96603bd2d0c5 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:30.395771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 244/495] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:30:30.395771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9965fc5-0786-4684-927b-97d3bb911864 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:30.655849 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a68438-61cf-4e96-8b11-96603bd2d0c5 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:30.711756 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9965fc5-0786-4684-927b-97d3bb911864 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:30.723473 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d88abf-2753-42f0-916f-4105a3aba245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:30.724493 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d88abf-2753-42f0-916f-4105a3aba245 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:30.724925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d88abf-2753-42f0-916f-4105a3aba245 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:30.725334 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d88abf-2753-42f0-916f-4105a3aba245 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:30.728784 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:30.736488 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d88abf-2753-42f0-916f-4105a3aba245 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:30.738264 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d88abf-2753-42f0-916f-4105a3aba245 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:30.748062 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:30.752865 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-82d88abf-2753-42f0-916f-4105a3aba245 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 26 05:30:30.752865 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:30.752865 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:30.752865 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:30.752865 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:30.752865 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:30.752865 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:30.752865 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:30.752865 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:30.752865 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:30.752865 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:30.752865 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:30.752865 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:30:30.752865 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:30:30.752865 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:30:30.752865 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:30:30.753817 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:30.753817 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:30.753817 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:30:30.753817 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:30:30.753817 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:30:30.753817 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:30:30.753817 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:30.753817 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:30.753817 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:30.753817 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:30.753817 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:30.753817 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:30.753817 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:30.753817 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:30.753817 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:30.753817 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:30.753817 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:30.753817 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:30.754706 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:30.754706 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:30.754706 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:30:30.754706 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:30:30.754706 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:30:30.754706 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:30:30.754706 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:30:30.754706 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:30:30.754706 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 26 05:30:30.754706 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:30.756933 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 252/496] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:30:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:30.758031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d88abf-2753-42f0-916f-4105a3aba245 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:30.792445 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76878c97-b08c-46fa-aeb6-a603607a98e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:30.793510 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76878c97-b08c-46fa-aeb6-a603607a98e5 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:30.794047 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76878c97-b08c-46fa-aeb6-a603607a98e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:30.795098 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76878c97-b08c-46fa-aeb6-a603607a98e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:30.796947 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76878c97-b08c-46fa-aeb6-a603607a98e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:30.797902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76878c97-b08c-46fa-aeb6-a603607a98e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:30.801609 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76878c97-b08c-46fa-aeb6-a603607a98e5 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:30.823936 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 245/497] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 26 05:30:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:30.825843 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76878c97-b08c-46fa-aeb6-a603607a98e5 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:30.890494 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d88abf-2753-42f0-916f-4105a3aba245 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:30.943641 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3a9d6-8633-4439-85f9-8a050b59ebe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:30.944433 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3a9d6-8633-4439-85f9-8a050b59ebe1 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:30.944774 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3a9d6-8633-4439-85f9-8a050b59ebe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:30.945082 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3a9d6-8633-4439-85f9-8a050b59ebe1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:30.958093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3a9d6-8633-4439-85f9-8a050b59ebe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:30.960796 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d3a9d6-8633-4439-85f9-8a050b59ebe1 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:30.985451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-53d3a9d6-8633-4439-85f9-8a050b59ebe1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:30.985451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:30.985451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:30.985451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:30.985451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:30.985451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:30.985451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:30.985451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:30.985451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:30.985451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:30.985451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:30.985451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:30.985451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:30.985451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:30.985451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:30.985451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:30.986574 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:30.986574 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:30.986574 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:30.986574 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:30.986574 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:30.986574 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:30.986574 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:30.986574 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:30.986574 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:30.986574 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:30.986574 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:30.986574 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:30.986574 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:30.986574 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:30.986574 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:30.986574 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:30.986574 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:30.987579 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:30.987579 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:30.987579 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:30.988540 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 253/498] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:30.989138 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3a9d6-8633-4439-85f9-8a050b59ebe1 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:31.018980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76878c97-b08c-46fa-aeb6-a603607a98e5 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:31.052740 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:31.066321 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b759e7-8b01-4ac6-a6d3-a21885f57f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:31.067372 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b759e7-8b01-4ac6-a6d3-a21885f57f45 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:31.067889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b759e7-8b01-4ac6-a6d3-a21885f57f45 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:31.068325 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b759e7-8b01-4ac6-a6d3-a21885f57f45 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:31.082503 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b759e7-8b01-4ac6-a6d3-a21885f57f45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:30:31.087686 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-79b759e7-8b01-4ac6-a6d3-a21885f57f45 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:30:31.087686 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:31.087686 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:31.087686 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:31.087686 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:31.087686 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:31.087686 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:31.087686 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:31.087686 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:31.087686 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:31.087686 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:31.087686 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:31.087686 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:30:31.087686 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:30:31.087686 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:30:31.087686 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:30:31.088670 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:30:31.088670 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:30:31.088670 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:30:31.088670 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:30:31.088670 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:31.088670 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:31.088670 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:31.088670 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:31.088670 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:31.088670 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:31.088670 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:31.088670 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:31.088670 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:31.088670 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:31.088670 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:31.088670 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:31.089468 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:31.089468 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:31.089468 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:31.089468 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:31.089468 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:30:31.089468 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:30:31.089468 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:30:31.089468 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:30:31.089468 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:30:31.089468 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:30:31.089468 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:30:31.089468 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:31.089468 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 246/499] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 26 05:30:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:31.090144 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b759e7-8b01-4ac6-a6d3-a21885f57f45 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:31.141859 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d3a9d6-8633-4439-85f9-8a050b59ebe1 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:31.149333 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:31.185332 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedd457-f052-47e2-ba86-9cef8d443592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:31.185972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedd457-f052-47e2-ba86-9cef8d443592 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:31.186142 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedd457-f052-47e2-ba86-9cef8d443592 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:31.186381 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedd457-f052-47e2-ba86-9cef8d443592 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:31.187139 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedd457-f052-47e2-ba86-9cef8d443592 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:31.187441 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedd457-f052-47e2-ba86-9cef8d443592 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:31.188998 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedd457-f052-47e2-ba86-9cef8d443592 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:31.242696 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b759e7-8b01-4ac6-a6d3-a21885f57f45 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:31.245433 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 254/500] 10.222.0.66 () {56 vars in 1137 bytes} [Mon Sep 26 05:30:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:31.248645 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c49adb-6777-4092-a56a-74a92e95415c None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:31.250162 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c49adb-6777-4092-a56a-74a92e95415c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:31.251174 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c49adb-6777-4092-a56a-74a92e95415c None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:31.254275 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 255/501] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:31.255282 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c49adb-6777-4092-a56a-74a92e95415c None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:31.283905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ec261-9ceb-4f4e-94d9-7da6a47d8dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:31.284686 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ec261-9ceb-4f4e-94d9-7da6a47d8dfe None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:31.284862 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ec261-9ceb-4f4e-94d9-7da6a47d8dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:31.285151 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ec261-9ceb-4f4e-94d9-7da6a47d8dfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:31.297982 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ec261-9ceb-4f4e-94d9-7da6a47d8dfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:31.299469 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ec261-9ceb-4f4e-94d9-7da6a47d8dfe None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:31.314642 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-978ec261-9ceb-4f4e-94d9-7da6a47d8dfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:31.314642 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:31.314642 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:31.314642 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:31.314642 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:31.314642 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:31.314642 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:31.314642 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:31.314642 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:31.314642 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:31.314642 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:31.314642 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:31.314642 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:31.314642 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:31.314642 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:31.314642 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:31.316005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:31.316005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:31.316005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:31.316005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:31.316005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:31.316005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:31.316005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:31.316005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:31.316005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:31.316005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:31.316005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:31.316005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:31.316005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:31.316005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:31.316005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:31.316005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:31.316005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:31.317234 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:31.317234 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:31.317234 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:31.317234 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 247/502] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:31.317234 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ec261-9ceb-4f4e-94d9-7da6a47d8dfe None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:31.403610 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c49adb-6777-4092-a56a-74a92e95415c None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:31.417169 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:31.417859 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:31.428659 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ec261-9ceb-4f4e-94d9-7da6a47d8dfe None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:31.454766 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e389c57-421f-4883-bb3e-7c8e659901c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:31.455853 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e389c57-421f-4883-bb3e-7c8e659901c8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:31.456327 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e389c57-421f-4883-bb3e-7c8e659901c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:31.456801 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e389c57-421f-4883-bb3e-7c8e659901c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:31.457940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e389c57-421f-4883-bb3e-7c8e659901c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:31.458466 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e389c57-421f-4883-bb3e-7c8e659901c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:31.460299 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e389c57-421f-4883-bb3e-7c8e659901c8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:31.473260 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 256/503] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:31.473680 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8baf80a-51b9-4e39-be96-c66e0174f792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:31.474294 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8baf80a-51b9-4e39-be96-c66e0174f792 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:31.474378 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e389c57-421f-4883-bb3e-7c8e659901c8 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:31.474632 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8baf80a-51b9-4e39-be96-c66e0174f792 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:31.474900 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8baf80a-51b9-4e39-be96-c66e0174f792 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:31.475561 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8baf80a-51b9-4e39-be96-c66e0174f792 None admin] RBAC: Adding query filter params (name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:31.475892 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8baf80a-51b9-4e39-be96-c66e0174f792 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:31.477324 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8baf80a-51b9-4e39-be96-c66e0174f792 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:31.486341 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 248/504] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 26 05:30:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:31.487593 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89758f0-84df-4303-bf9a-8f26d5628630 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:31.487943 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89758f0-84df-4303-bf9a-8f26d5628630 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:31.488212 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89758f0-84df-4303-bf9a-8f26d5628630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:31.508050 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-e89758f0-84df-4303-bf9a-8f26d5628630 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:31.509202 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e89758f0-84df-4303-bf9a-8f26d5628630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:31.600027 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 249/505] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:30:31.600989 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89758f0-84df-4303-bf9a-8f26d5628630 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:31.603837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e389c57-421f-4883-bb3e-7c8e659901c8 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:31.672626 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208ec39-7602-4109-ad76-ac0505e8d971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:31.673937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208ec39-7602-4109-ad76-ac0505e8d971 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:31.674573 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208ec39-7602-4109-ad76-ac0505e8d971 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:31.675138 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208ec39-7602-4109-ad76-ac0505e8d971 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:31.744671 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:31.793513 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:31.820754 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c208ec39-7602-4109-ad76-ac0505e8d971 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:31.822984 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c208ec39-7602-4109-ad76-ac0505e8d971 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:31.839180 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89758f0-84df-4303-bf9a-8f26d5628630 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:31.899350 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78120b-b2df-4699-bbe0-6c4580d02866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:31.900019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78120b-b2df-4699-bbe0-6c4580d02866 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:31.900333 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78120b-b2df-4699-bbe0-6c4580d02866 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:31.901200 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78120b-b2df-4699-bbe0-6c4580d02866 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:31.901860 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78120b-b2df-4699-bbe0-6c4580d02866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:31.902162 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78120b-b2df-4699-bbe0-6c4580d02866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:31.903560 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb78120b-b2df-4699-bbe0-6c4580d02866 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:31.919339 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 250/506] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:31.920257 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78120b-b2df-4699-bbe0-6c4580d02866 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:31.993324 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 257/507] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:30:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:31.994664 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208ec39-7602-4109-ad76-ac0505e8d971 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:32.059755 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78120b-b2df-4699-bbe0-6c4580d02866 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:32.069626 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:32.109666 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208ec39-7602-4109-ad76-ac0505e8d971 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:32.119607 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7791c-3f27-4181-b424-68c0e0f2489b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:32.120645 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7791c-3f27-4181-b424-68c0e0f2489b None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:32.121130 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7791c-3f27-4181-b424-68c0e0f2489b None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:32.121621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7791c-3f27-4181-b424-68c0e0f2489b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:32.135866 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7791c-3f27-4181-b424-68c0e0f2489b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:32.138682 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7791c-3f27-4181-b424-68c0e0f2489b None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:32.147490 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ac88e-8ab7-4323-98b3-0fe731f3df5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:32.148223 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ac88e-8ab7-4323-98b3-0fe731f3df5a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:32.148499 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ac88e-8ab7-4323-98b3-0fe731f3df5a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:32.148768 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ac88e-8ab7-4323-98b3-0fe731f3df5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:32.160276 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ac88e-8ab7-4323-98b3-0fe731f3df5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:32.161887 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ac88e-8ab7-4323-98b3-0fe731f3df5a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:32.162264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-dfd7791c-3f27-4181-b424-68c0e0f2489b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:30:32.162264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:32.162264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:32.162264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:32.162264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:32.162264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:32.162264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:32.162264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:32.162264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:32.162264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:32.162264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:32.162264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:32.162264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:30:32.162264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:30:32.162264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:30:32.162264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:30:32.163982 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:32.163982 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:32.163982 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:30:32.163982 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:30:32.163982 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:30:32.163982 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:30:32.163982 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:32.163982 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:32.163982 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:32.163982 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:32.163982 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:32.163982 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:32.163982 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:32.163982 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:32.163982 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:32.163982 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:32.163982 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:32.163982 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:32.165060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:32.165060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:32.165060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:30:32.165060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:30:32.165060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:30:32.165060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:30:32.165060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:30:32.165060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:30:32.165060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:30:32.165060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:32.165060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 251/508] 10.222.0.66 () {56 vars in 1093 bytes} [Mon Sep 26 05:30:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:32.166176 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7791c-3f27-4181-b424-68c0e0f2489b None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:32.172580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:32.181868 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-857ac88e-8ab7-4323-98b3-0fe731f3df5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:32.181868 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:32.181868 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:32.181868 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:32.181868 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:32.181868 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:32.181868 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:32.181868 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:32.181868 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:32.181868 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:32.181868 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:32.181868 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:32.181868 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:32.181868 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:32.181868 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:32.181868 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:32.183521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:32.183521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:32.183521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:32.183521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:32.183521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:32.183521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:32.183521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:32.183521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:32.183521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:32.183521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:32.183521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:32.183521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:32.183521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:32.183521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:32.183521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:32.183521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:32.183521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:32.186369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:32.186369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:32.186369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:32.186369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 258/509] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:32.186369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ac88e-8ab7-4323-98b3-0fe731f3df5a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:32.303967 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ac88e-8ab7-4323-98b3-0fe731f3df5a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:32.318856 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7791c-3f27-4181-b424-68c0e0f2489b None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:32.325733 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:32.346258 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429255c-2b03-44f9-a230-4b1ea3c594f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:32.346893 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429255c-2b03-44f9-a230-4b1ea3c594f5 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:32.347167 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429255c-2b03-44f9-a230-4b1ea3c594f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:32.347440 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429255c-2b03-44f9-a230-4b1ea3c594f5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:32.355634 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429255c-2b03-44f9-a230-4b1ea3c594f5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:32.357140 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429255c-2b03-44f9-a230-4b1ea3c594f5 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:32.359502 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8c03f-5c0c-45e5-9eac-6d6068743d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:32.360263 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8c03f-5c0c-45e5-9eac-6d6068743d5a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:32.360568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8c03f-5c0c-45e5-9eac-6d6068743d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:32.360871 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8c03f-5c0c-45e5-9eac-6d6068743d5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:32.369587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-6429255c-2b03-44f9-a230-4b1ea3c594f5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 05:30:32.369587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:32.369587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:32.369587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:32.369587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:32.369587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:32.369587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:32.369587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:32.369587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:32.369587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:32.369587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:32.369587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:32.369587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:30:32.369587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:30:32.369587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:30:32.369587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:30:32.370812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:32.370812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:32.370812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:30:32.370812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:30:32.370812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:30:32.370812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:30:32.370812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:32.370812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:32.370812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:32.370812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:32.370812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:32.370812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:32.370812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:32.370812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:32.370812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:32.370812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:32.370812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:32.370812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:32.371811 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:32.371811 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:32.371811 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:30:32.371811 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:30:32.371811 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:30:32.371811 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:30:32.371811 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:30:32.371811 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:30:32.371811 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 05:30:32.371811 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:32.371811 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 259/510] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:30:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:32.371811 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429255c-2b03-44f9-a230-4b1ea3c594f5 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:32.375133 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8c03f-5c0c-45e5-9eac-6d6068743d5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:32.377892 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8c03f-5c0c-45e5-9eac-6d6068743d5a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:32.398325 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-2da8c03f-5c0c-45e5-9eac-6d6068743d5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:32.398325 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:32.398325 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:32.398325 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:32.398325 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:32.398325 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:32.398325 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:32.398325 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:32.398325 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:32.398325 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:32.398325 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:32.398325 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:32.398325 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:32.398325 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:32.398325 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:32.398325 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:32.401467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:32.401467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:32.401467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:32.401467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:32.401467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:32.401467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:32.401467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:32.401467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:32.401467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:32.401467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:32.401467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:32.401467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:32.401467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:32.401467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:32.401467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:32.401467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:32.401467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:32.404013 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:32.404013 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:32.404013 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:32.404013 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 252/511] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:32.404013 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8c03f-5c0c-45e5-9eac-6d6068743d5a None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:32.473343 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:32.489785 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429255c-2b03-44f9-a230-4b1ea3c594f5 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:32.531213 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f22a4c-210c-48d6-9f35-1feda227198a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:32.531913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f22a4c-210c-48d6-9f35-1feda227198a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:32.532190 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f22a4c-210c-48d6-9f35-1feda227198a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:32.532461 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f22a4c-210c-48d6-9f35-1feda227198a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:32.538550 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8c03f-5c0c-45e5-9eac-6d6068743d5a None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:32.544999 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f22a4c-210c-48d6-9f35-1feda227198a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:32.546517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f22a4c-210c-48d6-9f35-1feda227198a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:32.564661 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-21f22a4c-210c-48d6-9f35-1feda227198a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:32.564661 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:32.564661 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:32.564661 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:32.564661 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:32.564661 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:32.564661 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:32.564661 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:32.564661 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:32.564661 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:32.564661 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:32.564661 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:32.564661 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:32.564661 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:32.564661 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:32.564661 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:32.565898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:32.565898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:32.565898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:32.565898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:32.565898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:32.565898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:32.565898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:32.565898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:32.565898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:32.565898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:32.565898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:32.565898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:32.565898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:32.565898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:32.565898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:32.565898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:32.565898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:32.567476 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:32.567476 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:32.567476 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:32.567476 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 260/512] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:32.567476 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f22a4c-210c-48d6-9f35-1feda227198a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:32.594040 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aaeba3-d020-418a-9400-485a05d7caa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:32.594621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aaeba3-d020-418a-9400-485a05d7caa8 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:32.594895 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aaeba3-d020-418a-9400-485a05d7caa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:32.595160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aaeba3-d020-418a-9400-485a05d7caa8 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:32.595932 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aaeba3-d020-418a-9400-485a05d7caa8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:32.596236 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aaeba3-d020-418a-9400-485a05d7caa8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:32.597694 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aaeba3-d020-418a-9400-485a05d7caa8 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:32.602594 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:32.640858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 253/513] 10.222.0.66 () {56 vars in 1133 bytes} [Mon Sep 26 05:30:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:32.641734 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aaeba3-d020-418a-9400-485a05d7caa8 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:32.692879 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f22a4c-210c-48d6-9f35-1feda227198a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:32.741595 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f13dd-15e2-4d16-b614-769b3c61cfd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:32.742393 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f13dd-15e2-4d16-b614-769b3c61cfd3 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:32.742729 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f13dd-15e2-4d16-b614-769b3c61cfd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:32.743044 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f13dd-15e2-4d16-b614-769b3c61cfd3 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:32.743862 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f13dd-15e2-4d16-b614-769b3c61cfd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:32.744265 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f13dd-15e2-4d16-b614-769b3c61cfd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:32.746294 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f13dd-15e2-4d16-b614-769b3c61cfd3 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:32.770028 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 261/514] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:32.770028 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f13dd-15e2-4d16-b614-769b3c61cfd3 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:32.772400 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aaeba3-d020-418a-9400-485a05d7caa8 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:32.797455 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:32.831330 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cbcb32-8d0c-44dd-8c75-719a5eb0ddb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:32.835818 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbcb32-8d0c-44dd-8c75-719a5eb0ddb2 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:32.836507 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbcb32-8d0c-44dd-8c75-719a5eb0ddb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:32.837137 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cbcb32-8d0c-44dd-8c75-719a5eb0ddb2 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:32.841239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cbcb32-8d0c-44dd-8c75-719a5eb0ddb2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:32.841876 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cbcb32-8d0c-44dd-8c75-719a5eb0ddb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:32.844532 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cbcb32-8d0c-44dd-8c75-719a5eb0ddb2 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:32.874558 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 254/515] 10.222.0.66 () {56 vars in 1137 bytes} [Mon Sep 26 05:30:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:32.876126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cbcb32-8d0c-44dd-8c75-719a5eb0ddb2 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:32.918819 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:32.935349 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f13dd-15e2-4d16-b614-769b3c61cfd3 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:32.988798 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210276f-f1ec-4d8a-8f10-1be90441acf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:32.989400 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210276f-f1ec-4d8a-8f10-1be90441acf8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:32.989670 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210276f-f1ec-4d8a-8f10-1be90441acf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:32.989934 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210276f-f1ec-4d8a-8f10-1be90441acf8 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:32.990585 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210276f-f1ec-4d8a-8f10-1be90441acf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:32.990877 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210276f-f1ec-4d8a-8f10-1be90441acf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:32.994858 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210276f-f1ec-4d8a-8f10-1be90441acf8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:33.008201 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 262/516] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:33.008846 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210276f-f1ec-4d8a-8f10-1be90441acf8 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:33.040424 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cbcb32-8d0c-44dd-8c75-719a5eb0ddb2 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:33.092184 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd0fe5-2a89-425b-b4a1-0f91e5d00df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:33.092819 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd0fe5-2a89-425b-b4a1-0f91e5d00df8 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:33.093109 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd0fe5-2a89-425b-b4a1-0f91e5d00df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:33.093497 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd0fe5-2a89-425b-b4a1-0f91e5d00df8 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:33.094108 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd0fe5-2a89-425b-b4a1-0f91e5d00df8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:33.094403 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd0fe5-2a89-425b-b4a1-0f91e5d00df8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:33.095881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd0fe5-2a89-425b-b4a1-0f91e5d00df8 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:33.108722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 255/517] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:33.109795 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd0fe5-2a89-425b-b4a1-0f91e5d00df8 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:33.149075 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:33.149289 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210276f-f1ec-4d8a-8f10-1be90441acf8 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:33.191179 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12610fc-80aa-410e-a953-a71c2ccf7fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:33.192290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12610fc-80aa-410e-a953-a71c2ccf7fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:33.192555 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12610fc-80aa-410e-a953-a71c2ccf7fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:33.192907 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12610fc-80aa-410e-a953-a71c2ccf7fb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:33.216736 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:33.251418 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd0fe5-2a89-425b-b4a1-0f91e5d00df8 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:33.280233 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12610fc-80aa-410e-a953-a71c2ccf7fb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:33.283045 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12610fc-80aa-410e-a953-a71c2ccf7fb0 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:33.310198 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287a4bd-5747-409f-9787-0cab333dfa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:33.310846 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287a4bd-5747-409f-9787-0cab333dfa26 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:33.311127 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287a4bd-5747-409f-9787-0cab333dfa26 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:33.311400 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287a4bd-5747-409f-9787-0cab333dfa26 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:33.321426 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287a4bd-5747-409f-9787-0cab333dfa26 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:33.322902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287a4bd-5747-409f-9787-0cab333dfa26 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:33.335359 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-b287a4bd-5747-409f-9787-0cab333dfa26 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 05:30:33.335359 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:33.335359 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:33.335359 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:33.335359 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:33.335359 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:33.335359 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:33.335359 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:33.335359 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:33.335359 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:33.335359 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:33.335359 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:33.335359 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:30:33.335359 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:30:33.335359 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:30:33.335359 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:30:33.337410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:33.337410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:33.337410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:30:33.337410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:30:33.337410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:30:33.337410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:30:33.337410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:33.337410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:33.337410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:33.337410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:33.337410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:33.337410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:33.337410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:33.337410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:33.337410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:33.337410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:33.337410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:33.337410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:33.339616 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:33.339616 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:33.339616 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:30:33.339616 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:30:33.339616 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:30:33.339616 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:30:33.339616 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:30:33.339616 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:30:33.339616 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 05:30:33.339616 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:33.341530 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 256/518] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 26 05:30:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:33.342285 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287a4bd-5747-409f-9787-0cab333dfa26 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:33.395973 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 263/519] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:30:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:33.396748 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12610fc-80aa-410e-a953-a71c2ccf7fb0 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:33.449584 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:33.467761 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:33.480255 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287a4bd-5747-409f-9787-0cab333dfa26 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:33.509747 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12610fc-80aa-410e-a953-a71c2ccf7fb0 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:33.529778 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51626ccb-b9e0-4767-b3c8-aa1354e33b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:33.530399 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51626ccb-b9e0-4767-b3c8-aa1354e33b4c None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:33.530678 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51626ccb-b9e0-4767-b3c8-aa1354e33b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:33.530946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51626ccb-b9e0-4767-b3c8-aa1354e33b4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:33.558317 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad529e-0a6c-4165-a650-c1888b0fc310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:33.558997 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad529e-0a6c-4165-a650-c1888b0fc310 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:33.559352 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad529e-0a6c-4165-a650-c1888b0fc310 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:33.559619 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad529e-0a6c-4165-a650-c1888b0fc310 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:33.560397 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad529e-0a6c-4165-a650-c1888b0fc310 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:33.561870 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad529e-0a6c-4165-a650-c1888b0fc310 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:33.586887 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 264/520] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 26 05:30:33 2022] POST /identity/v3/users => generated 247 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:33.588155 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad529e-0a6c-4165-a650-c1888b0fc310 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:33.629446 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51626ccb-b9e0-4767-b3c8-aa1354e33b4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:33.631308 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51626ccb-b9e0-4767-b3c8-aa1354e33b4c None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:33.732264 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad529e-0a6c-4165-a650-c1888b0fc310 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:33.741144 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:33.774822 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f3562-ba21-4f9d-8ecf-ba91b4888286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:33.775486 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f3562-ba21-4f9d-8ecf-ba91b4888286 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:33.775778 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f3562-ba21-4f9d-8ecf-ba91b4888286 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:33.776122 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f3562-ba21-4f9d-8ecf-ba91b4888286 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:33.784099 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f3562-ba21-4f9d-8ecf-ba91b4888286 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:33.785792 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f3562-ba21-4f9d-8ecf-ba91b4888286 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:33.791760 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:33.799695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-cd8f3562-ba21-4f9d-8ecf-ba91b4888286 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:30:33.799695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:33.799695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:33.799695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:33.799695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:33.799695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:33.799695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:33.799695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:33.799695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:33.799695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:33.799695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:33.799695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:33.799695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:30:33.799695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:30:33.799695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:30:33.801431 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:30:33.801431 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:33.801431 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:33.801431 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:33.801431 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:33.801431 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:33.801431 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:33.801431 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:33.801431 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:33.801431 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:33.801431 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:33.801431 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:33.801431 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:33.801431 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:33.801431 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:33.801431 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:33.801431 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:33.803391 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:30:33.803391 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:30:33.803391 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:30:33.803391 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:30:33.803391 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:30:33.803391 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:30:33.803391 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:30:33.803391 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:33.804392 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 265/521] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:30:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:33.806437 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f3562-ba21-4f9d-8ecf-ba91b4888286 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:33.812407 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 257/522] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:30:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:33.812750 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51626ccb-b9e0-4767-b3c8-aa1354e33b4c None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:33.953313 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f3562-ba21-4f9d-8ecf-ba91b4888286 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:33.981188 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51626ccb-b9e0-4767-b3c8-aa1354e33b4c None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:34.000960 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a5802-4e6d-4bfb-876b-570eed712992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:34.000960 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a5802-4e6d-4bfb-876b-570eed712992 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:34.000960 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a5802-4e6d-4bfb-876b-570eed712992 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:34.001487 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a5802-4e6d-4bfb-876b-570eed712992 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:34.002860 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a5802-4e6d-4bfb-876b-570eed712992 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:34.003380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a5802-4e6d-4bfb-876b-570eed712992 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:34.006127 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a5802-4e6d-4bfb-876b-570eed712992 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:34.026733 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa565872-d884-46f9-9706-59a63db3fdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:34.027643 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa565872-d884-46f9-9706-59a63db3fdc1 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:34.028101 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa565872-d884-46f9-9706-59a63db3fdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:34.028504 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa565872-d884-46f9-9706-59a63db3fdc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:34.039131 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 266/523] 10.222.0.66 () {56 vars in 1139 bytes} [Mon Sep 26 05:30:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:34.040253 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a5802-4e6d-4bfb-876b-570eed712992 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:34.049990 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa565872-d884-46f9-9706-59a63db3fdc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:34.051614 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa565872-d884-46f9-9706-59a63db3fdc1 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:34.072524 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-fa565872-d884-46f9-9706-59a63db3fdc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:34.072524 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:34.072524 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:34.072524 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:34.072524 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:34.072524 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:34.072524 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:34.072524 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:34.072524 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:34.072524 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:34.072524 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:34.072524 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:34.072524 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:34.072524 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:34.072524 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:34.072524 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:34.073621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:34.073621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:34.073621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:34.073621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:34.073621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:34.073621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:34.073621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:34.073621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:34.073621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:34.073621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:34.073621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:34.073621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:34.073621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:34.073621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:34.073621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:34.073621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:34.073621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:34.074471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:34.074471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:34.074471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:34.075211 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 258/524] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:34.076207 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa565872-d884-46f9-9706-59a63db3fdc1 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:34.080978 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:34.154103 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:34.177520 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a5802-4e6d-4bfb-876b-570eed712992 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:34.217909 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c3ab6-4e01-4e09-93a8-0a8607f9a37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:34.218851 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c3ab6-4e01-4e09-93a8-0a8607f9a37a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:34.218999 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c3ab6-4e01-4e09-93a8-0a8607f9a37a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:34.219284 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1c3ab6-4e01-4e09-93a8-0a8607f9a37a None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:34.220114 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c3ab6-4e01-4e09-93a8-0a8607f9a37a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:34.220490 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c3ab6-4e01-4e09-93a8-0a8607f9a37a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:34.222061 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1c3ab6-4e01-4e09-93a8-0a8607f9a37a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:34.240496 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa565872-d884-46f9-9706-59a63db3fdc1 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:34.246357 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 267/525] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:30:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:34.247374 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c3ab6-4e01-4e09-93a8-0a8607f9a37a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:34.298177 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e735c3-b3d0-48c5-b16d-168512ebf305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:34.299453 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e735c3-b3d0-48c5-b16d-168512ebf305 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:34.299727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e735c3-b3d0-48c5-b16d-168512ebf305 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:34.300041 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e735c3-b3d0-48c5-b16d-168512ebf305 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:34.311673 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e735c3-b3d0-48c5-b16d-168512ebf305 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:34.313165 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e735c3-b3d0-48c5-b16d-168512ebf305 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:34.328356 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-31e735c3-b3d0-48c5-b16d-168512ebf305 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:34.328356 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:34.328356 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:34.328356 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:34.328356 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:34.328356 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:34.328356 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:34.328356 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:34.328356 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:34.328356 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:34.328356 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:34.328356 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:34.328356 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:34.328356 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:34.328356 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:34.328356 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:34.329649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:34.329649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:34.329649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:34.329649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:34.329649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:34.329649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:34.329649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:34.329649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:34.329649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:34.329649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:34.329649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:34.329649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:34.329649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:34.329649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:34.329649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:34.329649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:34.329649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:34.330764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:34.330764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:34.330764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:34.330764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 259/526] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:34.330764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e735c3-b3d0-48c5-b16d-168512ebf305 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:34.376972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:34.394635 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1c3ab6-4e01-4e09-93a8-0a8607f9a37a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:34.441156 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779fe87-8bde-4162-9df6-6ba8b3625cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:34.441787 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779fe87-8bde-4162-9df6-6ba8b3625cfe None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:34.442057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779fe87-8bde-4162-9df6-6ba8b3625cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:34.442322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779fe87-8bde-4162-9df6-6ba8b3625cfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:34.466717 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:34.474738 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e735c3-b3d0-48c5-b16d-168512ebf305 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:34.513681 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24809346-86c7-43a3-b423-bb26be74ef6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:34.514777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24809346-86c7-43a3-b423-bb26be74ef6d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:34.515357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24809346-86c7-43a3-b423-bb26be74ef6d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:34.515875 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24809346-86c7-43a3-b423-bb26be74ef6d None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:34.516790 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24809346-86c7-43a3-b423-bb26be74ef6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:34.517265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24809346-86c7-43a3-b423-bb26be74ef6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:34.518903 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24809346-86c7-43a3-b423-bb26be74ef6d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:34.531408 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779fe87-8bde-4162-9df6-6ba8b3625cfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:34.533300 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779fe87-8bde-4162-9df6-6ba8b3625cfe None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:34.535982 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 260/527] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:34.537571 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24809346-86c7-43a3-b423-bb26be74ef6d None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:34.660065 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:34.687224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24809346-86c7-43a3-b423-bb26be74ef6d None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:34.690789 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 268/528] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:30:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:34.691875 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779fe87-8bde-4162-9df6-6ba8b3625cfe None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:34.760196 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f1ed7-503b-4cbc-ac71-3925d7bd48d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:34.761325 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f1ed7-503b-4cbc-ac71-3925d7bd48d8 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:34.761868 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f1ed7-503b-4cbc-ac71-3925d7bd48d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:34.762390 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f1ed7-503b-4cbc-ac71-3925d7bd48d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:34.763961 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f1ed7-503b-4cbc-ac71-3925d7bd48d8 None admin] RBAC: Adding query filter params (role.id=024a61996071437aa07a3faf2bb5ae69, scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8, user.id=766ad3d6be374fc482a7c0bf6a1e56ec) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:34.764449 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f1ed7-503b-4cbc-ac71-3925d7bd48d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:34.767210 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f1ed7-503b-4cbc-ac71-3925d7bd48d8 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:34.778804 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 261/529] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:30:34 2022] GET /identity/v3/role_assignments?user.id=766ad3d6be374fc482a7c0bf6a1e56ec&scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8&role.id=024a61996071437aa07a3faf2bb5ae69 => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:34.780276 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f1ed7-503b-4cbc-ac71-3925d7bd48d8 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:34.841173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:34.904745 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779fe87-8bde-4162-9df6-6ba8b3625cfe None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:34.955776 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c3f85-0325-47d5-be7f-a6d7fe7e622d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:34.955776 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c3f85-0325-47d5-be7f-a6d7fe7e622d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:34.955776 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c3f85-0325-47d5-be7f-a6d7fe7e622d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:34.956292 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c3f85-0325-47d5-be7f-a6d7fe7e622d None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:34.956818 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c3f85-0325-47d5-be7f-a6d7fe7e622d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:34.957585 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c3f85-0325-47d5-be7f-a6d7fe7e622d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:34.958603 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c3f85-0325-47d5-be7f-a6d7fe7e622d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:34.972954 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 269/530] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:34.973886 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c3f85-0325-47d5-be7f-a6d7fe7e622d None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:35.027878 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f1ed7-503b-4cbc-ac71-3925d7bd48d8 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:35.046561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:35.088599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209096b0-11b3-454c-9d23-bbc1673459de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:35.088599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209096b0-11b3-454c-9d23-bbc1673459de None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:35.088599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209096b0-11b3-454c-9d23-bbc1673459de None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:35.088599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209096b0-11b3-454c-9d23-bbc1673459de None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:35.100440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209096b0-11b3-454c-9d23-bbc1673459de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:35.103246 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209096b0-11b3-454c-9d23-bbc1673459de None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:35.128224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-209096b0-11b3-454c-9d23-bbc1673459de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:30:35.128224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:35.128224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:35.128224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:35.128224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:35.128224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:35.128224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:35.128224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:35.128224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:35.128224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:35.128224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:35.128224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:35.128224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:30:35.128224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:30:35.128224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:30:35.129159 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:30:35.129159 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:35.129159 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:35.129159 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:35.129159 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:35.129159 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:35.129159 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:35.129159 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:35.129159 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:35.129159 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:35.129159 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:35.129159 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:35.129159 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:35.129159 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:35.129159 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:35.129159 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:35.129159 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:35.130037 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:30:35.130037 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:30:35.130037 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:30:35.130037 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:30:35.130037 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:30:35.130037 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:30:35.130037 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:30:35.130037 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:35.133204 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 262/531] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:30:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:35.134695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209096b0-11b3-454c-9d23-bbc1673459de None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:35.171445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c3f85-0325-47d5-be7f-a6d7fe7e622d None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:35.236987 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bff968-cace-4afd-a0d0-f1d223c50a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:35.239515 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bff968-cace-4afd-a0d0-f1d223c50a2b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:35.240434 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bff968-cace-4afd-a0d0-f1d223c50a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:35.241197 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bff968-cace-4afd-a0d0-f1d223c50a2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:35.264590 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bff968-cace-4afd-a0d0-f1d223c50a2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:35.268130 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bff968-cace-4afd-a0d0-f1d223c50a2b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:35.300128 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-b3bff968-cace-4afd-a0d0-f1d223c50a2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:35.300128 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:35.300128 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:35.300128 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:35.300128 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:35.300128 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:35.300128 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:35.300128 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:35.300128 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:35.300128 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:35.300128 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:35.300128 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:35.300128 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:35.300128 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:35.300128 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:35.300128 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:35.301825 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:35.301825 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:35.301825 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:35.301825 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:35.301825 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:35.301825 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:35.301825 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:35.301825 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:35.301825 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:35.301825 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:35.301825 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:35.301825 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:35.301825 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:35.301825 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:35.301825 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:35.301825 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:35.301825 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:35.303484 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:35.303484 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:35.303484 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:35.307306 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 270/532] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:35.309511 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bff968-cace-4afd-a0d0-f1d223c50a2b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:35.323184 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:35.375341 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209096b0-11b3-454c-9d23-bbc1673459de None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:35.455240 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc12938-c35e-408b-8b7e-1155c2c18f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:35.456036 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc12938-c35e-408b-8b7e-1155c2c18f6a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:35.456449 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc12938-c35e-408b-8b7e-1155c2c18f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:35.456910 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc12938-c35e-408b-8b7e-1155c2c18f6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:35.472187 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc12938-c35e-408b-8b7e-1155c2c18f6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:35.476618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc12938-c35e-408b-8b7e-1155c2c18f6a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:35.501256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-6cc12938-c35e-408b-8b7e-1155c2c18f6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:30:35.501256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:35.501256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:35.501256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:35.501256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:35.501256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:35.501256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:35.501256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:35.501256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:35.501256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:35.501256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:35.501256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:35.501256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:30:35.501256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:30:35.501256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:30:35.502858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:30:35.502858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:35.502858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:35.502858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:35.502858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:35.502858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:35.502858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:35.502858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:35.502858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:35.502858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:35.502858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:35.502858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:35.502858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:35.502858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:35.502858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:35.502858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:35.502858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:35.504533 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:30:35.504533 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:30:35.504533 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:30:35.504533 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:30:35.504533 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:30:35.504533 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:30:35.504533 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:30:35.504533 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:35.508959 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 263/533] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:30:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:35.510892 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc12938-c35e-408b-8b7e-1155c2c18f6a None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:35.529338 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:35.534705 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bff968-cace-4afd-a0d0-f1d223c50a2b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:35.594031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9dfc1-c214-418b-be1e-1c4f730f3746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:35.595374 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9dfc1-c214-418b-be1e-1c4f730f3746 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:35.595962 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9dfc1-c214-418b-be1e-1c4f730f3746 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:35.596513 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9dfc1-c214-418b-be1e-1c4f730f3746 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:35.597825 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9dfc1-c214-418b-be1e-1c4f730f3746 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:35.598418 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9dfc1-c214-418b-be1e-1c4f730f3746 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:35.602689 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9dfc1-c214-418b-be1e-1c4f730f3746 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:35.634466 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 271/534] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:30:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:35.634466 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9dfc1-c214-418b-be1e-1c4f730f3746 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:35.763828 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc12938-c35e-408b-8b7e-1155c2c18f6a None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:35.814548 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed957dc9-7e58-4513-80be-e99658dd785d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:35.816076 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed957dc9-7e58-4513-80be-e99658dd785d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:35.816654 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed957dc9-7e58-4513-80be-e99658dd785d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:35.817118 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed957dc9-7e58-4513-80be-e99658dd785d None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:35.818416 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed957dc9-7e58-4513-80be-e99658dd785d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:35.818932 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed957dc9-7e58-4513-80be-e99658dd785d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:35.821772 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed957dc9-7e58-4513-80be-e99658dd785d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:35.838319 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9dfc1-c214-418b-be1e-1c4f730f3746 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:35.841870 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:35.852969 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 264/535] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:35.854931 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed957dc9-7e58-4513-80be-e99658dd785d None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:35.919253 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9953085-89ab-45d6-a3b2-e9012ac8e725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:35.921863 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9953085-89ab-45d6-a3b2-e9012ac8e725 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:35.922242 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9953085-89ab-45d6-a3b2-e9012ac8e725 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:35.922386 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9953085-89ab-45d6-a3b2-e9012ac8e725 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:35.923117 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9953085-89ab-45d6-a3b2-e9012ac8e725 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:35.923418 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9953085-89ab-45d6-a3b2-e9012ac8e725 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:35.925062 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9953085-89ab-45d6-a3b2-e9012ac8e725 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:35.944223 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 272/536] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:30:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:35.945382 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9953085-89ab-45d6-a3b2-e9012ac8e725 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:35.968019 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:36.037206 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed957dc9-7e58-4513-80be-e99658dd785d None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:36.068498 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9953085-89ab-45d6-a3b2-e9012ac8e725 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:36.105441 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2d656-1fa1-43f1-a7d7-695485b45c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:36.106370 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2d656-1fa1-43f1-a7d7-695485b45c50 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:36.106839 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2d656-1fa1-43f1-a7d7-695485b45c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:36.107535 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2d656-1fa1-43f1-a7d7-695485b45c50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:36.108710 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2d656-1fa1-43f1-a7d7-695485b45c50 None admin] RBAC: Adding query filter params (role.id=024a61996071437aa07a3faf2bb5ae69, scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8, user.id=c559a36836be411b9afd076f4c9a0655) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:36.109268 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2d656-1fa1-43f1-a7d7-695485b45c50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:36.111886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2d656-1fa1-43f1-a7d7-695485b45c50 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:36.112965 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90be38-2866-4b07-bb67-000dd5c2993a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:36.113633 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90be38-2866-4b07-bb67-000dd5c2993a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:36.113902 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90be38-2866-4b07-bb67-000dd5c2993a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:36.114163 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90be38-2866-4b07-bb67-000dd5c2993a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:36.122494 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90be38-2866-4b07-bb67-000dd5c2993a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:36.124035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90be38-2866-4b07-bb67-000dd5c2993a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:36.132399 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 265/537] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:30:35 2022] GET /identity/v3/role_assignments?user.id=c559a36836be411b9afd076f4c9a0655&scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8&role.id=024a61996071437aa07a3faf2bb5ae69 => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:36.135339 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2d656-1fa1-43f1-a7d7-695485b45c50 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:36.139396 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-dc90be38-2866-4b07-bb67-000dd5c2993a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:30:36.139396 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:36.139396 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:36.139396 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:36.139396 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:36.139396 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:36.139396 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:36.139396 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:36.139396 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:36.139396 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:36.139396 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:36.139396 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:36.139396 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:30:36.139396 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:30:36.139396 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:30:36.141098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:30:36.141098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:36.141098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:36.141098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:36.141098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:36.141098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:36.141098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:36.141098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:36.141098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:36.141098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:36.141098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:36.141098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:36.141098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:36.141098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:36.141098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:36.141098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:36.141098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:36.142697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:30:36.142697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:30:36.142697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:30:36.142697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:30:36.142697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:30:36.142697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:30:36.142697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:30:36.142697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:36.145995 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 273/538] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:30:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:36.147530 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8822d5c-1002-4355-afc1-c019d5edcbf4 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:36.147925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8822d5c-1002-4355-afc1-c019d5edcbf4 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:36.148253 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8822d5c-1002-4355-afc1-c019d5edcbf4 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:36.156737 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 274/539] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:36.156737 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8822d5c-1002-4355-afc1-c019d5edcbf4 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:36.230845 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:36.279086 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2d656-1fa1-43f1-a7d7-695485b45c50 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:36.322004 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c83e83-d2f5-4020-b23d-69fdf8093686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:36.322635 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c83e83-d2f5-4020-b23d-69fdf8093686 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:36.322908 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c83e83-d2f5-4020-b23d-69fdf8093686 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:36.323175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c83e83-d2f5-4020-b23d-69fdf8093686 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:36.323949 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c83e83-d2f5-4020-b23d-69fdf8093686 None admin] RBAC: Adding query filter params (role.id=024a61996071437aa07a3faf2bb5ae69, scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8, user.id=842ef2c8cd794023ac29bd03c768986b) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:36.324819 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c83e83-d2f5-4020-b23d-69fdf8093686 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:36.325707 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c83e83-d2f5-4020-b23d-69fdf8093686 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:36.338378 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:36.340580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 266/540] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:30:36 2022] GET /identity/v3/role_assignments?user.id=842ef2c8cd794023ac29bd03c768986b&scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8&role.id=024a61996071437aa07a3faf2bb5ae69 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:36.341679 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb1550-2855-45f4-86f0-e713de397e3e None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:36.342007 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb1550-2855-45f4-86f0-e713de397e3e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:36.342364 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb1550-2855-45f4-86f0-e713de397e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:36.393102 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-6ffb1550-2855-45f4-86f0-e713de397e3e None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:36.394243 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-6ffb1550-2855-45f4-86f0-e713de397e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:36.397725 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8822d5c-1002-4355-afc1-c019d5edcbf4 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:36.485768 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b6264-c2a8-4c3a-a177-e069ef37c067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:36.487334 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b6264-c2a8-4c3a-a177-e069ef37c067 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:36.488139 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b6264-c2a8-4c3a-a177-e069ef37c067 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:36.488865 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b6264-c2a8-4c3a-a177-e069ef37c067 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:36.490490 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b6264-c2a8-4c3a-a177-e069ef37c067 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:36.491305 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b6264-c2a8-4c3a-a177-e069ef37c067 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:36.494591 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b6264-c2a8-4c3a-a177-e069ef37c067 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:36.522695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 275/541] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:30:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:36.530971 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b6264-c2a8-4c3a-a177-e069ef37c067 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:36.621756 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 267/542] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:30:36.831997 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b6264-c2a8-4c3a-a177-e069ef37c067 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:36.930231 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf15ea-2861-4a31-a68e-281e489de8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:36.931281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf15ea-2861-4a31-a68e-281e489de8dc None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:36.931801 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf15ea-2861-4a31-a68e-281e489de8dc None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:36.932234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf15ea-2861-4a31-a68e-281e489de8dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:36.933605 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf15ea-2861-4a31-a68e-281e489de8dc None admin] RBAC: Adding query filter params (role.id=024a61996071437aa07a3faf2bb5ae69, scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8, user.id=26b3d51ac6ca41cf9e535e751ac94675) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:36.934129 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf15ea-2861-4a31-a68e-281e489de8dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:36.936893 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaf15ea-2861-4a31-a68e-281e489de8dc None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:36.944391 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:36.953674 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 276/543] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:30:36 2022] GET /identity/v3/role_assignments?user.id=26b3d51ac6ca41cf9e535e751ac94675&scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8&role.id=024a61996071437aa07a3faf2bb5ae69 => generated 259 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:37.201435 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb1550-2855-45f4-86f0-e713de397e3e None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:37.333666 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:37.446531 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb1550-2855-45f4-86f0-e713de397e3e None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:37.562085 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944cccd-716d-4af9-ae76-267292666e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:37.563055 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944cccd-716d-4af9-ae76-267292666e65 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:37.563527 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944cccd-716d-4af9-ae76-267292666e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:37.564005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944cccd-716d-4af9-ae76-267292666e65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:37.592028 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944cccd-716d-4af9-ae76-267292666e65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:30:37.609552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-6944cccd-716d-4af9-ae76-267292666e65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:30:37.609552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:37.609552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:37.609552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:37.609552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:37.609552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:37.609552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:37.609552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:37.609552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:37.609552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:37.609552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:37.609552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:37.609552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:30:37.609552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:30:37.609552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:30:37.609552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:30:37.611269 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:30:37.611269 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:30:37.611269 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:30:37.611269 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:30:37.611269 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:37.611269 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:37.611269 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:37.611269 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:37.611269 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:37.611269 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:37.611269 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:37.611269 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:37.611269 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:37.611269 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:37.611269 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:37.611269 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:37.612800 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:37.612800 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:37.612800 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:37.612800 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:37.612800 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:30:37.612800 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:30:37.612800 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:30:37.612800 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:30:37.612800 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:30:37.612800 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:30:37.612800 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:30:37.612800 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:37.612800 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 268/544] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 26 05:30:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:37.624699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf15ea-2861-4a31-a68e-281e489de8dc None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:37.906390 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf15ea-2861-4a31-a68e-281e489de8dc None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:38.056161 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e992c5-50a7-48b8-9bc0-45956c6070b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:38.057222 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e992c5-50a7-48b8-9bc0-45956c6070b7 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:38.057708 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e992c5-50a7-48b8-9bc0-45956c6070b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:38.058189 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e992c5-50a7-48b8-9bc0-45956c6070b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:38.059470 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e992c5-50a7-48b8-9bc0-45956c6070b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:38.063784 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e992c5-50a7-48b8-9bc0-45956c6070b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:38.063784 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e992c5-50a7-48b8-9bc0-45956c6070b7 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:38.087814 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 277/545] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 26 05:30:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 464 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:38.097590 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944cccd-716d-4af9-ae76-267292666e65 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:38.375411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80b1b3-b958-4f29-a988-f6bedf165709 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:38.375700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80b1b3-b958-4f29-a988-f6bedf165709 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:38.376198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80b1b3-b958-4f29-a988-f6bedf165709 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:38.377668 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 278/546] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:30:38.383879 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371f82f-d7a8-4378-a648-52e7033aca2a None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:38.383879 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371f82f-d7a8-4378-a648-52e7033aca2a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:38.385838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371f82f-d7a8-4378-a648-52e7033aca2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:38.416581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944cccd-716d-4af9-ae76-267292666e65 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:38.424598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-7371f82f-d7a8-4378-a648-52e7033aca2a None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:38.425828 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7371f82f-d7a8-4378-a648-52e7033aca2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:38.451689 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:38.472237 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cb328-8ad7-4bcb-96ec-5f1673eec096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:38.473195 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cb328-8ad7-4bcb-96ec-5f1673eec096 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:38.473613 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cb328-8ad7-4bcb-96ec-5f1673eec096 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:38.474019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88cb328-8ad7-4bcb-96ec-5f1673eec096 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:38.488847 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88cb328-8ad7-4bcb-96ec-5f1673eec096 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:38.493022 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88cb328-8ad7-4bcb-96ec-5f1673eec096 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:38.528552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-b88cb328-8ad7-4bcb-96ec-5f1673eec096 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:38.528552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:38.528552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:38.528552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:38.528552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:38.528552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:38.528552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:38.528552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:38.528552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:38.528552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:38.528552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:38.528552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:38.528552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:38.528552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:38.528552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:38.528552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:38.530207 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:38.530207 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:38.530207 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:38.530207 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:38.530207 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:38.530207 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:38.530207 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:38.530207 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:38.530207 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:38.530207 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:38.530207 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:38.530207 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:38.530207 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:38.530207 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:38.530207 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:38.530207 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:38.530207 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:38.531595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:38.531595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:38.531595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:38.534709 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 269/547] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 438 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:38.544010 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cb328-8ad7-4bcb-96ec-5f1673eec096 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:38.663385 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88cb328-8ad7-4bcb-96ec-5f1673eec096 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:38.701845 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3132571-70e0-492c-a0a4-cfc7af3d06fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:38.703341 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3132571-70e0-492c-a0a4-cfc7af3d06fd None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:38.703849 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3132571-70e0-492c-a0a4-cfc7af3d06fd None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:38.704353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3132571-70e0-492c-a0a4-cfc7af3d06fd None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:38.705265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3132571-70e0-492c-a0a4-cfc7af3d06fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:38.705808 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3132571-70e0-492c-a0a4-cfc7af3d06fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:38.707429 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3132571-70e0-492c-a0a4-cfc7af3d06fd None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:38.728722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 270/548] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:38.730674 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3132571-70e0-492c-a0a4-cfc7af3d06fd None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:38.730866 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:38.766262 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 279/549] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:30:38.775095 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:38.910650 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3132571-70e0-492c-a0a4-cfc7af3d06fd None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:39.024818 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f7d40-7703-4760-b962-0095ba6acdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:39.026480 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f7d40-7703-4760-b962-0095ba6acdc5 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:39.026480 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f7d40-7703-4760-b962-0095ba6acdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:39.026480 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f7d40-7703-4760-b962-0095ba6acdc5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:39.041023 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f7d40-7703-4760-b962-0095ba6acdc5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:39.042512 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f7d40-7703-4760-b962-0095ba6acdc5 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:39.065625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-f50f7d40-7703-4760-b962-0095ba6acdc5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 05:30:39.065625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:39.065625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:39.065625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:39.065625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:39.065625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:39.065625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:39.065625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:39.065625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:39.065625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:39.065625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:39.065625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:39.065625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:30:39.065625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:30:39.065625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:30:39.065625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:30:39.067413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:39.067413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:39.067413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:30:39.067413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:30:39.067413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:30:39.067413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:30:39.067413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:39.067413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:39.067413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:39.067413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:39.067413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:39.067413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:39.067413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:39.067413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:39.067413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:39.067413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:39.067413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:39.067413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:39.069223 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:39.069223 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:39.069223 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:30:39.069223 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:30:39.069223 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:30:39.069223 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:30:39.069223 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:30:39.069223 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:30:39.069223 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 05:30:39.069223 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:39.075765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 271/550] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:30:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:30:39.082713 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371f82f-d7a8-4378-a648-52e7033aca2a None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:39.336283 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371f82f-d7a8-4378-a648-52e7033aca2a None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:39.384352 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f7d40-7703-4760-b962-0095ba6acdc5 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:39.413740 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca832c59-a866-48b0-8bc7-ea3142afae7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:39.414378 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca832c59-a866-48b0-8bc7-ea3142afae7f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:39.414699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca832c59-a866-48b0-8bc7-ea3142afae7f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:39.414969 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca832c59-a866-48b0-8bc7-ea3142afae7f None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:39.415825 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca832c59-a866-48b0-8bc7-ea3142afae7f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:39.416178 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca832c59-a866-48b0-8bc7-ea3142afae7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:39.417680 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca832c59-a866-48b0-8bc7-ea3142afae7f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:39.470189 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 280/551] 10.222.0.66 () {56 vars in 1135 bytes} [Mon Sep 26 05:30:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:39.484153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca832c59-a866-48b0-8bc7-ea3142afae7f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:39.635439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:39.660338 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f7d40-7703-4760-b962-0095ba6acdc5 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:39.673061 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:39.731196 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5139086c-f11e-4be1-b9d9-d9bed001fe6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:39.732400 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139086c-f11e-4be1-b9d9-d9bed001fe6d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:39.732863 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139086c-f11e-4be1-b9d9-d9bed001fe6d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:39.733555 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5139086c-f11e-4be1-b9d9-d9bed001fe6d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:39.743932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca832c59-a866-48b0-8bc7-ea3142afae7f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:39.756015 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5139086c-f11e-4be1-b9d9-d9bed001fe6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:30:39.767277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-5139086c-f11e-4be1-b9d9-d9bed001fe6d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:30:39.767277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:39.767277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:39.767277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:39.767277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:39.767277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:39.767277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:39.767277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:39.767277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:39.767277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:39.767277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:39.767277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:39.767277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:30:39.767277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:30:39.767277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:30:39.767277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:30:39.768545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:30:39.768545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:30:39.768545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:30:39.768545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:30:39.768545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:39.768545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:39.768545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:39.768545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:39.768545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:39.768545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:39.768545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:39.768545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:39.768545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:39.768545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:39.768545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:39.768545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:39.769488 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:39.769488 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:39.769488 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:39.769488 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:39.769488 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:30:39.769488 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:30:39.769488 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:30:39.769488 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:30:39.769488 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:30:39.769488 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:30:39.769488 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:30:39.769488 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:39.770231 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 272/552] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 26 05:30:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:39.778750 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e1963-7dde-4e43-b56d-9ceeda7128a4 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:39.779243 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e1963-7dde-4e43-b56d-9ceeda7128a4 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:39.779724 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5e1963-7dde-4e43-b56d-9ceeda7128a4 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:39.795850 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 273/553] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:39 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:39.795850 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e1963-7dde-4e43-b56d-9ceeda7128a4 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:39.801835 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619eb979-c37c-45bd-a078-9dd1dd8a3d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:39.804146 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619eb979-c37c-45bd-a078-9dd1dd8a3d48 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:39.804902 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619eb979-c37c-45bd-a078-9dd1dd8a3d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:39.805393 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619eb979-c37c-45bd-a078-9dd1dd8a3d48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:39.900621 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619eb979-c37c-45bd-a078-9dd1dd8a3d48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:39.902452 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619eb979-c37c-45bd-a078-9dd1dd8a3d48 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:39.960597 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:39.992588 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5e1963-7dde-4e43-b56d-9ceeda7128a4 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:40.040449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 281/554] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:30:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:40.040449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28350209-8d43-4af9-9de2-98abfdc18346 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:40.040449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28350209-8d43-4af9-9de2-98abfdc18346 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:40.040449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28350209-8d43-4af9-9de2-98abfdc18346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:40.045508 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852912d1-a698-44ca-a12c-c03b27f81c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:40.046107 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852912d1-a698-44ca-a12c-c03b27f81c2e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:40.046736 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852912d1-a698-44ca-a12c-c03b27f81c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:40.046994 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852912d1-a698-44ca-a12c-c03b27f81c2e None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:40.048732 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852912d1-a698-44ca-a12c-c03b27f81c2e None admin] RBAC: Adding query filter params (name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:40.049030 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852912d1-a698-44ca-a12c-c03b27f81c2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:40.050438 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852912d1-a698-44ca-a12c-c03b27f81c2e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:40.059368 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-28350209-8d43-4af9-9de2-98abfdc18346 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:40.060601 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-28350209-8d43-4af9-9de2-98abfdc18346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:40.068448 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 274/555] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 26 05:30:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:40.068448 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cced22-6a9e-44d2-bf4a-1b05cd0ed29d None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:40.068448 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cced22-6a9e-44d2-bf4a-1b05cd0ed29d None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:40.068448 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cced22-6a9e-44d2-bf4a-1b05cd0ed29d None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:40.068448 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 275/556] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:40.069668 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cced22-6a9e-44d2-bf4a-1b05cd0ed29d None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:40.087693 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:40.171795 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 282/557] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:30:40.171795 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28350209-8d43-4af9-9de2-98abfdc18346 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:40.230650 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cced22-6a9e-44d2-bf4a-1b05cd0ed29d None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:40.299210 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccbc89-a8b8-4676-a4aa-7092c41b2f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:40.300503 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccbc89-a8b8-4676-a4aa-7092c41b2f3b None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:40.300975 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccbc89-a8b8-4676-a4aa-7092c41b2f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:40.301481 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccbc89-a8b8-4676-a4aa-7092c41b2f3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:40.323581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ccbc89-a8b8-4676-a4aa-7092c41b2f3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:40.326461 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ccbc89-a8b8-4676-a4aa-7092c41b2f3b None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:40.346325 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:40.366379 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-06ccbc89-a8b8-4676-a4aa-7092c41b2f3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:40.366379 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:40.366379 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:40.366379 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:40.366379 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:40.366379 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:40.366379 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:40.366379 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:40.366379 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:40.366379 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:40.366379 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:40.366379 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:40.366379 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:40.366379 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:40.366379 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:40.366379 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:40.367539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:40.367539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:40.367539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:40.367539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:40.367539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:40.367539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:40.367539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:40.367539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:40.367539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:40.367539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:40.367539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:40.367539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:40.367539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:40.367539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:40.367539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:40.367539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:40.367539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:40.368458 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:40.368458 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:40.368458 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:40.374673 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 276/558] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:40.376758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14bbe07-f82b-4adc-9ff4-a7dc84b20226 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:40.377250 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14bbe07-f82b-4adc-9ff4-a7dc84b20226 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:40.377730 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14bbe07-f82b-4adc-9ff4-a7dc84b20226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:40.386705 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28350209-8d43-4af9-9de2-98abfdc18346 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:40.414312 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-e14bbe07-f82b-4adc-9ff4-a7dc84b20226 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:40.416358 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e14bbe07-f82b-4adc-9ff4-a7dc84b20226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:40.426830 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a46de-4654-484d-b806-3b630352affc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:40.427863 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a46de-4654-484d-b806-3b630352affc None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:40.428783 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a46de-4654-484d-b806-3b630352affc None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:40.429366 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a46de-4654-484d-b806-3b630352affc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:40.441877 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a46de-4654-484d-b806-3b630352affc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:40.443847 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a46de-4654-484d-b806-3b630352affc None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:40.480290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-885a46de-4654-484d-b806-3b630352affc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:40.480290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:40.480290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:40.480290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:40.480290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:40.480290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:40.480290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:40.480290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:40.480290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:40.480290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:40.480290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:40.480290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:40.480290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:40.480290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:40.480290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:40.480290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:40.482126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:40.482126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:40.482126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:40.482126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:40.482126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:40.482126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:40.482126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:40.482126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:40.482126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:40.482126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:40.482126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:40.482126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:40.482126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:40.482126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:40.482126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:40.482126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:40.482126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:40.483823 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:40.483823 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:40.483823 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:40.487478 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 283/559] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:40.489564 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a46de-4654-484d-b806-3b630352affc None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:40.511635 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:40.535804 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 277/560] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:30:40.535804 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14bbe07-f82b-4adc-9ff4-a7dc84b20226 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:40.695878 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14bbe07-f82b-4adc-9ff4-a7dc84b20226 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:40.720580 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a46de-4654-484d-b806-3b630352affc None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:40.758585 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:40.768001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6e4a7-efef-40e6-bacc-ed92500f40e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:40.768935 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6e4a7-efef-40e6-bacc-ed92500f40e4 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:40.769392 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6e4a7-efef-40e6-bacc-ed92500f40e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:40.769874 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6e4a7-efef-40e6-bacc-ed92500f40e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:40.770794 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f6e4a7-efef-40e6-bacc-ed92500f40e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:40.771285 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f6e4a7-efef-40e6-bacc-ed92500f40e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:40.773097 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f6e4a7-efef-40e6-bacc-ed92500f40e4 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:40.781856 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3b2e8-c0ce-4208-b612-86b6cf95bc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:40.782317 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3b2e8-c0ce-4208-b612-86b6cf95bc3b None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:40.782805 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3b2e8-c0ce-4208-b612-86b6cf95bc3b None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:40.783420 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3b2e8-c0ce-4208-b612-86b6cf95bc3b None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:40.787839 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3b2e8-c0ce-4208-b612-86b6cf95bc3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:40.788355 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3b2e8-c0ce-4208-b612-86b6cf95bc3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:40.792517 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3b2e8-c0ce-4208-b612-86b6cf95bc3b None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:40.799940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 284/561] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:40.801253 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6e4a7-efef-40e6-bacc-ed92500f40e4 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:40.824114 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 278/562] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:40.824114 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3b2e8-c0ce-4208-b612-86b6cf95bc3b None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:40.944531 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6e4a7-efef-40e6-bacc-ed92500f40e4 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:40.972196 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:41.024414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338363c0-f651-4139-a7f0-416331b19b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:41.025614 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338363c0-f651-4139-a7f0-416331b19b7c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:41.026094 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338363c0-f651-4139-a7f0-416331b19b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:41.028552 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338363c0-f651-4139-a7f0-416331b19b7c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:41.047485 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338363c0-f651-4139-a7f0-416331b19b7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:30:41.055217 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3b2e8-c0ce-4208-b612-86b6cf95bc3b None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:41.057151 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-338363c0-f651-4139-a7f0-416331b19b7c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:30:41.057151 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:41.057151 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:41.057151 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:41.057151 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:41.057151 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:41.057151 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:41.057151 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:41.057151 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:41.057151 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:41.057151 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:41.057151 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:41.057151 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:30:41.057151 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:30:41.057151 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:30:41.057151 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:30:41.058173 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:30:41.058173 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:30:41.058173 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:30:41.058173 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:30:41.058173 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:41.058173 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:41.058173 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:41.058173 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:41.058173 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:41.058173 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:41.058173 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:41.058173 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:41.058173 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:41.058173 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:41.058173 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:41.058173 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:41.059012 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:41.059012 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:41.059012 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:41.059012 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:41.059012 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:30:41.059012 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:30:41.059012 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:30:41.059012 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:30:41.059012 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:30:41.059012 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:30:41.059012 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:30:41.059012 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:41.059772 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 285/563] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 26 05:30:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:41.060919 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338363c0-f651-4139-a7f0-416331b19b7c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:41.115240 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017f04c-8124-4a7a-a00f-04f5e1cd7567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:41.116216 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017f04c-8124-4a7a-a00f-04f5e1cd7567 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:41.116596 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017f04c-8124-4a7a-a00f-04f5e1cd7567 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:41.117012 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017f04c-8124-4a7a-a00f-04f5e1cd7567 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:41.125960 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017f04c-8124-4a7a-a00f-04f5e1cd7567 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:41.127682 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017f04c-8124-4a7a-a00f-04f5e1cd7567 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:41.136081 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:41.141955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-6017f04c-8124-4a7a-a00f-04f5e1cd7567 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:30:41.141955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:41.141955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:41.141955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:41.141955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:41.141955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:41.141955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:41.141955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:41.141955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:41.141955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:41.141955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:41.141955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:41.141955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:30:41.141955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:30:41.141955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:30:41.143963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:30:41.143963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:41.143963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:41.143963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:41.143963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:41.143963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:41.143963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:41.143963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:41.143963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:41.143963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:41.143963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:41.143963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:41.143963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:41.143963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:41.143963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:41.143963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:41.143963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:41.146109 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:30:41.146109 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:30:41.146109 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:30:41.146109 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:30:41.146109 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:30:41.146109 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:30:41.146109 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:30:41.146109 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:41.146109 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 279/564] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:30:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:41.146109 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017f04c-8124-4a7a-a00f-04f5e1cd7567 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:41.196734 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338363c0-f651-4139-a7f0-416331b19b7c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:41.247380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417985b-306f-4b06-a757-b38a05ce8b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:41.248007 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417985b-306f-4b06-a757-b38a05ce8b7a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:41.248287 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417985b-306f-4b06-a757-b38a05ce8b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:41.248552 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417985b-306f-4b06-a757-b38a05ce8b7a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:41.256929 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417985b-306f-4b06-a757-b38a05ce8b7a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:41.258555 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417985b-306f-4b06-a757-b38a05ce8b7a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:41.271195 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017f04c-8124-4a7a-a00f-04f5e1cd7567 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:41.271760 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-8417985b-306f-4b06-a757-b38a05ce8b7a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 26 05:30:41.271760 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:41.271760 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:41.271760 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:41.271760 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:41.271760 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:41.271760 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:41.271760 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:41.271760 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:41.271760 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:41.271760 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:41.271760 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:41.271760 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:30:41.271760 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:30:41.271760 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:30:41.271760 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:30:41.273782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:41.273782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:41.273782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:30:41.273782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:30:41.273782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:30:41.273782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:30:41.273782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:41.273782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:41.273782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:41.273782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:41.273782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:41.273782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:41.273782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:41.273782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:41.273782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:41.273782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:41.273782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:41.273782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:41.276059 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:41.276059 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:41.276059 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:30:41.276059 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:30:41.276059 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:30:41.276059 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:30:41.276059 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:30:41.276059 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:30:41.276059 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 26 05:30:41.276059 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:41.276059 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 286/565] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:30:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:41.276059 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417985b-306f-4b06-a757-b38a05ce8b7a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:41.297929 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:41.324134 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afcdbd9-7fe2-40e8-9f22-c93e90743cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:41.325319 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcdbd9-7fe2-40e8-9f22-c93e90743cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:41.326621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcdbd9-7fe2-40e8-9f22-c93e90743cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:41.327103 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcdbd9-7fe2-40e8-9f22-c93e90743cf8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:41.346159 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afcdbd9-7fe2-40e8-9f22-c93e90743cf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:30:41.355452 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-0afcdbd9-7fe2-40e8-9f22-c93e90743cf8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:30:41.355452 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:41.355452 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:41.355452 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:41.355452 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:41.355452 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:41.355452 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:41.355452 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:41.355452 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:41.355452 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:41.355452 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:41.355452 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:41.355452 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:30:41.355452 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:30:41.355452 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:30:41.355452 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:30:41.357188 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:30:41.357188 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:30:41.357188 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:30:41.357188 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:30:41.357188 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:41.357188 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:41.357188 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:41.357188 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:41.357188 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:41.357188 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:41.357188 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:41.357188 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:41.357188 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:41.357188 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:41.357188 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:41.357188 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:41.358063 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:41.358063 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:41.358063 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:41.358063 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:41.358063 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:30:41.358063 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:30:41.358063 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:30:41.358063 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:30:41.358063 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:30:41.358063 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:30:41.358063 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:30:41.358063 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:41.358063 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 280/566] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 26 05:30:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:41.359823 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f884a-14ee-483d-bde8-8f0984ab62af None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:41.360284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f884a-14ee-483d-bde8-8f0984ab62af None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:41.360740 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f884a-14ee-483d-bde8-8f0984ab62af None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:41.367843 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 281/567] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:41.367843 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f884a-14ee-483d-bde8-8f0984ab62af None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:41.429477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417985b-306f-4b06-a757-b38a05ce8b7a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:41.448417 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:41.484357 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43ecf4-5c35-4d14-a3cb-95564f260a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:41.485303 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43ecf4-5c35-4d14-a3cb-95564f260a39 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:41.485734 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43ecf4-5c35-4d14-a3cb-95564f260a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:41.486159 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43ecf4-5c35-4d14-a3cb-95564f260a39 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:41.487272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43ecf4-5c35-4d14-a3cb-95564f260a39 None admin] RBAC: Adding query filter params (name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:41.487784 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43ecf4-5c35-4d14-a3cb-95564f260a39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:41.489799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43ecf4-5c35-4d14-a3cb-95564f260a39 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:41.509611 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 287/568] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 26 05:30:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:41.509611 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43ecf4-5c35-4d14-a3cb-95564f260a39 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:41.512264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f884a-14ee-483d-bde8-8f0984ab62af None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:41.557475 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3aaed-1e29-4f64-b027-b33885501d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:41.558422 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3aaed-1e29-4f64-b027-b33885501d61 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:41.558774 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3aaed-1e29-4f64-b027-b33885501d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:41.559100 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3aaed-1e29-4f64-b027-b33885501d61 None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:41.559947 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3aaed-1e29-4f64-b027-b33885501d61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:41.560310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3aaed-1e29-4f64-b027-b33885501d61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:41.561889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3aaed-1e29-4f64-b027-b33885501d61 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:41.585206 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 282/569] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:30:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:41.586195 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3aaed-1e29-4f64-b027-b33885501d61 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:41.639468 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:41.655005 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43ecf4-5c35-4d14-a3cb-95564f260a39 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:41.701927 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89044b1c-665e-44ff-bb8b-9dc19fcc5786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:41.702919 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89044b1c-665e-44ff-bb8b-9dc19fcc5786 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:41.703187 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89044b1c-665e-44ff-bb8b-9dc19fcc5786 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:41.703450 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89044b1c-665e-44ff-bb8b-9dc19fcc5786 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:41.704300 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89044b1c-665e-44ff-bb8b-9dc19fcc5786 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:41.704557 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89044b1c-665e-44ff-bb8b-9dc19fcc5786 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:41.705983 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89044b1c-665e-44ff-bb8b-9dc19fcc5786 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:41.729410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3aaed-1e29-4f64-b027-b33885501d61 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:41.732253 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 288/570] 10.222.0.66 () {56 vars in 1137 bytes} [Mon Sep 26 05:30:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:41.734543 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29366578-4fdd-47a5-859c-edc384543078 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:41.735032 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29366578-4fdd-47a5-859c-edc384543078 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:41.735511 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29366578-4fdd-47a5-859c-edc384543078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:41.766753 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-29366578-4fdd-47a5-859c-edc384543078 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:41.768831 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-29366578-4fdd-47a5-859c-edc384543078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:41.773566 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b394c8-0b08-486a-bc48-9870497e5b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:41.774207 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b394c8-0b08-486a-bc48-9870497e5b9c None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:41.774483 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b394c8-0b08-486a-bc48-9870497e5b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:41.774751 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b394c8-0b08-486a-bc48-9870497e5b9c None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:41.775461 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b394c8-0b08-486a-bc48-9870497e5b9c None admin] RBAC: Adding query filter params (name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:41.775774 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b394c8-0b08-486a-bc48-9870497e5b9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:41.777266 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b394c8-0b08-486a-bc48-9870497e5b9c None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:41.793674 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 283/571] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 26 05:30:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:41.793674 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b394c8-0b08-486a-bc48-9870497e5b9c None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:41.809631 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:41.878027 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 289/572] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:30:41.878932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29366578-4fdd-47a5-859c-edc384543078 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:41.925716 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:41.933687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b394c8-0b08-486a-bc48-9870497e5b9c None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:41.983296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7e7c3-a032-4f3f-b63d-f79b94dfea57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:41.984313 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7e7c3-a032-4f3f-b63d-f79b94dfea57 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:41.984746 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7e7c3-a032-4f3f-b63d-f79b94dfea57 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:41.985181 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7e7c3-a032-4f3f-b63d-f79b94dfea57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:42.004451 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7e7c3-a032-4f3f-b63d-f79b94dfea57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:42.006772 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7e7c3-a032-4f3f-b63d-f79b94dfea57 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:42.030311 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29366578-4fdd-47a5-859c-edc384543078 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:42.030846 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-f1e7e7c3-a032-4f3f-b63d-f79b94dfea57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:42.030846 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:42.030846 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:42.030846 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:42.030846 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:42.030846 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:42.030846 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:42.030846 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:42.030846 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:42.030846 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:42.030846 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:42.030846 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:42.030846 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:42.030846 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:42.030846 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:42.030846 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:42.031902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:42.031902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:42.031902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:42.031902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:42.031902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:42.031902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:42.031902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:42.031902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:42.031902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:42.031902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:42.031902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:42.031902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:42.031902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:42.031902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:42.031902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:42.031902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:42.031902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:42.032817 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:42.032817 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:42.032817 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:42.033625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 284/573] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:42.034535 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7e7c3-a032-4f3f-b63d-f79b94dfea57 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:42.075522 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8d97b-ff6d-41e2-bfc7-6af9c5ff4383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:42.076193 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8d97b-ff6d-41e2-bfc7-6af9c5ff4383 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:42.076467 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8d97b-ff6d-41e2-bfc7-6af9c5ff4383 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:42.076740 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8d97b-ff6d-41e2-bfc7-6af9c5ff4383 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:42.078181 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8d97b-ff6d-41e2-bfc7-6af9c5ff4383 None admin] RBAC: Adding query filter params (role.id=024a61996071437aa07a3faf2bb5ae69, scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8, user.id=830cd52ac42548b2ade17b5215aefd28) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:42.078686 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8d97b-ff6d-41e2-bfc7-6af9c5ff4383 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:42.081262 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8d97b-ff6d-41e2-bfc7-6af9c5ff4383 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:42.091422 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 290/574] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:30:41 2022] GET /identity/v3/role_assignments?user.id=830cd52ac42548b2ade17b5215aefd28&scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8&role.id=024a61996071437aa07a3faf2bb5ae69 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:42.092880 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8d97b-ff6d-41e2-bfc7-6af9c5ff4383 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:42.169909 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:42.184876 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7e7c3-a032-4f3f-b63d-f79b94dfea57 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:42.237968 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201e4ac-88d7-4a71-9289-1b03ee2072b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:42.239026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201e4ac-88d7-4a71-9289-1b03ee2072b6 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:42.239556 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201e4ac-88d7-4a71-9289-1b03ee2072b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:42.240064 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201e4ac-88d7-4a71-9289-1b03ee2072b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:42.254155 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201e4ac-88d7-4a71-9289-1b03ee2072b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:42.256095 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201e4ac-88d7-4a71-9289-1b03ee2072b6 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:42.268057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:42.278097 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-c201e4ac-88d7-4a71-9289-1b03ee2072b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:42.278097 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:42.278097 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:42.278097 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:42.278097 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:42.278097 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:42.278097 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:42.278097 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:42.278097 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:42.278097 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:42.278097 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:42.278097 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:42.278097 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:42.278097 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:42.278097 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:42.278097 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:42.284867 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:42.284867 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:42.284867 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:42.284867 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:42.284867 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:42.284867 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:42.284867 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:42.284867 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:42.284867 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:42.284867 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:42.284867 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:42.284867 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:42.284867 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:42.284867 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:42.284867 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:42.284867 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:42.284867 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:42.286439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:42.286439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:42.286439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:42.286439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 285/575] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:42.286439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201e4ac-88d7-4a71-9289-1b03ee2072b6 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:42.334389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8d97b-ff6d-41e2-bfc7-6af9c5ff4383 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:42.376135 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc314bd-e54c-4264-9d15-22b6fb1d2a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:42.376796 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc314bd-e54c-4264-9d15-22b6fb1d2a6d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:42.377073 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc314bd-e54c-4264-9d15-22b6fb1d2a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:42.377331 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc314bd-e54c-4264-9d15-22b6fb1d2a6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:42.389370 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc314bd-e54c-4264-9d15-22b6fb1d2a6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:42.390879 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc314bd-e54c-4264-9d15-22b6fb1d2a6d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:42.406477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-2bc314bd-e54c-4264-9d15-22b6fb1d2a6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:42.406477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:42.406477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:42.406477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:42.406477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:42.406477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:42.406477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:42.406477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:42.406477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:42.406477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:42.406477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:42.406477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:42.406477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:42.406477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:42.406477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:42.406477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:42.410360 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:42.410360 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:42.410360 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:42.410360 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:42.410360 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:42.410360 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:42.410360 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:42.410360 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:42.410360 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:42.410360 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:42.410360 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:42.410360 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:42.410360 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:42.410360 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:42.410360 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:42.410360 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:42.410360 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:42.412361 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:42.412361 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:42.412361 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:42.412361 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 291/576] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:42.412361 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc314bd-e54c-4264-9d15-22b6fb1d2a6d None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:42.441407 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201e4ac-88d7-4a71-9289-1b03ee2072b6 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:42.490074 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037b69f-ab47-42fb-b484-5360a134c7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:42.490967 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037b69f-ab47-42fb-b484-5360a134c7fc None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:42.491412 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037b69f-ab47-42fb-b484-5360a134c7fc None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:42.491945 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a037b69f-ab47-42fb-b484-5360a134c7fc None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:42.493039 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037b69f-ab47-42fb-b484-5360a134c7fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:42.493438 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037b69f-ab47-42fb-b484-5360a134c7fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:42.495774 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a037b69f-ab47-42fb-b484-5360a134c7fc None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:42.519245 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 286/577] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:42.520784 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037b69f-ab47-42fb-b484-5360a134c7fc None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:42.552661 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:42.582958 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc314bd-e54c-4264-9d15-22b6fb1d2a6d None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:42.628638 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ce686-db57-4d8b-be51-55eb4f89415f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:42.629669 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ce686-db57-4d8b-be51-55eb4f89415f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:42.630129 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ce686-db57-4d8b-be51-55eb4f89415f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:42.630574 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ce686-db57-4d8b-be51-55eb4f89415f None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:42.631663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ce686-db57-4d8b-be51-55eb4f89415f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:42.632227 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ce686-db57-4d8b-be51-55eb4f89415f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:42.632901 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:42.636552 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ce686-db57-4d8b-be51-55eb4f89415f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:42.661040 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 292/578] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:42.661794 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ce686-db57-4d8b-be51-55eb4f89415f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:42.699342 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a037b69f-ab47-42fb-b484-5360a134c7fc None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:42.754761 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905d7ed-cbd8-4071-bbcf-d496ad768b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:42.755852 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905d7ed-cbd8-4071-bbcf-d496ad768b03 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:42.756291 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905d7ed-cbd8-4071-bbcf-d496ad768b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:42.756716 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905d7ed-cbd8-4071-bbcf-d496ad768b03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:42.776685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905d7ed-cbd8-4071-bbcf-d496ad768b03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:30:42.785415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-b905d7ed-cbd8-4071-bbcf-d496ad768b03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:30:42.785415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:42.785415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:42.785415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:42.785415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:42.785415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:42.785415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:42.785415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:42.785415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:42.785415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:42.785415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:42.785415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:42.785415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:30:42.785415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:30:42.785415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:30:42.785415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:30:42.787147 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:30:42.787147 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:30:42.787147 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:30:42.787147 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:30:42.787147 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:42.787147 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:42.787147 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:42.787147 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:42.787147 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:42.787147 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:42.787147 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:42.787147 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:42.787147 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:42.787147 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:42.787147 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:42.787147 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:42.790053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:42.790053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:42.790053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:42.790053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:42.790053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:30:42.790053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:30:42.790053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:30:42.790053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:30:42.790053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:30:42.790053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:30:42.790053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:30:42.790053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:42.790053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 287/579] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 26 05:30:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:42.790053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905d7ed-cbd8-4071-bbcf-d496ad768b03 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:42.860484 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ce686-db57-4d8b-be51-55eb4f89415f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:42.908756 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52224c9-17cd-401e-b01b-39a773998b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:42.909804 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52224c9-17cd-401e-b01b-39a773998b63 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:42.910280 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52224c9-17cd-401e-b01b-39a773998b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:42.910743 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52224c9-17cd-401e-b01b-39a773998b63 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:42.912481 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52224c9-17cd-401e-b01b-39a773998b63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:42.912481 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52224c9-17cd-401e-b01b-39a773998b63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:42.915128 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52224c9-17cd-401e-b01b-39a773998b63 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:42.928332 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:42.946408 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 293/580] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:42.947895 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52224c9-17cd-401e-b01b-39a773998b63 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:42.965544 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905d7ed-cbd8-4071-bbcf-d496ad768b03 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:42.992531 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:43.017742 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd537ce8-07c1-4283-8fd0-352a19f99e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:43.018855 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd537ce8-07c1-4283-8fd0-352a19f99e39 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:43.019326 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd537ce8-07c1-4283-8fd0-352a19f99e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:43.019844 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd537ce8-07c1-4283-8fd0-352a19f99e39 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:43.034735 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd537ce8-07c1-4283-8fd0-352a19f99e39 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:43.037415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd537ce8-07c1-4283-8fd0-352a19f99e39 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:43.060684 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-dd537ce8-07c1-4283-8fd0-352a19f99e39 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 05:30:43.060684 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:43.060684 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:43.060684 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:43.060684 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:43.060684 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:43.060684 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:43.060684 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:43.060684 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:43.060684 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:43.060684 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:43.060684 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:43.060684 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:30:43.060684 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:30:43.060684 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:30:43.060684 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:30:43.061722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:43.061722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:43.061722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:30:43.061722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:30:43.061722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:30:43.061722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:30:43.061722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:43.061722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:43.061722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:43.061722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:43.061722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:43.061722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:43.061722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:43.061722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:43.061722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:43.061722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:43.061722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:43.061722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:43.062751 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:43.062751 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:43.062751 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:30:43.062751 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:30:43.062751 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:30:43.062751 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:30:43.062751 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:30:43.062751 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:30:43.062751 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 05:30:43.062751 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:43.062751 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 288/581] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:30:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:43.064156 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd537ce8-07c1-4283-8fd0-352a19f99e39 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:43.111289 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52224c9-17cd-401e-b01b-39a773998b63 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:43.155541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8d222-e178-43e4-95cb-2d10aff89518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:43.156350 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8d222-e178-43e4-95cb-2d10aff89518 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:43.156654 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8d222-e178-43e4-95cb-2d10aff89518 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:43.156964 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8d222-e178-43e4-95cb-2d10aff89518 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:43.169771 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8d222-e178-43e4-95cb-2d10aff89518 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:43.173160 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8d222-e178-43e4-95cb-2d10aff89518 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:43.194130 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-a3a8d222-e178-43e4-95cb-2d10aff89518 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:30:43.194130 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:43.194130 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:43.194130 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:43.194130 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:43.194130 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:43.194130 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:43.194130 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:43.194130 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:43.194130 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:43.194130 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:43.194130 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:43.194130 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:30:43.194130 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:30:43.194130 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:30:43.195929 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:30:43.195929 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:43.195929 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:43.195929 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:43.195929 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:43.195929 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:43.195929 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:43.195929 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:43.195929 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:43.195929 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:43.195929 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:43.195929 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:43.195929 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:43.195929 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:43.195929 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:43.195929 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:43.195929 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:43.197801 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:30:43.197801 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:30:43.197801 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:30:43.197801 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:30:43.197801 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:30:43.197801 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:30:43.197801 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:30:43.197801 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:43.204121 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 294/582] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:30:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:43.205601 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8d222-e178-43e4-95cb-2d10aff89518 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:43.266294 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd537ce8-07c1-4283-8fd0-352a19f99e39 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:43.321348 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:43.329463 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc18338-462c-4efe-b498-a3d2506c3da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:43.330111 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc18338-462c-4efe-b498-a3d2506c3da1 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:43.330385 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc18338-462c-4efe-b498-a3d2506c3da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:43.330643 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc18338-462c-4efe-b498-a3d2506c3da1 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:43.331334 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc18338-462c-4efe-b498-a3d2506c3da1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:43.331633 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc18338-462c-4efe-b498-a3d2506c3da1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:43.333598 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc18338-462c-4efe-b498-a3d2506c3da1 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:43.349218 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 289/583] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 26 05:30:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:43.350463 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc18338-462c-4efe-b498-a3d2506c3da1 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:43.391281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8d222-e178-43e4-95cb-2d10aff89518 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:43.434462 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:43.441931 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674777ba-0f11-4e16-944a-b201166228fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:43.442708 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674777ba-0f11-4e16-944a-b201166228fd None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:43.443129 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674777ba-0f11-4e16-944a-b201166228fd None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:43.443493 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674777ba-0f11-4e16-944a-b201166228fd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:43.453857 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674777ba-0f11-4e16-944a-b201166228fd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:43.455485 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674777ba-0f11-4e16-944a-b201166228fd None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:43.470468 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-674777ba-0f11-4e16-944a-b201166228fd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:30:43.470468 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:43.470468 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:43.470468 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:43.470468 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:43.470468 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:43.470468 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:43.470468 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:43.470468 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:43.470468 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:43.470468 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:43.470468 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:43.470468 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:30:43.470468 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:30:43.470468 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:30:43.470468 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:30:43.472322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:43.472322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:43.472322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:30:43.472322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:30:43.472322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:30:43.472322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:30:43.472322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:43.472322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:43.472322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:43.472322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:43.472322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:43.472322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:43.472322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:43.472322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:43.472322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:43.472322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:43.472322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:43.472322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:43.474886 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:43.474886 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:43.474886 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:30:43.474886 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:30:43.474886 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:30:43.474886 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:30:43.474886 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:30:43.474886 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:30:43.474886 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:30:43.474886 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:43.474886 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 295/584] 10.222.0.66 () {56 vars in 1093 bytes} [Mon Sep 26 05:30:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:43.474886 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674777ba-0f11-4e16-944a-b201166228fd None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:43.548603 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc18338-462c-4efe-b498-a3d2506c3da1 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:43.617557 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bb4e0-2227-4acb-809b-f2d173ebcd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:43.618429 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bb4e0-2227-4acb-809b-f2d173ebcd37 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:43.619954 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bb4e0-2227-4acb-809b-f2d173ebcd37 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:43.619954 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bb4e0-2227-4acb-809b-f2d173ebcd37 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:43.620593 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271bb4e0-2227-4acb-809b-f2d173ebcd37 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:43.621104 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271bb4e0-2227-4acb-809b-f2d173ebcd37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:43.625387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271bb4e0-2227-4acb-809b-f2d173ebcd37 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:43.633330 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674777ba-0f11-4e16-944a-b201166228fd None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:43.656028 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 290/585] 10.222.0.66 () {56 vars in 1137 bytes} [Mon Sep 26 05:30:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:43.657374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bb4e0-2227-4acb-809b-f2d173ebcd37 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:43.670439 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:43.691938 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec26d2b-4597-4339-9374-89201f93b7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:43.692901 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec26d2b-4597-4339-9374-89201f93b7c2 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:43.693267 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec26d2b-4597-4339-9374-89201f93b7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:43.693596 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec26d2b-4597-4339-9374-89201f93b7c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:43.694371 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec26d2b-4597-4339-9374-89201f93b7c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:43.694733 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec26d2b-4597-4339-9374-89201f93b7c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:43.696396 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec26d2b-4597-4339-9374-89201f93b7c2 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:43.716821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 296/586] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:30:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:43.718360 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec26d2b-4597-4339-9374-89201f93b7c2 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:43.830201 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:43.835183 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bb4e0-2227-4acb-809b-f2d173ebcd37 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:43.877431 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec26d2b-4597-4339-9374-89201f93b7c2 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:43.887539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2a14d-84f2-4b45-9387-77b98b426d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:43.888532 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2a14d-84f2-4b45-9387-77b98b426d8a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:43.888954 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2a14d-84f2-4b45-9387-77b98b426d8a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:43.889496 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2a14d-84f2-4b45-9387-77b98b426d8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:43.902230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2a14d-84f2-4b45-9387-77b98b426d8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:43.903906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2a14d-84f2-4b45-9387-77b98b426d8a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:43.920438 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f3a12-e47d-4bd8-88a8-5aa363fe919c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:43.921248 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f3a12-e47d-4bd8-88a8-5aa363fe919c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:43.921691 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f3a12-e47d-4bd8-88a8-5aa363fe919c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:43.922046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-a8f2a14d-84f2-4b45-9387-77b98b426d8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:43.922046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:43.922046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:43.922046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:43.922046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:43.922046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:43.922046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:43.922046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:43.922046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:43.922046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:43.922046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:43.922046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:43.922046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:43.922046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:43.922046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:43.922046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:43.924232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:43.924232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:43.924232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:43.924232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:43.924232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:43.924232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:43.924232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:43.924232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:43.924232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:43.924232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:43.924232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:43.924232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:43.924232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:43.924232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:43.924232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:43.924232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:43.924232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:43.925947 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:43.925947 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:43.925947 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:43.926268 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f3a12-e47d-4bd8-88a8-5aa363fe919c None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:43.926268 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f3a12-e47d-4bd8-88a8-5aa363fe919c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:43.926268 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f3a12-e47d-4bd8-88a8-5aa363fe919c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:43.926633 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f3a12-e47d-4bd8-88a8-5aa363fe919c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:43.928247 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 291/587] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:43.929377 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2a14d-84f2-4b45-9387-77b98b426d8a None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:43.956308 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 297/588] 10.222.0.66 () {56 vars in 1133 bytes} [Mon Sep 26 05:30:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:43.961644 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f3a12-e47d-4bd8-88a8-5aa363fe919c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:44.006095 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:44.066724 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2a14d-84f2-4b45-9387-77b98b426d8a None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:44.091976 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f3a12-e47d-4bd8-88a8-5aa363fe919c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:44.111579 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d376ea-c0f8-410d-af4d-7161c13fd10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:44.112602 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d376ea-c0f8-410d-af4d-7161c13fd10f None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:44.113038 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d376ea-c0f8-410d-af4d-7161c13fd10f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:44.113438 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d376ea-c0f8-410d-af4d-7161c13fd10f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:44.129020 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d376ea-c0f8-410d-af4d-7161c13fd10f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:44.130934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d376ea-c0f8-410d-af4d-7161c13fd10f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:44.135996 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54f650-7091-43e2-8945-496499818425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:44.136691 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54f650-7091-43e2-8945-496499818425 None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:44.136971 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54f650-7091-43e2-8945-496499818425 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:44.137237 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54f650-7091-43e2-8945-496499818425 None admin] PATH_INFO: `/v3/projects/953bb95b0ba84d4f99a73afb426bb8c8/users/766ad3d6be374fc482a7c0bf6a1e56ec/roles/024a61996071437aa07a3faf2bb5ae69` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:44.149559 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-c0d376ea-c0f8-410d-af4d-7161c13fd10f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:44.149559 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:44.149559 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:44.149559 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:44.149559 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:44.149559 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:44.149559 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:44.149559 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:44.149559 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:44.149559 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:44.149559 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:44.149559 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:44.149559 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:44.149559 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:44.149559 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:44.149559 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:44.150711 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:44.150711 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:44.150711 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:44.150711 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:44.150711 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:44.150711 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:44.150711 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:44.150711 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:44.150711 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:44.150711 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:44.150711 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:44.150711 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:44.150711 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:44.150711 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:44.150711 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:44.150711 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:44.150711 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:44.151636 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:44.151636 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:44.151636 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:44.155964 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 292/589] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:44.157730 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d376ea-c0f8-410d-af4d-7161c13fd10f None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:44.160316 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa54f650-7091-43e2-8945-496499818425 None admin] RBAC: Authorizing `identity:create_grant(project_id=953bb95b0ba84d4f99a73afb426bb8c8, user_id=766ad3d6be374fc482a7c0bf6a1e56ec, role_id=024a61996071437aa07a3faf2bb5ae69)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:44.162887 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:44.164837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa54f650-7091-43e2-8945-496499818425 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:44.185023 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 298/590] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 26 05:30:43 2022] PUT /identity/v3/projects/953bb95b0ba84d4f99a73afb426bb8c8/users/766ad3d6be374fc482a7c0bf6a1e56ec/roles/024a61996071437aa07a3faf2bb5ae69 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:44.187009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54f650-7091-43e2-8945-496499818425 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:44.318900 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d376ea-c0f8-410d-af4d-7161c13fd10f None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:44.362012 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:44.365446 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cbb4d-ab04-44a0-a551-ea5ac4e37180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:44.366529 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cbb4d-ab04-44a0-a551-ea5ac4e37180 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:44.367411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cbb4d-ab04-44a0-a551-ea5ac4e37180 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:44.367953 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9cbb4d-ab04-44a0-a551-ea5ac4e37180 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:44.369848 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9cbb4d-ab04-44a0-a551-ea5ac4e37180 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:44.370566 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9cbb4d-ab04-44a0-a551-ea5ac4e37180 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:44.372295 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9cbb4d-ab04-44a0-a551-ea5ac4e37180 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:44.400799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54f650-7091-43e2-8945-496499818425 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:44.403997 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 293/591] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:44.405310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cbb4d-ab04-44a0-a551-ea5ac4e37180 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:44.452910 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae8c8d-8cd8-48ca-9963-1fe03d1fb9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:44.454041 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae8c8d-8cd8-48ca-9963-1fe03d1fb9c3 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:44.454581 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae8c8d-8cd8-48ca-9963-1fe03d1fb9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:44.455060 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae8c8d-8cd8-48ca-9963-1fe03d1fb9c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:44.468906 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae8c8d-8cd8-48ca-9963-1fe03d1fb9c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:44.471061 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae8c8d-8cd8-48ca-9963-1fe03d1fb9c3 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:44.490516 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-daae8c8d-8cd8-48ca-9963-1fe03d1fb9c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:44.490516 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:44.490516 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:44.490516 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:44.490516 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:44.490516 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:44.490516 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:44.490516 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:44.490516 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:44.490516 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:44.490516 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:44.490516 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:44.490516 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:44.490516 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:44.490516 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:44.490516 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:44.491543 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:44.491543 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:44.491543 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:44.491543 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:44.491543 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:44.491543 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:44.491543 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:44.491543 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:44.491543 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:44.491543 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:44.491543 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:44.491543 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:44.491543 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:44.491543 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:44.491543 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:44.491543 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:44.491543 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:44.492598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:44.492598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:44.492598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:44.500707 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 299/592] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:44.502121 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae8c8d-8cd8-48ca-9963-1fe03d1fb9c3 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:44.540025 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:44.615481 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9cbb4d-ab04-44a0-a551-ea5ac4e37180 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:44.649675 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae8c8d-8cd8-48ca-9963-1fe03d1fb9c3 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:44.680426 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b61333-a2c8-4ddc-9f75-8aeae7140abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:44.681427 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b61333-a2c8-4ddc-9f75-8aeae7140abd None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:44.681883 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b61333-a2c8-4ddc-9f75-8aeae7140abd None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:44.682348 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b61333-a2c8-4ddc-9f75-8aeae7140abd None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:44.683535 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b61333-a2c8-4ddc-9f75-8aeae7140abd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:44.684145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b61333-a2c8-4ddc-9f75-8aeae7140abd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:44.686965 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b61333-a2c8-4ddc-9f75-8aeae7140abd None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:44.692570 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f2089-f5bc-4e92-868e-0c697e568aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:44.693607 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f2089-f5bc-4e92-868e-0c697e568aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:44.694085 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f2089-f5bc-4e92-868e-0c697e568aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:44.694609 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f2089-f5bc-4e92-868e-0c697e568aa9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:44.704926 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f2089-f5bc-4e92-868e-0c697e568aa9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:44.706756 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f2089-f5bc-4e92-868e-0c697e568aa9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:44.723449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-4e6f2089-f5bc-4e92-868e-0c697e568aa9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 05:30:44.723449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:44.723449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:44.723449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:44.723449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:44.723449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:44.723449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:44.723449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:44.723449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:44.723449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:44.723449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:44.723449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:44.723449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:30:44.723449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:30:44.723449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:30:44.723449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:30:44.725369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:44.725369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:44.725369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:30:44.725369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:30:44.725369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:30:44.725369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:30:44.725369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:44.725369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:44.725369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:44.725369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:44.725369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:44.725369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:44.725369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:44.725369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:44.725369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:44.725369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:44.725369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:44.725369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:44.727241 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:44.727241 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:44.727241 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:30:44.727241 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:30:44.727241 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:30:44.727241 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:30:44.727241 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:30:44.727241 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:30:44.727241 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 05:30:44.727241 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:44.729002 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:44.738192 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 300/594] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 26 05:30:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:44.738192 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f2089-f5bc-4e92-868e-0c697e568aa9 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:44.738873 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 294/594] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:44.740860 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b61333-a2c8-4ddc-9f75-8aeae7140abd None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:44.866058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f2089-f5bc-4e92-868e-0c697e568aa9 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:44.905428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eafb40-fca8-43a2-8055-a86488e93dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:44.906458 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eafb40-fca8-43a2-8055-a86488e93dbf None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:44.906458 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eafb40-fca8-43a2-8055-a86488e93dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:44.906693 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eafb40-fca8-43a2-8055-a86488e93dbf None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:44.907258 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eafb40-fca8-43a2-8055-a86488e93dbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:44.907636 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eafb40-fca8-43a2-8055-a86488e93dbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:44.909128 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eafb40-fca8-43a2-8055-a86488e93dbf None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:44.928910 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 301/595] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:44.930122 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eafb40-fca8-43a2-8055-a86488e93dbf None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:44.935885 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b61333-a2c8-4ddc-9f75-8aeae7140abd None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:44.990381 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:45.007640 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:45.015968 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210da70-f8a6-40bd-ae18-1d4f471e11d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:45.018020 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210da70-f8a6-40bd-ae18-1d4f471e11d7 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:45.020342 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210da70-f8a6-40bd-ae18-1d4f471e11d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:45.020680 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210da70-f8a6-40bd-ae18-1d4f471e11d7 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:45.021555 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210da70-f8a6-40bd-ae18-1d4f471e11d7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:45.021862 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210da70-f8a6-40bd-ae18-1d4f471e11d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:45.023461 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210da70-f8a6-40bd-ae18-1d4f471e11d7 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:45.067832 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 295/596] 10.222.0.66 () {56 vars in 1139 bytes} [Mon Sep 26 05:30:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:45.069956 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210da70-f8a6-40bd-ae18-1d4f471e11d7 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:45.084919 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eafb40-fca8-43a2-8055-a86488e93dbf None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:45.167080 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a44807-1ee4-4f99-9590-8da714db9ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:45.168536 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a44807-1ee4-4f99-9590-8da714db9ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:45.168821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a44807-1ee4-4f99-9590-8da714db9ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:45.169090 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a44807-1ee4-4f99-9590-8da714db9ca3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:45.184524 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a44807-1ee4-4f99-9590-8da714db9ca3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:45.188113 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a44807-1ee4-4f99-9590-8da714db9ca3 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:45.210480 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-e0a44807-1ee4-4f99-9590-8da714db9ca3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:30:45.210480 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:45.210480 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:45.210480 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:45.210480 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:45.210480 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:45.210480 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:45.210480 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:45.210480 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:45.210480 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:45.210480 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:45.210480 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:45.210480 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:30:45.210480 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:30:45.210480 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:30:45.211577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:30:45.211577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:45.211577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:45.211577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:45.211577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:45.211577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:45.211577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:45.211577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:45.211577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:45.211577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:45.211577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:45.211577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:45.211577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:45.211577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:45.211577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:45.211577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:45.211577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:45.212669 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:30:45.212669 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:30:45.212669 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:30:45.212669 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:30:45.212669 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:30:45.212669 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:30:45.212669 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:30:45.212669 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:45.212669 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 302/597] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:30:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:45.214126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a44807-1ee4-4f99-9590-8da714db9ca3 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:45.218346 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210da70-f8a6-40bd-ae18-1d4f471e11d7 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:45.258326 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b61ded-70ad-478c-9c2d-37023f7f3a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:45.259455 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b61ded-70ad-478c-9c2d-37023f7f3a09 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:45.259844 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b61ded-70ad-478c-9c2d-37023f7f3a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:45.260135 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b61ded-70ad-478c-9c2d-37023f7f3a09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:45.268602 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b61ded-70ad-478c-9c2d-37023f7f3a09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:45.270194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b61ded-70ad-478c-9c2d-37023f7f3a09 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:45.284498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-58b61ded-70ad-478c-9c2d-37023f7f3a09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:30:45.284498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:45.284498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:45.284498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:45.284498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:45.284498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:45.284498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:45.284498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:45.284498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:45.284498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:45.284498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:45.284498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:45.284498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:30:45.284498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:30:45.284498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:30:45.286193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:30:45.286193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:45.286193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:45.286193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:45.286193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:45.286193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:45.286193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:45.286193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:45.286193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:45.286193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:45.286193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:45.286193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:45.286193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:45.286193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:45.286193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:45.286193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:45.286193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:45.287963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:30:45.287963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:30:45.287963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:30:45.287963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:30:45.287963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:30:45.287963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:30:45.287963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:30:45.287963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:45.290960 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 296/598] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:30:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:45.293447 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04176c4-06dd-452b-a498-3c327ef769b3 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:45.293447 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04176c4-06dd-452b-a498-3c327ef769b3 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:45.293447 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04176c4-06dd-452b-a498-3c327ef769b3 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:45.300499 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 297/599] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:45.300499 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04176c4-06dd-452b-a498-3c327ef769b3 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:45.366982 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:45.395810 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a44807-1ee4-4f99-9590-8da714db9ca3 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:45.434345 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:45.462439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04176c4-06dd-452b-a498-3c327ef769b3 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:45.464776 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb89e4d-5c85-4aac-bda8-0fbdfccfc8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:45.465819 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb89e4d-5c85-4aac-bda8-0fbdfccfc8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:45.466279 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb89e4d-5c85-4aac-bda8-0fbdfccfc8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:45.466748 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb89e4d-5c85-4aac-bda8-0fbdfccfc8d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:45.484731 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb89e4d-5c85-4aac-bda8-0fbdfccfc8d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:45.487258 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb89e4d-5c85-4aac-bda8-0fbdfccfc8d0 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:45.506385 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ac360-3e19-4f52-a8d6-9b0abf2d7e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:45.508126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ac360-3e19-4f52-a8d6-9b0abf2d7e8c None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:45.508925 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ac360-3e19-4f52-a8d6-9b0abf2d7e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:45.509382 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ac360-3e19-4f52-a8d6-9b0abf2d7e8c None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:45.510807 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ac360-3e19-4f52-a8d6-9b0abf2d7e8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:45.511404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ac360-3e19-4f52-a8d6-9b0abf2d7e8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:45.514139 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ac360-3e19-4f52-a8d6-9b0abf2d7e8c None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:45.521368 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-1bb89e4d-5c85-4aac-bda8-0fbdfccfc8d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:45.521368 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:45.521368 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:45.521368 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:45.521368 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:45.521368 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:45.521368 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:45.521368 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:45.521368 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:45.521368 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:45.521368 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:45.521368 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:45.521368 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:45.521368 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:45.521368 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:45.521368 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:45.523279 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:45.523279 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:45.523279 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:45.523279 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:45.523279 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:45.523279 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:45.523279 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:45.523279 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:45.523279 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:45.523279 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:45.523279 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:45.523279 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:45.523279 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:45.523279 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:45.523279 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:45.523279 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:45.523279 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:45.525233 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:45.525233 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:45.525233 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:45.528377 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 303/600] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:45.531042 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb89e4d-5c85-4aac-bda8-0fbdfccfc8d0 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:45.535364 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 298/601] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:30:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:45.537694 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311ba0e-40f1-4b0c-8347-d75167a759c7 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:45.538287 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311ba0e-40f1-4b0c-8347-d75167a759c7 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:45.539961 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311ba0e-40f1-4b0c-8347-d75167a759c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:45.568295 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-f311ba0e-40f1-4b0c-8347-d75167a759c7 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:45.570227 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f311ba0e-40f1-4b0c-8347-d75167a759c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:45.689598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb89e4d-5c85-4aac-bda8-0fbdfccfc8d0 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:45.695036 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 299/602] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:30:45.696145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311ba0e-40f1-4b0c-8347-d75167a759c7 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:45.780848 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df12c9-bf2e-4805-b631-ca2583437ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:45.783100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df12c9-bf2e-4805-b631-ca2583437ebc None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:45.784018 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df12c9-bf2e-4805-b631-ca2583437ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:45.784813 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df12c9-bf2e-4805-b631-ca2583437ebc None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:45.786743 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df12c9-bf2e-4805-b631-ca2583437ebc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:45.787574 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df12c9-bf2e-4805-b631-ca2583437ebc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:45.792125 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df12c9-bf2e-4805-b631-ca2583437ebc None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:45.817035 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:45.831238 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 304/603] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:30:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:45.833277 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df12c9-bf2e-4805-b631-ca2583437ebc None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:45.905722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:45.985367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311ba0e-40f1-4b0c-8347-d75167a759c7 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:46.062689 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87505304-ded7-4032-b387-bac9dfcb3516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:46.063219 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87505304-ded7-4032-b387-bac9dfcb3516 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:46.063483 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87505304-ded7-4032-b387-bac9dfcb3516 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:46.063854 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87505304-ded7-4032-b387-bac9dfcb3516 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:46.064435 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87505304-ded7-4032-b387-bac9dfcb3516 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:46.064732 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87505304-ded7-4032-b387-bac9dfcb3516 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:46.066130 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87505304-ded7-4032-b387-bac9dfcb3516 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:46.080597 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 300/604] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:46.081556 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87505304-ded7-4032-b387-bac9dfcb3516 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:46.101234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df12c9-bf2e-4805-b631-ca2583437ebc None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:46.164999 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55351c-d2a3-478f-96cc-e894ae9aa612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:46.166793 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55351c-d2a3-478f-96cc-e894ae9aa612 None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:46.167693 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55351c-d2a3-478f-96cc-e894ae9aa612 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:46.168259 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55351c-d2a3-478f-96cc-e894ae9aa612 None admin] PATH_INFO: `/v3/projects/953bb95b0ba84d4f99a73afb426bb8c8/users/842ef2c8cd794023ac29bd03c768986b/roles/024a61996071437aa07a3faf2bb5ae69` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:46.209270 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55351c-d2a3-478f-96cc-e894ae9aa612 None admin] RBAC: Authorizing `identity:create_grant(project_id=953bb95b0ba84d4f99a73afb426bb8c8, user_id=842ef2c8cd794023ac29bd03c768986b, role_id=024a61996071437aa07a3faf2bb5ae69)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:46.212480 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55351c-d2a3-478f-96cc-e894ae9aa612 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:46.230349 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:46.244254 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87505304-ded7-4032-b387-bac9dfcb3516 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:46.246863 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 305/605] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 26 05:30:45 2022] PUT /identity/v3/projects/953bb95b0ba84d4f99a73afb426bb8c8/users/842ef2c8cd794023ac29bd03c768986b/roles/024a61996071437aa07a3faf2bb5ae69 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:46.248680 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55351c-d2a3-478f-96cc-e894ae9aa612 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:46.324198 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9b9a3-18ca-45a5-a74e-a64f9e166103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:46.325201 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9b9a3-18ca-45a5-a74e-a64f9e166103 None admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:46.331770 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9b9a3-18ca-45a5-a74e-a64f9e166103 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:46.331770 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9b9a3-18ca-45a5-a74e-a64f9e166103 None admin] PATH_INFO: `/v3/projects/953bb95b0ba84d4f99a73afb426bb8c8/users/c559a36836be411b9afd076f4c9a0655/roles/024a61996071437aa07a3faf2bb5ae69` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:46.403769 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9b9a3-18ca-45a5-a74e-a64f9e166103 None admin] RBAC: Authorizing `identity:create_grant(project_id=953bb95b0ba84d4f99a73afb426bb8c8, user_id=c559a36836be411b9afd076f4c9a0655, role_id=024a61996071437aa07a3faf2bb5ae69)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:46.403769 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9b9a3-18ca-45a5-a74e-a64f9e166103 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:46.459766 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 301/606] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 26 05:30:46 2022] PUT /identity/v3/projects/953bb95b0ba84d4f99a73afb426bb8c8/users/c559a36836be411b9afd076f4c9a0655/roles/024a61996071437aa07a3faf2bb5ae69 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:46.466125 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9b9a3-18ca-45a5-a74e-a64f9e166103 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:46.567027 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:46.663768 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55351c-d2a3-478f-96cc-e894ae9aa612 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:46.774569 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9b9a3-18ca-45a5-a74e-a64f9e166103 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:46.837293 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64f56c-cb32-4257-8969-7814925700a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:46.837972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64f56c-cb32-4257-8969-7814925700a8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:46.838247 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64f56c-cb32-4257-8969-7814925700a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:46.838519 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64f56c-cb32-4257-8969-7814925700a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:46.869148 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64f56c-cb32-4257-8969-7814925700a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:30:46.874380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-cf64f56c-cb32-4257-8969-7814925700a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:30:46.874380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:46.874380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:46.874380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:46.874380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:46.874380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:46.874380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:46.874380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:46.874380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:46.874380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:46.874380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:46.874380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:46.874380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:30:46.874380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:30:46.874380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:30:46.874380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:30:46.876102 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:30:46.876102 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:30:46.876102 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:30:46.876102 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:30:46.876102 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:46.876102 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:46.876102 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:46.876102 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:46.876102 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:46.876102 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:46.876102 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:46.876102 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:46.876102 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:46.876102 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:46.876102 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:46.876102 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:46.877613 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:46.877613 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:46.877613 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:46.877613 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:46.877613 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:30:46.877613 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:30:46.877613 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:30:46.877613 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:30:46.877613 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:30:46.877613 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:30:46.877613 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:30:46.877613 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:46.884031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 306/607] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 26 05:30:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 637 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:46.891977 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f1f17-f026-4d7c-a857-9b5f6bc02ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:46.891977 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f1f17-f026-4d7c-a857-9b5f6bc02ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:46.891977 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f1f17-f026-4d7c-a857-9b5f6bc02ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:46.891977 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f1f17-f026-4d7c-a857-9b5f6bc02ed3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:46.894502 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64f56c-cb32-4257-8969-7814925700a8 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:46.922037 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f1f17-f026-4d7c-a857-9b5f6bc02ed3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:46.925326 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90f1f17-f026-4d7c-a857-9b5f6bc02ed3 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:46.968951 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-e90f1f17-f026-4d7c-a857-9b5f6bc02ed3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:30:46.968951 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:46.968951 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:46.968951 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:46.968951 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:46.968951 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:46.968951 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:46.968951 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:46.968951 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:46.968951 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:46.968951 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:46.968951 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:46.968951 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:30:46.968951 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:30:46.968951 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:30:46.970515 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:30:46.970515 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:46.970515 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:46.970515 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:46.970515 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:46.970515 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:46.970515 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:46.970515 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:46.970515 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:46.970515 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:46.970515 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:46.970515 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:46.970515 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:46.970515 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:46.970515 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:46.970515 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:46.970515 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:46.972274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:30:46.972274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:30:46.972274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:30:46.972274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:30:46.972274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:30:46.972274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:30:46.972274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:30:46.972274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:46.988126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 302/608] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:30:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 525 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:47.001324 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f1f17-f026-4d7c-a857-9b5f6bc02ed3 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:47.006236 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:47.247436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64f56c-cb32-4257-8969-7814925700a8 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:47.299660 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f1f17-f026-4d7c-a857-9b5f6bc02ed3 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:47.340604 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71b63e-013a-4d20-90e7-b948ee41354c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:47.341475 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71b63e-013a-4d20-90e7-b948ee41354c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:47.341887 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71b63e-013a-4d20-90e7-b948ee41354c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:47.342371 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71b63e-013a-4d20-90e7-b948ee41354c None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:47.343401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71b63e-013a-4d20-90e7-b948ee41354c None admin] RBAC: Adding query filter params (name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:47.343946 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71b63e-013a-4d20-90e7-b948ee41354c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:47.346249 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71b63e-013a-4d20-90e7-b948ee41354c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:47.361437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51a685-1547-4cd7-b783-440697a2ff50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:47.362079 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51a685-1547-4cd7-b783-440697a2ff50 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:47.367640 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51a685-1547-4cd7-b783-440697a2ff50 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:47.367640 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51a685-1547-4cd7-b783-440697a2ff50 None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:47.367640 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51a685-1547-4cd7-b783-440697a2ff50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:47.367640 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51a685-1547-4cd7-b783-440697a2ff50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:47.368266 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 307/609] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 26 05:30:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:47.368266 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09651ab-ed17-45a5-a175-ef2ccb4db0d3 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:47.368514 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51a685-1547-4cd7-b783-440697a2ff50 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:47.368652 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09651ab-ed17-45a5-a175-ef2ccb4db0d3 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:47.368652 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09651ab-ed17-45a5-a175-ef2ccb4db0d3 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:47.378015 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 308/610] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:47 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:47.379851 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09651ab-ed17-45a5-a175-ef2ccb4db0d3 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:47.385758 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:47.392993 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 303/611] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:30:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:47.394328 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc75876-b595-4739-af0b-a8ed2dd934a7 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:47.394612 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc75876-b595-4739-af0b-a8ed2dd934a7 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:47.394937 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc75876-b595-4739-af0b-a8ed2dd934a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:47.429789 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-ebc75876-b595-4739-af0b-a8ed2dd934a7 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:47.431080 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ebc75876-b595-4739-af0b-a8ed2dd934a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:47.534431 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:47.550507 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 304/612] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:30:47.551416 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc75876-b595-4739-af0b-a8ed2dd934a7 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:47.728601 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09651ab-ed17-45a5-a175-ef2ccb4db0d3 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:47.845361 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc75876-b595-4739-af0b-a8ed2dd934a7 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:47.868708 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97ce45-5739-448d-a3fc-fdca0f0ad2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:47.869384 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97ce45-5739-448d-a3fc-fdca0f0ad2b9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:47.869660 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97ce45-5739-448d-a3fc-fdca0f0ad2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:47.869928 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97ce45-5739-448d-a3fc-fdca0f0ad2b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:47.905275 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97ce45-5739-448d-a3fc-fdca0f0ad2b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:47.906223 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97ce45-5739-448d-a3fc-fdca0f0ad2b9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:47.943048 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b829de-a70e-4d9a-be31-1a4d8ed8aa8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:47.944738 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b829de-a70e-4d9a-be31-1a4d8ed8aa8e None admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:47.945554 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b829de-a70e-4d9a-be31-1a4d8ed8aa8e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:47.947502 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b829de-a70e-4d9a-be31-1a4d8ed8aa8e None admin] PATH_INFO: `/v3/projects/953bb95b0ba84d4f99a73afb426bb8c8/users/26b3d51ac6ca41cf9e535e751ac94675/roles/024a61996071437aa07a3faf2bb5ae69` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:47.958970 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-2a97ce45-5739-448d-a3fc-fdca0f0ad2b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:47.958970 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:47.958970 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:47.958970 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:47.958970 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:47.958970 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:47.958970 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:47.958970 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:47.958970 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:47.958970 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:47.958970 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:47.958970 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:47.958970 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:47.958970 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:47.958970 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:47.958970 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:47.960786 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:47.960786 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:47.960786 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:47.960786 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:47.960786 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:47.960786 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:47.960786 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:47.960786 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:47.960786 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:47.960786 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:47.960786 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:47.960786 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:47.960786 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:47.960786 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:47.960786 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:47.960786 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:47.960786 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:47.962376 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:47.962376 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:47.962376 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:47.972827 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 309/613] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 594 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:47.974736 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97ce45-5739-448d-a3fc-fdca0f0ad2b9 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:47.992520 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b829de-a70e-4d9a-be31-1a4d8ed8aa8e None admin] RBAC: Authorizing `identity:create_grant(project_id=953bb95b0ba84d4f99a73afb426bb8c8, user_id=26b3d51ac6ca41cf9e535e751ac94675, role_id=024a61996071437aa07a3faf2bb5ae69)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:47.993987 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b829de-a70e-4d9a-be31-1a4d8ed8aa8e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:48.015959 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 305/614] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 26 05:30:47 2022] PUT /identity/v3/projects/953bb95b0ba84d4f99a73afb426bb8c8/users/26b3d51ac6ca41cf9e535e751ac94675/roles/024a61996071437aa07a3faf2bb5ae69 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:48.017043 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b829de-a70e-4d9a-be31-1a4d8ed8aa8e None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:48.161542 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:48.188417 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:48.301647 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97ce45-5739-448d-a3fc-fdca0f0ad2b9 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:48.306576 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b829de-a70e-4d9a-be31-1a4d8ed8aa8e None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:48.346774 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442e6fd-acf6-4251-baeb-ba031360d946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:48.347429 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442e6fd-acf6-4251-baeb-ba031360d946 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:48.347706 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442e6fd-acf6-4251-baeb-ba031360d946 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:48.348002 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442e6fd-acf6-4251-baeb-ba031360d946 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:48.363041 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d442e6fd-acf6-4251-baeb-ba031360d946 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:30:48.369112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-d442e6fd-acf6-4251-baeb-ba031360d946 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:30:48.369112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:48.369112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:48.369112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:48.369112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:48.369112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:48.369112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:48.369112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:48.369112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:48.369112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:48.369112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:48.369112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:48.369112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:30:48.369112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:30:48.369112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:30:48.369112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:30:48.370925 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:30:48.370925 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:30:48.370925 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:30:48.370925 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:30:48.370925 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:48.370925 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:48.370925 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:48.370925 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:48.370925 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:48.370925 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:48.370925 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:48.370925 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:48.370925 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:48.370925 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:48.370925 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:48.370925 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:48.372549 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:48.372549 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:48.372549 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:48.372549 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:48.372549 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:30:48.372549 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:30:48.372549 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:30:48.372549 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:30:48.372549 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:30:48.372549 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:30:48.372549 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:30:48.372549 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:48.375907 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 306/615] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 26 05:30:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:48.378548 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442e6fd-acf6-4251-baeb-ba031360d946 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:48.389299 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb85d42-b301-49c7-b513-ff75bb44121b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:48.390789 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb85d42-b301-49c7-b513-ff75bb44121b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:48.391575 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb85d42-b301-49c7-b513-ff75bb44121b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:48.392354 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb85d42-b301-49c7-b513-ff75bb44121b None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:48.393797 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb85d42-b301-49c7-b513-ff75bb44121b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:48.394590 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb85d42-b301-49c7-b513-ff75bb44121b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:48.397692 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb85d42-b301-49c7-b513-ff75bb44121b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:48.422425 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 310/616] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:48.428449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb85d42-b301-49c7-b513-ff75bb44121b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:48.503385 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442e6fd-acf6-4251-baeb-ba031360d946 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:48.507122 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:48.546714 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d5a36-9a24-4117-b50a-e628055b4e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:48.547340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d5a36-9a24-4117-b50a-e628055b4e18 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:48.547688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d5a36-9a24-4117-b50a-e628055b4e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:48.548001 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d5a36-9a24-4117-b50a-e628055b4e18 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:48.548669 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d5a36-9a24-4117-b50a-e628055b4e18 None admin] RBAC: Adding query filter params (name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:48.548966 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d5a36-9a24-4117-b50a-e628055b4e18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:48.550388 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79d5a36-9a24-4117-b50a-e628055b4e18 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:48.564757 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 307/617] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 26 05:30:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:48.566173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d5a36-9a24-4117-b50a-e628055b4e18 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:48.658013 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb85d42-b301-49c7-b513-ff75bb44121b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:48.690572 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:48.785582 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d5a36-9a24-4117-b50a-e628055b4e18 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:48.791450 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb01154-902c-462e-890f-c304bd1f958e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:48.792971 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb01154-902c-462e-890f-c304bd1f958e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:48.793720 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb01154-902c-462e-890f-c304bd1f958e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:48.794458 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb01154-902c-462e-890f-c304bd1f958e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:48.829042 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb01154-902c-462e-890f-c304bd1f958e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:48.834005 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb01154-902c-462e-890f-c304bd1f958e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:48.863047 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-dbb01154-902c-462e-890f-c304bd1f958e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 05:30:48.863047 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:48.863047 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:48.863047 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:48.863047 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:48.863047 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:48.863047 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:48.863047 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:48.863047 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:48.863047 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:48.863047 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:48.863047 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:48.863047 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:30:48.863047 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:30:48.863047 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:30:48.863047 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:30:48.865069 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:48.865069 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:48.865069 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:30:48.865069 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:30:48.865069 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:30:48.865069 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:30:48.865069 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:48.865069 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:48.865069 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:48.865069 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:48.865069 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:48.865069 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:48.865069 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:48.865069 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:48.865069 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:48.865069 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:48.865069 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:48.865069 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:48.867203 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:48.867203 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:48.867203 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:30:48.867203 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:30:48.867203 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:30:48.867203 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:30:48.867203 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:30:48.867203 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:30:48.867203 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 05:30:48.867203 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:48.869224 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 311/618] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:30:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 442 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:48.874604 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb01154-902c-462e-890f-c304bd1f958e None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:48.965212 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca745f-80b2-4243-b10a-c50ad50259c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:48.970015 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca745f-80b2-4243-b10a-c50ad50259c5 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:48.970015 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca745f-80b2-4243-b10a-c50ad50259c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:48.970015 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca745f-80b2-4243-b10a-c50ad50259c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:48.994036 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca745f-80b2-4243-b10a-c50ad50259c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:48.995529 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca745f-80b2-4243-b10a-c50ad50259c5 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:49.023024 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-e1ca745f-80b2-4243-b10a-c50ad50259c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:49.023024 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:49.023024 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:49.023024 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:49.023024 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:49.023024 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:49.023024 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:49.023024 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:49.023024 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:49.023024 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:49.023024 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:49.023024 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:49.023024 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:49.023024 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:49.023024 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:49.023024 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:49.024889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:49.024889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:49.024889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:49.024889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:49.024889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:49.024889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:49.024889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:49.024889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:49.024889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:49.024889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:49.024889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:49.024889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:49.024889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:49.024889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:49.024889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:49.024889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:49.024889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:49.026594 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:49.026594 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:49.026594 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:49.031780 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 308/619] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 462 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:49.036438 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca745f-80b2-4243-b10a-c50ad50259c5 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:49.096340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:49.160352 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb01154-902c-462e-890f-c304bd1f958e None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:49.234882 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9556da6-8a17-4d62-9fae-b5aaa8fe7d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:49.235432 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9556da6-8a17-4d62-9fae-b5aaa8fe7d08 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:49.235685 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9556da6-8a17-4d62-9fae-b5aaa8fe7d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:49.235990 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9556da6-8a17-4d62-9fae-b5aaa8fe7d08 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:49.236748 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9556da6-8a17-4d62-9fae-b5aaa8fe7d08 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:49.237050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9556da6-8a17-4d62-9fae-b5aaa8fe7d08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:49.243706 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9556da6-8a17-4d62-9fae-b5aaa8fe7d08 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:49.275905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca745f-80b2-4243-b10a-c50ad50259c5 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:49.276871 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 312/620] 10.222.0.66 () {56 vars in 1135 bytes} [Mon Sep 26 05:30:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:49.278335 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26438b44-4f24-4890-9c59-998c6b493668 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:49.278615 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26438b44-4f24-4890-9c59-998c6b493668 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:49.278890 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26438b44-4f24-4890-9c59-998c6b493668 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:49.281008 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 313/621] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:49.283059 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26438b44-4f24-4890-9c59-998c6b493668 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:49.329936 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:49.331925 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7793263-c321-4850-8846-dbf89a87d5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:49.332941 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7793263-c321-4850-8846-dbf89a87d5d7 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:49.333397 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7793263-c321-4850-8846-dbf89a87d5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:49.333573 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7793263-c321-4850-8846-dbf89a87d5d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:49.334303 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7793263-c321-4850-8846-dbf89a87d5d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:49.334618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7793263-c321-4850-8846-dbf89a87d5d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:49.337127 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7793263-c321-4850-8846-dbf89a87d5d7 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:49.350771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 309/622] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:30:49.353318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82efc1-19ef-4a68-8a5a-405220ff9b66 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:49.353318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82efc1-19ef-4a68-8a5a-405220ff9b66 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:49.353318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82efc1-19ef-4a68-8a5a-405220ff9b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:49.383484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-1f82efc1-19ef-4a68-8a5a-405220ff9b66 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:49.385425 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1f82efc1-19ef-4a68-8a5a-405220ff9b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:49.467228 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26438b44-4f24-4890-9c59-998c6b493668 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:49.517800 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 310/623] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:30:49.519048 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82efc1-19ef-4a68-8a5a-405220ff9b66 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:49.535768 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:49.547029 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfdb1ca-fbe9-43c2-a353-1f1ebdd71907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:49.549360 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdb1ca-fbe9-43c2-a353-1f1ebdd71907 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:49.549924 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdb1ca-fbe9-43c2-a353-1f1ebdd71907 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:49.551718 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdb1ca-fbe9-43c2-a353-1f1ebdd71907 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:49.585009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfdb1ca-fbe9-43c2-a353-1f1ebdd71907 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:49.587048 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfdb1ca-fbe9-43c2-a353-1f1ebdd71907 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:49.627648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-bcfdb1ca-fbe9-43c2-a353-1f1ebdd71907 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:49.627648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:49.627648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:49.627648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:49.627648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:49.627648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:49.627648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:49.627648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:49.627648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:49.627648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:49.627648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:49.627648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:49.627648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:49.627648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:49.627648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:49.627648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:49.628689 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:49.628689 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:49.628689 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:49.628689 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:49.628689 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:49.628689 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:49.628689 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:49.628689 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:49.628689 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:49.628689 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:49.628689 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:49.628689 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:49.628689 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:49.628689 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:49.628689 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:49.628689 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:49.628689 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:49.629608 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:49.629608 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:49.629608 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:49.631874 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 314/624] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:49.640300 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfdb1ca-fbe9-43c2-a353-1f1ebdd71907 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:49.730447 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82efc1-19ef-4a68-8a5a-405220ff9b66 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:49.781990 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e6e17-b7f2-44ba-b033-d3cf01ef4d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:49.782567 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e6e17-b7f2-44ba-b033-d3cf01ef4d0c None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:49.783626 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e6e17-b7f2-44ba-b033-d3cf01ef4d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:49.783626 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e6e17-b7f2-44ba-b033-d3cf01ef4d0c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:49.802090 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e6e17-b7f2-44ba-b033-d3cf01ef4d0c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:49.803966 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e6e17-b7f2-44ba-b033-d3cf01ef4d0c None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:49.820467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-140e6e17-b7f2-44ba-b033-d3cf01ef4d0c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 26 05:30:49.820467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:49.820467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:49.820467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:49.820467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:49.820467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:49.820467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:49.820467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:49.820467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:49.820467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:49.820467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:49.820467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:49.820467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:30:49.820467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:30:49.820467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:30:49.820467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:30:49.821536 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:49.821536 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:49.821536 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:30:49.821536 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:30:49.821536 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:30:49.821536 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:30:49.821536 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:49.821536 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:49.821536 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:49.821536 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:49.821536 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:49.821536 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:49.821536 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:49.821536 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:49.821536 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:49.821536 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:49.821536 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:49.821536 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:49.822541 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:49.822541 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:49.822541 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:30:49.822541 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:30:49.822541 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:30:49.822541 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:30:49.822541 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:30:49.822541 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:30:49.822541 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 26 05:30:49.822541 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:49.823599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 311/625] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:30:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:49.826387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfefb8b-d484-4d6d-b7fd-a10e877f06d5 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:49.826387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfefb8b-d484-4d6d-b7fd-a10e877f06d5 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:49.826387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfefb8b-d484-4d6d-b7fd-a10e877f06d5 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:49.829641 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 312/626] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:49.830589 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfefb8b-d484-4d6d-b7fd-a10e877f06d5 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:49.898268 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:49.926060 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfdb1ca-fbe9-43c2-a353-1f1ebdd71907 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:49.927024 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:49.973103 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfefb8b-d484-4d6d-b7fd-a10e877f06d5 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:49.973674 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495595d-eb9e-49d4-9e64-268dbaf12141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:49.974358 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495595d-eb9e-49d4-9e64-268dbaf12141 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:49.974726 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495595d-eb9e-49d4-9e64-268dbaf12141 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:49.975272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495595d-eb9e-49d4-9e64-268dbaf12141 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:49.976994 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495595d-eb9e-49d4-9e64-268dbaf12141 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:49.977295 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495595d-eb9e-49d4-9e64-268dbaf12141 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:49.978756 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495595d-eb9e-49d4-9e64-268dbaf12141 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:50.000012 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 315/627] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:50.002591 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77594298-2c2a-439c-a994-4cf9c99de0ec None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:50.003337 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77594298-2c2a-439c-a994-4cf9c99de0ec None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:50.004391 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77594298-2c2a-439c-a994-4cf9c99de0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:50.018591 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045afaf5-6ca6-48e2-8786-f0d8a0b89762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:50.019228 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045afaf5-6ca6-48e2-8786-f0d8a0b89762 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:50.019500 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045afaf5-6ca6-48e2-8786-f0d8a0b89762 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:50.019786 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045afaf5-6ca6-48e2-8786-f0d8a0b89762 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:50.020597 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045afaf5-6ca6-48e2-8786-f0d8a0b89762 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:50.020895 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045afaf5-6ca6-48e2-8786-f0d8a0b89762 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:50.022612 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045afaf5-6ca6-48e2-8786-f0d8a0b89762 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:50.032192 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-77594298-2c2a-439c-a994-4cf9c99de0ec None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:50.033654 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-77594298-2c2a-439c-a994-4cf9c99de0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:50.050454 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 313/628] 10.222.0.66 () {56 vars in 1137 bytes} [Mon Sep 26 05:30:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:50.051826 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045afaf5-6ca6-48e2-8786-f0d8a0b89762 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:50.160361 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 316/629] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:30:50.161359 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77594298-2c2a-439c-a994-4cf9c99de0ec None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:50.196718 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045afaf5-6ca6-48e2-8786-f0d8a0b89762 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:50.226673 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:50.240739 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2433898-d38a-4bae-ad0f-d81ca8dbf195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:50.241857 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2433898-d38a-4bae-ad0f-d81ca8dbf195 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:50.242587 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2433898-d38a-4bae-ad0f-d81ca8dbf195 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:50.243054 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2433898-d38a-4bae-ad0f-d81ca8dbf195 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:50.256801 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2433898-d38a-4bae-ad0f-d81ca8dbf195 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:30:50.257964 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:50.264136 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-a2433898-d38a-4bae-ad0f-d81ca8dbf195 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:30:50.264136 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:50.264136 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:50.264136 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:50.264136 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:50.264136 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:50.264136 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:50.264136 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:50.264136 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:50.264136 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:50.264136 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:50.264136 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:50.264136 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:30:50.264136 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:30:50.264136 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:30:50.264136 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:30:50.265143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:30:50.265143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:30:50.265143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:30:50.265143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:30:50.265143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:50.265143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:50.265143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:50.265143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:50.265143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:50.265143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:50.265143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:50.265143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:50.265143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:50.265143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:50.265143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:50.265143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:50.266003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:50.266003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:50.266003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:50.266003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:50.266003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:30:50.266003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:30:50.266003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:30:50.266003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:30:50.266003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:30:50.266003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:30:50.266003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:30:50.266003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:50.275274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 314/630] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 26 05:30:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:50.277123 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2433898-d38a-4bae-ad0f-d81ca8dbf195 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:50.301414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77594298-2c2a-439c-a994-4cf9c99de0ec None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:50.341963 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22cdad-489d-46f5-8654-f3bfa3b7d052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:50.342657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22cdad-489d-46f5-8654-f3bfa3b7d052 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:50.342916 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22cdad-489d-46f5-8654-f3bfa3b7d052 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:50.343182 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22cdad-489d-46f5-8654-f3bfa3b7d052 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:50.351476 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22cdad-489d-46f5-8654-f3bfa3b7d052 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:50.353794 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22cdad-489d-46f5-8654-f3bfa3b7d052 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:50.374235 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-df22cdad-489d-46f5-8654-f3bfa3b7d052 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:30:50.374235 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:50.374235 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:50.374235 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:50.374235 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:50.374235 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:50.374235 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:50.374235 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:50.374235 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:50.374235 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:50.374235 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:50.374235 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:50.374235 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:30:50.374235 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:30:50.374235 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:30:50.375294 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:30:50.375294 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:50.375294 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:50.375294 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:50.375294 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:50.375294 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:50.375294 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:50.375294 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:50.375294 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:50.375294 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:50.375294 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:50.375294 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:50.375294 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:50.375294 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:50.375294 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:50.375294 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:50.375294 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:50.376246 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:30:50.376246 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:30:50.376246 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:30:50.376246 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:30:50.376246 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:30:50.376246 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:30:50.376246 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:30:50.376246 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:50.383771 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 317/631] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:30:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:50.383771 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22cdad-489d-46f5-8654-f3bfa3b7d052 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:50.415587 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2433898-d38a-4bae-ad0f-d81ca8dbf195 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:50.472763 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca3792-74d5-4d30-bdc5-6fc83e677ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:50.473878 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca3792-74d5-4d30-bdc5-6fc83e677ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:50.474372 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca3792-74d5-4d30-bdc5-6fc83e677ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:50.474843 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acca3792-74d5-4d30-bdc5-6fc83e677ac2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:50.558958 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22cdad-489d-46f5-8654-f3bfa3b7d052 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:50.563390 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:50.595709 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca3792-74d5-4d30-bdc5-6fc83e677ac2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:50.597606 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acca3792-74d5-4d30-bdc5-6fc83e677ac2 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:50.620150 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e150eb-78f8-40aa-8101-b626c4225d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:50.620929 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e150eb-78f8-40aa-8101-b626c4225d72 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:50.621306 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e150eb-78f8-40aa-8101-b626c4225d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:50.621709 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e150eb-78f8-40aa-8101-b626c4225d72 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:50.622576 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e150eb-78f8-40aa-8101-b626c4225d72 None admin] RBAC: Adding query filter params (name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:50.623404 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e150eb-78f8-40aa-8101-b626c4225d72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:50.625139 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e150eb-78f8-40aa-8101-b626c4225d72 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:50.629268 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:50.643936 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 318/632] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 26 05:30:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:50.645276 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e150eb-78f8-40aa-8101-b626c4225d72 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:50.778214 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 315/633] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:30:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:50.779499 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca3792-74d5-4d30-bdc5-6fc83e677ac2 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:50.806642 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e150eb-78f8-40aa-8101-b626c4225d72 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:50.851106 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6214b-f1d8-4a77-ad1f-8fe320d78566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:50.851106 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6214b-f1d8-4a77-ad1f-8fe320d78566 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:50.851400 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6214b-f1d8-4a77-ad1f-8fe320d78566 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:50.851561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6214b-f1d8-4a77-ad1f-8fe320d78566 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:50.852313 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6214b-f1d8-4a77-ad1f-8fe320d78566 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:50.852621 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6214b-f1d8-4a77-ad1f-8fe320d78566 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:50.854095 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b6214b-f1d8-4a77-ad1f-8fe320d78566 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:50.868712 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 319/634] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:30:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:50.869754 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6214b-f1d8-4a77-ad1f-8fe320d78566 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:50.904376 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:50.924449 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acca3792-74d5-4d30-bdc5-6fc83e677ac2 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:50.941603 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:50.968256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00be38-2f75-4bd1-8012-794bf4c89de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:50.968898 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00be38-2f75-4bd1-8012-794bf4c89de2 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:50.969170 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00be38-2f75-4bd1-8012-794bf4c89de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:50.969433 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00be38-2f75-4bd1-8012-794bf4c89de2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:50.980527 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b00be38-2f75-4bd1-8012-794bf4c89de2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:50.982225 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b00be38-2f75-4bd1-8012-794bf4c89de2 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:50.999437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-6b00be38-2f75-4bd1-8012-794bf4c89de2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:50.999437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:50.999437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:50.999437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:50.999437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:50.999437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:50.999437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:50.999437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:50.999437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:50.999437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:50.999437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:50.999437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:50.999437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:50.999437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:50.999437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:50.999437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:51.000499 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:51.000499 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:51.000499 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:51.000499 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:51.000499 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:51.000499 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:51.000499 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:51.000499 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:51.000499 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:51.000499 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:51.000499 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:51.000499 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:51.000499 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:51.000499 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:51.000499 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:51.000499 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:51.000499 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:51.002111 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:51.002111 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:51.002111 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:51.002111 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 316/635] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:51.002111 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649448a2-0021-4d1d-8b4f-33100d09a851 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:51.002111 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649448a2-0021-4d1d-8b4f-33100d09a851 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:51.002459 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649448a2-0021-4d1d-8b4f-33100d09a851 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:51.008468 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 317/636] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:51.008468 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649448a2-0021-4d1d-8b4f-33100d09a851 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:51.018764 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6214b-f1d8-4a77-ad1f-8fe320d78566 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:51.073955 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1671414-dc8a-46b7-a11d-d3e08c9687d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:51.074743 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1671414-dc8a-46b7-a11d-d3e08c9687d4 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:51.075013 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1671414-dc8a-46b7-a11d-d3e08c9687d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:51.075277 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1671414-dc8a-46b7-a11d-d3e08c9687d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:51.088355 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1671414-dc8a-46b7-a11d-d3e08c9687d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:30:51.093619 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-c1671414-dc8a-46b7-a11d-d3e08c9687d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:30:51.093619 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:51.093619 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:51.093619 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:51.093619 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:51.093619 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:51.093619 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:51.093619 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:51.093619 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:51.093619 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:51.093619 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:51.093619 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:51.093619 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:30:51.093619 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:30:51.093619 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:30:51.093619 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:30:51.095699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:30:51.095699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:30:51.095699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:30:51.095699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:30:51.095699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:51.095699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:51.095699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:51.095699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:51.095699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:51.095699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:51.095699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:51.095699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:51.095699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:51.095699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:51.095699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:51.095699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:51.097405 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:51.097405 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:51.097405 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:51.097405 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:51.097405 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:30:51.097405 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:30:51.097405 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:30:51.097405 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:30:51.097405 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:30:51.097405 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:30:51.097405 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:30:51.097405 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:51.097405 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 320/637] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 26 05:30:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:51.097405 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1671414-dc8a-46b7-a11d-d3e08c9687d4 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:51.163496 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649448a2-0021-4d1d-8b4f-33100d09a851 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:51.223946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e463c5-be1c-41d4-abf0-f621191c1fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:51.225077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e463c5-be1c-41d4-abf0-f621191c1fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:51.225640 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e463c5-be1c-41d4-abf0-f621191c1fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:51.226177 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e463c5-be1c-41d4-abf0-f621191c1fb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:51.235486 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:51.251901 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e463c5-be1c-41d4-abf0-f621191c1fb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:51.254692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e463c5-be1c-41d4-abf0-f621191c1fb5 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:51.281040 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1671414-dc8a-46b7-a11d-d3e08c9687d4 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:51.284345 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-b5e463c5-be1c-41d4-abf0-f621191c1fb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:51.284345 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:51.284345 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:51.284345 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:51.284345 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:51.284345 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:51.284345 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:51.284345 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:51.284345 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:51.284345 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:51.284345 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:51.284345 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:51.284345 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:51.284345 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:51.284345 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:51.284345 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:51.285605 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:51.285605 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:51.285605 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:51.285605 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:51.285605 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:51.285605 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:51.285605 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:51.285605 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:51.285605 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:51.285605 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:51.285605 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:51.285605 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:51.285605 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:51.285605 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:51.285605 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:51.285605 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:51.285605 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:51.286695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:51.286695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:51.286695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:51.286895 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 318/638] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:51.288271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e463c5-be1c-41d4-abf0-f621191c1fb5 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:51.304457 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:51.332181 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3879fe-2ecb-4b13-a625-1d43ffc57aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:51.333260 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3879fe-2ecb-4b13-a625-1d43ffc57aa6 None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:51.333628 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3879fe-2ecb-4b13-a625-1d43ffc57aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:51.334089 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3879fe-2ecb-4b13-a625-1d43ffc57aa6 None admin] PATH_INFO: `/v3/projects/953bb95b0ba84d4f99a73afb426bb8c8/users/830cd52ac42548b2ade17b5215aefd28/roles/024a61996071437aa07a3faf2bb5ae69` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:51.352298 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3879fe-2ecb-4b13-a625-1d43ffc57aa6 None admin] RBAC: Authorizing `identity:create_grant(project_id=953bb95b0ba84d4f99a73afb426bb8c8, user_id=830cd52ac42548b2ade17b5215aefd28, role_id=024a61996071437aa07a3faf2bb5ae69)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:51.354401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3879fe-2ecb-4b13-a625-1d43ffc57aa6 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:51.371929 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 321/639] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 26 05:30:51 2022] PUT /identity/v3/projects/953bb95b0ba84d4f99a73afb426bb8c8/users/830cd52ac42548b2ade17b5215aefd28/roles/024a61996071437aa07a3faf2bb5ae69 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:30:51.374679 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798525ae-79d0-40fe-9dd6-37f39165ff5c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:51.375169 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798525ae-79d0-40fe-9dd6-37f39165ff5c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:51.375652 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798525ae-79d0-40fe-9dd6-37f39165ff5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:51.412875 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-798525ae-79d0-40fe-9dd6-37f39165ff5c None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:51.416165 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-798525ae-79d0-40fe-9dd6-37f39165ff5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:51.471235 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e463c5-be1c-41d4-abf0-f621191c1fb5 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:51.537643 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e66a9-a8c2-4080-b51e-0e3fa188a6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:51.538890 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e66a9-a8c2-4080-b51e-0e3fa188a6ae None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:51.539454 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e66a9-a8c2-4080-b51e-0e3fa188a6ae None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:51.540033 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e66a9-a8c2-4080-b51e-0e3fa188a6ae None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:51.541263 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e66a9-a8c2-4080-b51e-0e3fa188a6ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:51.541858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e66a9-a8c2-4080-b51e-0e3fa188a6ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:51.544547 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e66a9-a8c2-4080-b51e-0e3fa188a6ae None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:51.571764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 319/640] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:51.571764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e66a9-a8c2-4080-b51e-0e3fa188a6ae None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:51.572833 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 322/641] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:30:51.574585 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798525ae-79d0-40fe-9dd6-37f39165ff5c None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:51.652980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:51.735199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e66a9-a8c2-4080-b51e-0e3fa188a6ae None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:51.800073 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54e331-72da-42c7-b3c5-d10e3f4b4902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:51.801027 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54e331-72da-42c7-b3c5-d10e3f4b4902 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:51.801550 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54e331-72da-42c7-b3c5-d10e3f4b4902 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:51.801965 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54e331-72da-42c7-b3c5-d10e3f4b4902 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:51.802795 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54e331-72da-42c7-b3c5-d10e3f4b4902 None admin] RBAC: Adding query filter params (name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:51.803237 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54e331-72da-42c7-b3c5-d10e3f4b4902 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:51.805638 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54e331-72da-42c7-b3c5-d10e3f4b4902 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:51.817410 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:51.828283 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 320/642] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 26 05:30:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:51.829604 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54e331-72da-42c7-b3c5-d10e3f4b4902 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:51.836243 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798525ae-79d0-40fe-9dd6-37f39165ff5c None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:51.933114 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fada6-be35-44d0-abba-8aa78904c07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:51.934309 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fada6-be35-44d0-abba-8aa78904c07c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:51.934766 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fada6-be35-44d0-abba-8aa78904c07c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:51.935209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fada6-be35-44d0-abba-8aa78904c07c None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:51.936332 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366fada6-be35-44d0-abba-8aa78904c07c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:51.936769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366fada6-be35-44d0-abba-8aa78904c07c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:51.938935 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366fada6-be35-44d0-abba-8aa78904c07c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:51.992746 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 323/643] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:51.993879 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fada6-be35-44d0-abba-8aa78904c07c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:52.139462 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54e331-72da-42c7-b3c5-d10e3f4b4902 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:52.162252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:52.215877 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a63591-10c4-410b-9f8b-3de6b9597ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:52.216933 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a63591-10c4-410b-9f8b-3de6b9597ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:52.217860 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a63591-10c4-410b-9f8b-3de6b9597ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:52.218319 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a63591-10c4-410b-9f8b-3de6b9597ab6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:52.231615 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fada6-be35-44d0-abba-8aa78904c07c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:52.235306 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a63591-10c4-410b-9f8b-3de6b9597ab6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:52.238319 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a63591-10c4-410b-9f8b-3de6b9597ab6 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:52.252992 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-43a63591-10c4-410b-9f8b-3de6b9597ab6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 05:30:52.252992 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:52.252992 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:52.252992 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:52.252992 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:52.252992 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:52.252992 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:52.252992 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:52.252992 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:52.252992 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:52.252992 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:52.252992 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:52.252992 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:30:52.252992 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:30:52.252992 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:30:52.252992 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:30:52.254057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:52.254057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:52.254057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:30:52.254057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:30:52.254057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:30:52.254057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:30:52.254057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:52.254057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:52.254057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:52.254057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:52.254057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:52.254057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:52.254057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:52.254057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:52.254057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:52.254057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:52.254057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:52.254057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:52.255062 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:52.255062 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:52.255062 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:30:52.255062 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:30:52.255062 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:30:52.255062 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:30:52.255062 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:30:52.255062 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:30:52.255062 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 05:30:52.255062 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:52.257982 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 321/644] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:30:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 429 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:52.259147 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a63591-10c4-410b-9f8b-3de6b9597ab6 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:52.299322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ae36f-dd80-4104-95c1-f7d8ae07f532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:52.300864 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ae36f-dd80-4104-95c1-f7d8ae07f532 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:52.301555 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ae36f-dd80-4104-95c1-f7d8ae07f532 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:52.302076 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ae36f-dd80-4104-95c1-f7d8ae07f532 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:52.322348 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ae36f-dd80-4104-95c1-f7d8ae07f532 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:52.325107 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ae36f-dd80-4104-95c1-f7d8ae07f532 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:52.351887 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-3b6ae36f-dd80-4104-95c1-f7d8ae07f532 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:52.351887 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:52.351887 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:52.351887 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:52.351887 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:52.351887 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:52.351887 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:52.351887 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:52.351887 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:52.351887 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:52.351887 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:52.351887 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:52.351887 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:52.351887 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:52.351887 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:52.351887 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:52.354234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:52.354234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:52.354234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:52.354234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:52.354234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:52.354234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:52.354234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:52.354234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:52.354234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:52.354234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:52.354234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:52.354234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:52.354234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:52.354234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:52.354234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:52.354234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:52.354234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:52.356231 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:52.356231 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:52.356231 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:52.356231 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 324/645] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:52.356669 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ae36f-dd80-4104-95c1-f7d8ae07f532 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:52.386493 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:52.436705 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a63591-10c4-410b-9f8b-3de6b9597ab6 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:52.511578 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5b529-b808-477a-adf0-44359fae5fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:52.513199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5b529-b808-477a-adf0-44359fae5fbf None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:52.513985 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5b529-b808-477a-adf0-44359fae5fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:52.514830 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5b529-b808-477a-adf0-44359fae5fbf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:52.528994 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5b529-b808-477a-adf0-44359fae5fbf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:52.532134 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5b529-b808-477a-adf0-44359fae5fbf None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:52.552370 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ae36f-dd80-4104-95c1-f7d8ae07f532 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:52.555421 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-abd5b529-b808-477a-adf0-44359fae5fbf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:30:52.555421 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:52.555421 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:52.555421 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:52.555421 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:52.555421 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:52.555421 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:52.555421 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:52.555421 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:52.555421 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:52.555421 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:52.555421 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:52.555421 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:30:52.555421 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:30:52.555421 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:30:52.556886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:30:52.556886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:52.556886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:52.556886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:52.556886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:52.556886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:52.556886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:52.556886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:52.556886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:52.556886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:52.556886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:52.556886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:52.556886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:52.556886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:52.556886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:52.556886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:52.556886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:52.557811 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:30:52.557811 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:30:52.557811 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:30:52.557811 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:30:52.557811 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:30:52.557811 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:30:52.557811 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:30:52.557811 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:52.559777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 322/646] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:30:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:52.568498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5b529-b808-477a-adf0-44359fae5fbf None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:52.609256 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ed8ac-b860-48c7-b95e-309a514e8da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:52.610280 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ed8ac-b860-48c7-b95e-309a514e8da5 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:52.610717 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ed8ac-b860-48c7-b95e-309a514e8da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:52.611143 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ed8ac-b860-48c7-b95e-309a514e8da5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:52.630754 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ed8ac-b860-48c7-b95e-309a514e8da5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:30:52.634638 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:52.636722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-3c7ed8ac-b860-48c7-b95e-309a514e8da5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:30:52.636722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:52.636722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:52.636722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:52.636722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:52.636722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:52.636722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:52.636722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:52.636722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:52.636722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:52.636722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:52.636722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:52.636722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:30:52.636722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:30:52.636722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:30:52.636722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:30:52.638989 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:30:52.638989 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:30:52.638989 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:30:52.638989 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:30:52.638989 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:52.638989 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:52.638989 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:52.638989 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:52.638989 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:52.638989 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:52.638989 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:52.638989 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:52.638989 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:52.638989 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:52.638989 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:52.638989 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:52.640763 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:52.640763 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:52.640763 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:52.640763 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:52.640763 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:30:52.640763 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:30:52.640763 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:30:52.640763 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:30:52.640763 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:30:52.640763 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:30:52.640763 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:30:52.640763 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:52.643385 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 325/647] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 26 05:30:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:52.644271 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ed8ac-b860-48c7-b95e-309a514e8da5 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:52.742545 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:52.777470 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5b529-b808-477a-adf0-44359fae5fbf None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:52.813592 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ed8ac-b860-48c7-b95e-309a514e8da5 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:52.837565 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7d172-3164-41df-8c2d-bde3d457a40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:52.838741 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7d172-3164-41df-8c2d-bde3d457a40a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:52.839054 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7d172-3164-41df-8c2d-bde3d457a40a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:52.839330 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7d172-3164-41df-8c2d-bde3d457a40a None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:52.840948 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7d172-3164-41df-8c2d-bde3d457a40a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:52.841860 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7d172-3164-41df-8c2d-bde3d457a40a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:52.844583 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7d172-3164-41df-8c2d-bde3d457a40a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:52.882158 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 323/648] 10.222.0.66 () {56 vars in 1137 bytes} [Mon Sep 26 05:30:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:52.883828 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7d172-3164-41df-8c2d-bde3d457a40a None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:52.884722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76deebf-4c3a-42fa-bcac-09232bbebbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:52.885872 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76deebf-4c3a-42fa-bcac-09232bbebbbb None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:52.886367 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76deebf-4c3a-42fa-bcac-09232bbebbbb None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:52.886881 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76deebf-4c3a-42fa-bcac-09232bbebbbb None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:52.888378 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76deebf-4c3a-42fa-bcac-09232bbebbbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:52.889993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76deebf-4c3a-42fa-bcac-09232bbebbbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:52.891606 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76deebf-4c3a-42fa-bcac-09232bbebbbb None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:52.916679 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 326/649] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:52.918517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76deebf-4c3a-42fa-bcac-09232bbebbbb None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:53.043539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:53.072230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7d172-3164-41df-8c2d-bde3d457a40a None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:53.089780 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76deebf-4c3a-42fa-bcac-09232bbebbbb None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:53.131150 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee0c120-2a4c-4c77-a227-ae9b80dfb1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:53.132225 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0c120-2a4c-4c77-a227-ae9b80dfb1da None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:53.132795 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0c120-2a4c-4c77-a227-ae9b80dfb1da None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:53.133260 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0c120-2a4c-4c77-a227-ae9b80dfb1da None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:53.134958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee0c120-2a4c-4c77-a227-ae9b80dfb1da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:53.135214 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee0c120-2a4c-4c77-a227-ae9b80dfb1da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:53.137907 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee0c120-2a4c-4c77-a227-ae9b80dfb1da None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:53.145541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:53.161646 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255c6db-b7ce-4445-b215-4c54f02104d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:53.162660 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255c6db-b7ce-4445-b215-4c54f02104d5 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:53.163120 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255c6db-b7ce-4445-b215-4c54f02104d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:53.163618 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255c6db-b7ce-4445-b215-4c54f02104d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:53.164806 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255c6db-b7ce-4445-b215-4c54f02104d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:53.165339 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255c6db-b7ce-4445-b215-4c54f02104d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:53.167961 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255c6db-b7ce-4445-b215-4c54f02104d5 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:53.170680 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 324/650] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:30:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:53.172455 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee0c120-2a4c-4c77-a227-ae9b80dfb1da None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:53.183891 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 327/651] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 26 05:30:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:53.185524 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255c6db-b7ce-4445-b215-4c54f02104d5 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:53.343407 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255c6db-b7ce-4445-b215-4c54f02104d5 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:53.383996 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee0c120-2a4c-4c77-a227-ae9b80dfb1da None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:53.422109 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb7ea9-5f48-42a1-be89-5280a6d3d29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:53.424343 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb7ea9-5f48-42a1-be89-5280a6d3d29c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:53.425159 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb7ea9-5f48-42a1-be89-5280a6d3d29c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:53.425891 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb7ea9-5f48-42a1-be89-5280a6d3d29c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:53.441324 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb7ea9-5f48-42a1-be89-5280a6d3d29c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:53.442354 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b1c9c-ab40-4eda-8e09-5f7fc85239f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:53.443004 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b1c9c-ab40-4eda-8e09-5f7fc85239f1 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:53.443355 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b1c9c-ab40-4eda-8e09-5f7fc85239f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:53.443725 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b1c9c-ab40-4eda-8e09-5f7fc85239f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:53.445909 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb7ea9-5f48-42a1-be89-5280a6d3d29c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:53.469100 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:53.470630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-8bbb7ea9-5f48-42a1-be89-5280a6d3d29c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:30:53.470630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:53.470630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:53.470630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:53.470630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:53.470630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:53.470630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:53.470630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:53.470630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:53.470630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:53.470630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:53.470630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:53.470630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:30:53.470630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:30:53.470630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:30:53.470630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:30:53.472281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:53.472281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:53.472281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:30:53.472281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:30:53.472281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:30:53.472281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:30:53.472281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:53.472281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:53.472281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:53.472281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:53.472281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:53.472281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:53.472281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:53.472281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:53.472281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:53.472281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:53.472281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:53.472281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:53.473974 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:53.473974 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:53.473974 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:30:53.473974 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:30:53.473974 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:30:53.473974 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:30:53.473974 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:30:53.473974 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:30:53.473974 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:30:53.473974 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:53.477564 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 328/652] 10.222.0.66 () {56 vars in 1093 bytes} [Mon Sep 26 05:30:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:53.481453 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb7ea9-5f48-42a1-be89-5280a6d3d29c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:53.551477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:53.583933 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b1c9c-ab40-4eda-8e09-5f7fc85239f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:53.586605 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b1c9c-ab40-4eda-8e09-5f7fc85239f1 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:53.659954 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb7ea9-5f48-42a1-be89-5280a6d3d29c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:53.731225 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d772bdb-f642-4b51-89b3-42b2f9ec26e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:53.731917 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d772bdb-f642-4b51-89b3-42b2f9ec26e5 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:53.732240 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d772bdb-f642-4b51-89b3-42b2f9ec26e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:53.732479 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d772bdb-f642-4b51-89b3-42b2f9ec26e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:53.733519 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d772bdb-f642-4b51-89b3-42b2f9ec26e5 None admin] RBAC: Adding query filter params (role.id=024a61996071437aa07a3faf2bb5ae69, scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8, user.id=766ad3d6be374fc482a7c0bf6a1e56ec) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:53.733519 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d772bdb-f642-4b51-89b3-42b2f9ec26e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:53.735202 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d772bdb-f642-4b51-89b3-42b2f9ec26e5 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:53.752261 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 329/653] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:30:53 2022] GET /identity/v3/role_assignments?user.id=766ad3d6be374fc482a7c0bf6a1e56ec&scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8&role.id=024a61996071437aa07a3faf2bb5ae69 => generated 608 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:53.753552 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d772bdb-f642-4b51-89b3-42b2f9ec26e5 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:53.836150 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 325/654] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:30:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:53.839771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b1c9c-ab40-4eda-8e09-5f7fc85239f1 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:53.932486 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:54.033718 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b1c9c-ab40-4eda-8e09-5f7fc85239f1 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:54.053848 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d772bdb-f642-4b51-89b3-42b2f9ec26e5 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:54.073487 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:54.105292 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d5bcf-8248-4210-a877-564da421926a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:54.106835 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d5bcf-8248-4210-a877-564da421926a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:54.107304 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d5bcf-8248-4210-a877-564da421926a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:54.107765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d5bcf-8248-4210-a877-564da421926a None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:54.109709 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d5bcf-8248-4210-a877-564da421926a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:54.110112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d5bcf-8248-4210-a877-564da421926a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:54.111546 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d5bcf-8248-4210-a877-564da421926a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:54.120050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5840b628-2dd0-41f7-abd9-75b087e1489a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:54.120713 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840b628-2dd0-41f7-abd9-75b087e1489a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:54.120988 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840b628-2dd0-41f7-abd9-75b087e1489a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:54.121245 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5840b628-2dd0-41f7-abd9-75b087e1489a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:54.142245 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5840b628-2dd0-41f7-abd9-75b087e1489a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:54.145561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5840b628-2dd0-41f7-abd9-75b087e1489a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:54.149705 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 326/655] 10.222.0.66 () {56 vars in 1133 bytes} [Mon Sep 26 05:30:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:54.151646 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d5bcf-8248-4210-a877-564da421926a None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:54.181772 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-5840b628-2dd0-41f7-abd9-75b087e1489a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:54.181772 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:54.181772 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:54.181772 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:54.181772 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:54.181772 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:54.181772 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:54.181772 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:54.181772 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:54.181772 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:54.181772 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:54.181772 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:54.181772 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:54.181772 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:54.181772 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:54.181772 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:54.183598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:54.183598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:54.183598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:54.183598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:54.183598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:54.183598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:54.183598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:54.183598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:54.183598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:54.183598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:54.183598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:54.183598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:54.183598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:54.183598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:54.183598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:54.183598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:54.183598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:54.185334 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:54.185334 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:54.185334 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:54.185334 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 330/656] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 432 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:54.187912 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500e97c-ce59-4b9a-ac9e-2625a713d200 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:54.188557 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500e97c-ce59-4b9a-ac9e-2625a713d200 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:54.189138 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500e97c-ce59-4b9a-ac9e-2625a713d200 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:54.193653 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 331/657] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:54.194662 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500e97c-ce59-4b9a-ac9e-2625a713d200 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:54.388857 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d5bcf-8248-4210-a877-564da421926a None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:54.394662 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3500e97c-ce59-4b9a-ac9e-2625a713d200 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:54.411396 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:54.439976 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa3605-6e8c-4915-86a0-f3431dab8d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:54.440782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa3605-6e8c-4915-86a0-f3431dab8d1e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:54.441082 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa3605-6e8c-4915-86a0-f3431dab8d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:54.441443 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa3605-6e8c-4915-86a0-f3431dab8d1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:54.482646 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310a4a8-b5ae-4815-a2bf-ba0202026538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:54.483182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310a4a8-b5ae-4815-a2bf-ba0202026538 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:54.483661 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310a4a8-b5ae-4815-a2bf-ba0202026538 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:54.484141 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310a4a8-b5ae-4815-a2bf-ba0202026538 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:54.500095 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:54.504730 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310a4a8-b5ae-4815-a2bf-ba0202026538 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:54.507433 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310a4a8-b5ae-4815-a2bf-ba0202026538 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:54.549215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-5310a4a8-b5ae-4815-a2bf-ba0202026538 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:54.549215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:54.549215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:54.549215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:54.549215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:54.549215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:54.549215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:54.549215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:54.549215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:54.549215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:54.549215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:54.549215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:54.549215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:54.549215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:54.549215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:54.549215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:54.551242 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:54.551242 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:54.551242 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:54.551242 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:54.551242 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:54.551242 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:54.551242 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:54.551242 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:54.551242 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:54.551242 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:54.551242 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:54.551242 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:54.551242 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:54.551242 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:54.551242 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:54.551242 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:54.551242 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:54.553056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:54.553056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:54.553056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:54.553056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 327/658] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:54.553056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310a4a8-b5ae-4815-a2bf-ba0202026538 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:54.562710 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa3605-6e8c-4915-86a0-f3431dab8d1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:54.566626 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa3605-6e8c-4915-86a0-f3431dab8d1e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:54.742657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 332/659] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:30:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:54.747095 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ac4fc-d01d-4fa8-8135-d141bfa79362 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:54.748128 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ac4fc-d01d-4fa8-8135-d141bfa79362 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:54.749885 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ac4fc-d01d-4fa8-8135-d141bfa79362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:54.756908 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310a4a8-b5ae-4815-a2bf-ba0202026538 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:54.776210 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-4d8ac4fc-d01d-4fa8-8135-d141bfa79362 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:54.777826 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4d8ac4fc-d01d-4fa8-8135-d141bfa79362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:54.809322 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc892ef-b6ca-4b1b-b4ca-1ac12aa6f434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:54.810084 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc892ef-b6ca-4b1b-b4ca-1ac12aa6f434 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:54.810367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc892ef-b6ca-4b1b-b4ca-1ac12aa6f434 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:54.810648 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc892ef-b6ca-4b1b-b4ca-1ac12aa6f434 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:54.811321 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc892ef-b6ca-4b1b-b4ca-1ac12aa6f434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:54.811625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc892ef-b6ca-4b1b-b4ca-1ac12aa6f434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:54.813811 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc892ef-b6ca-4b1b-b4ca-1ac12aa6f434 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:54.835967 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 328/660] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:54.837358 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc892ef-b6ca-4b1b-b4ca-1ac12aa6f434 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:54.866955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:54.867219 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:54.879020 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 333/661] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:30:54.885656 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ac4fc-d01d-4fa8-8135-d141bfa79362 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:55.047860 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc892ef-b6ca-4b1b-b4ca-1ac12aa6f434 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:55.064186 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ac4fc-d01d-4fa8-8135-d141bfa79362 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:55.127760 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bed726-111f-46d7-87e4-663e081de30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:55.127760 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bed726-111f-46d7-87e4-663e081de30a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:55.128066 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bed726-111f-46d7-87e4-663e081de30a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:55.128138 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bed726-111f-46d7-87e4-663e081de30a None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:55.131764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bed726-111f-46d7-87e4-663e081de30a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:55.131764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bed726-111f-46d7-87e4-663e081de30a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:55.131764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bed726-111f-46d7-87e4-663e081de30a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:55.143765 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb7fcc-2da2-4d9e-8b74-ef6fefb9a1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:55.143765 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb7fcc-2da2-4d9e-8b74-ef6fefb9a1d4 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:55.143765 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb7fcc-2da2-4d9e-8b74-ef6fefb9a1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:55.143765 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb7fcc-2da2-4d9e-8b74-ef6fefb9a1d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:55.162794 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb7fcc-2da2-4d9e-8b74-ef6fefb9a1d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:55.162794 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb7fcc-2da2-4d9e-8b74-ef6fefb9a1d4 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:55.163264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 329/662] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:55.164110 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bed726-111f-46d7-87e4-663e081de30a None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:55.194843 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-14bb7fcc-2da2-4d9e-8b74-ef6fefb9a1d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:55.194843 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:55.194843 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:55.194843 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:55.194843 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:55.194843 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:55.194843 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:55.194843 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:55.194843 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:55.194843 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:55.194843 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:55.194843 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:55.194843 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:55.194843 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:55.194843 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:55.194843 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:55.195925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:55.195925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:55.195925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:55.195925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:55.195925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:55.195925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:55.195925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:55.195925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:55.195925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:55.195925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:55.195925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:55.195925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:55.195925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:55.195925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:55.195925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:55.195925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:55.195925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:55.196839 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:55.196839 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:55.196839 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:55.202681 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 334/663] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:55.203763 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb7fcc-2da2-4d9e-8b74-ef6fefb9a1d4 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:55.282757 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:55.306972 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:55.354469 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bed726-111f-46d7-87e4-663e081de30a None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:55.357825 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb7fcc-2da2-4d9e-8b74-ef6fefb9a1d4 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:55.409515 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9a887-d9b2-4e11-b6dd-0e65304a62ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:55.410168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9a887-d9b2-4e11-b6dd-0e65304a62ec None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:55.410441 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9a887-d9b2-4e11-b6dd-0e65304a62ec None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:55.410706 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9a887-d9b2-4e11-b6dd-0e65304a62ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:55.423092 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9a887-d9b2-4e11-b6dd-0e65304a62ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:55.424138 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458005c-bef6-4018-a154-aece240b7274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:55.424860 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458005c-bef6-4018-a154-aece240b7274 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:55.425199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458005c-bef6-4018-a154-aece240b7274 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:55.425521 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a458005c-bef6-4018-a154-aece240b7274 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:55.425879 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9a887-d9b2-4e11-b6dd-0e65304a62ec None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:55.435513 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458005c-bef6-4018-a154-aece240b7274 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:55.437098 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a458005c-bef6-4018-a154-aece240b7274 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:55.450228 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-a458005c-bef6-4018-a154-aece240b7274 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 05:30:55.450228 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:55.450228 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:55.450228 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:55.450228 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:55.450228 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:55.450228 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:55.450228 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:55.450228 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:55.450228 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:55.450228 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:55.450228 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:55.450228 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:30:55.450228 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:30:55.450228 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:30:55.450228 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:30:55.451252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:55.451252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:55.451252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:30:55.451252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:30:55.451252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:30:55.451252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:30:55.451252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:55.451252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:55.451252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:55.451252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:55.451252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:55.451252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:55.451252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:55.451252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:55.451252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:55.451252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:55.451252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:55.451252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:55.453149 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:55.453149 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:55.453149 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:30:55.453149 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:30:55.453149 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:30:55.453149 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:30:55.453149 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:30:55.453149 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:30:55.453149 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 26 05:30:55.453149 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:55.453743 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-29d9a887-d9b2-4e11-b6dd-0e65304a62ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:30:55.453743 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:55.453743 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:55.453743 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:55.453743 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:55.453743 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:55.453743 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:55.453743 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:55.453743 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:55.453743 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:55.453743 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:55.453743 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:55.453743 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:30:55.453743 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:30:55.453743 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:30:55.454889 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:30:55.454889 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:55.454889 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:55.454889 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:55.454889 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:55.454889 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:55.454889 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:55.454889 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:55.454889 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:55.454889 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:55.454889 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:55.454889 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:55.454889 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:55.454889 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:55.454889 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:55.454889 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:55.454889 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:55.455952 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:30:55.455952 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:30:55.455952 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:30:55.455952 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:30:55.455952 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:30:55.455952 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:30:55.455952 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:30:55.455952 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:55.457165 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 330/664] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 26 05:30:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:55.458363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458005c-bef6-4018-a154-aece240b7274 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:55.462140 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 335/665] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:30:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:55.464020 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9a887-d9b2-4e11-b6dd-0e65304a62ec None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:55.650998 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9a887-d9b2-4e11-b6dd-0e65304a62ec None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:55.660203 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a458005c-bef6-4018-a154-aece240b7274 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:55.667244 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:55.726855 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fcf1db-e3db-4fa9-875b-ce0069b40162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:55.727890 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fcf1db-e3db-4fa9-875b-ce0069b40162 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:55.728334 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fcf1db-e3db-4fa9-875b-ce0069b40162 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:55.728769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fcf1db-e3db-4fa9-875b-ce0069b40162 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:55.730096 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fcf1db-e3db-4fa9-875b-ce0069b40162 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:55.730332 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fcf1db-e3db-4fa9-875b-ce0069b40162 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:55.731610 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a723a41-aa3e-481b-9d20-105f29a09c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:55.732796 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fcf1db-e3db-4fa9-875b-ce0069b40162 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:55.733355 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a723a41-aa3e-481b-9d20-105f29a09c96 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:55.734116 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a723a41-aa3e-481b-9d20-105f29a09c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:55.734862 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a723a41-aa3e-481b-9d20-105f29a09c96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:55.750364 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:55.760758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a723a41-aa3e-481b-9d20-105f29a09c96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:30:55.765061 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 336/666] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:55.766958 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fcf1db-e3db-4fa9-875b-ce0069b40162 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:55.774146 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-0a723a41-aa3e-481b-9d20-105f29a09c96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:30:55.774146 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:55.774146 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:55.774146 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:55.774146 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:55.774146 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:55.774146 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:55.774146 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:55.774146 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:55.774146 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:55.774146 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:55.774146 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:55.774146 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:30:55.774146 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:30:55.774146 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:30:55.774146 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:30:55.776153 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:30:55.776153 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:30:55.776153 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:30:55.776153 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:30:55.776153 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:55.776153 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:55.776153 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:55.776153 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:55.776153 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:55.776153 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:55.776153 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:55.776153 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:55.776153 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:55.776153 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:55.776153 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:55.776153 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:55.778053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:55.778053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:55.778053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:55.778053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:55.778053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:30:55.778053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:30:55.778053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:30:55.778053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:30:55.778053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:30:55.778053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:30:55.778053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:30:55.778053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:55.781994 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 331/667] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 26 05:30:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:55.783676 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a723a41-aa3e-481b-9d20-105f29a09c96 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:55.952119 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a723a41-aa3e-481b-9d20-105f29a09c96 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:55.987840 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fcf1db-e3db-4fa9-875b-ce0069b40162 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:55.997820 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e346c6d-4394-465c-9351-6a6b0726cdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:55.998506 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e346c6d-4394-465c-9351-6a6b0726cdc4 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:55.998780 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e346c6d-4394-465c-9351-6a6b0726cdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:55.999036 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e346c6d-4394-465c-9351-6a6b0726cdc4 None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:55.999852 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e346c6d-4394-465c-9351-6a6b0726cdc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:56.000110 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e346c6d-4394-465c-9351-6a6b0726cdc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:56.001573 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e346c6d-4394-465c-9351-6a6b0726cdc4 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:56.037297 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 332/668] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:30:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:56.037297 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e346c6d-4394-465c-9351-6a6b0726cdc4 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:56.075863 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55488741-fc28-4d56-8a85-81d2979f6f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:56.077134 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55488741-fc28-4d56-8a85-81d2979f6f17 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:56.079535 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55488741-fc28-4d56-8a85-81d2979f6f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:56.080150 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55488741-fc28-4d56-8a85-81d2979f6f17 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:56.081644 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55488741-fc28-4d56-8a85-81d2979f6f17 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:56.082403 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55488741-fc28-4d56-8a85-81d2979f6f17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:56.084962 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55488741-fc28-4d56-8a85-81d2979f6f17 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:56.109333 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 337/669] 10.222.0.66 () {56 vars in 1139 bytes} [Mon Sep 26 05:30:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:56.111206 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55488741-fc28-4d56-8a85-81d2979f6f17 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:56.144882 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:56.150210 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:56.207697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e346c6d-4394-465c-9351-6a6b0726cdc4 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:56.269596 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147ecf7-5b54-4e4a-a092-1b7d6479f96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:56.270697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147ecf7-5b54-4e4a-a092-1b7d6479f96b None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:56.271173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147ecf7-5b54-4e4a-a092-1b7d6479f96b None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:56.271645 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b147ecf7-5b54-4e4a-a092-1b7d6479f96b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:56.272435 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55488741-fc28-4d56-8a85-81d2979f6f17 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:56.287951 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147ecf7-5b54-4e4a-a092-1b7d6479f96b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:56.291724 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b147ecf7-5b54-4e4a-a092-1b7d6479f96b None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:56.318457 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b10df-9fe0-4aca-9024-a83cb279ce25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:56.319421 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b10df-9fe0-4aca-9024-a83cb279ce25 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:56.319989 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b10df-9fe0-4aca-9024-a83cb279ce25 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:56.320434 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b10df-9fe0-4aca-9024-a83cb279ce25 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:56.321488 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b10df-9fe0-4aca-9024-a83cb279ce25 None admin] RBAC: Adding query filter params (name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:56.321613 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-b147ecf7-5b54-4e4a-a092-1b7d6479f96b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:30:56.321613 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:56.321613 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:56.321613 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:56.321613 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:56.321613 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:56.321613 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:56.321613 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:56.321613 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:56.321613 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:56.321613 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:56.321613 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:56.321613 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:30:56.321613 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:30:56.321613 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:30:56.322460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:30:56.322460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:56.322460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:56.322460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:56.322460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:56.322460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:56.322460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:56.322460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:56.322460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:56.322460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:56.322460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:56.322460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:56.322460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:56.322460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:56.322460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:56.322460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:56.322460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:56.323374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:30:56.323374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:30:56.323374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:30:56.323374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:30:56.323374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:30:56.323374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:30:56.323374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:30:56.323374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:56.324796 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b10df-9fe0-4aca-9024-a83cb279ce25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:56.326758 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b10df-9fe0-4aca-9024-a83cb279ce25 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:56.331955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 333/670] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:30:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:56.333547 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147ecf7-5b54-4e4a-a092-1b7d6479f96b None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:56.345259 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 338/671] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 26 05:30:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:56.346359 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b10df-9fe0-4aca-9024-a83cb279ce25 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:56.483394 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:56.494031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b147ecf7-5b54-4e4a-a092-1b7d6479f96b None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:56.502506 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b10df-9fe0-4aca-9024-a83cb279ce25 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:56.530664 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:56.561237 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f7717-6691-4210-8d25-1817a0f4c9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:56.561881 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f7717-6691-4210-8d25-1817a0f4c9af None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:56.562165 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f7717-6691-4210-8d25-1817a0f4c9af None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:56.562418 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f7717-6691-4210-8d25-1817a0f4c9af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:56.568783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246c3e5-b983-484b-a2b2-bb1ba56b3d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:56.569442 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246c3e5-b983-484b-a2b2-bb1ba56b3d29 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:56.569714 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246c3e5-b983-484b-a2b2-bb1ba56b3d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:56.570035 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246c3e5-b983-484b-a2b2-bb1ba56b3d29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:56.570788 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246c3e5-b983-484b-a2b2-bb1ba56b3d29 None admin] RBAC: Adding query filter params (role.id=024a61996071437aa07a3faf2bb5ae69, scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8, user.id=842ef2c8cd794023ac29bd03c768986b) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:56.571086 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246c3e5-b983-484b-a2b2-bb1ba56b3d29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:56.574633 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246c3e5-b983-484b-a2b2-bb1ba56b3d29 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:56.587882 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 334/672] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:30:56 2022] GET /identity/v3/role_assignments?user.id=842ef2c8cd794023ac29bd03c768986b&scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8&role.id=024a61996071437aa07a3faf2bb5ae69 => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:56.587882 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246c3e5-b983-484b-a2b2-bb1ba56b3d29 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:56.739842 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f7717-6691-4210-8d25-1817a0f4c9af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:56.739842 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f7717-6691-4210-8d25-1817a0f4c9af None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:56.784114 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246c3e5-b983-484b-a2b2-bb1ba56b3d29 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:56.868347 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ac3a9-98b9-418f-9cb6-28c1b99bb428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:56.869379 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ac3a9-98b9-418f-9cb6-28c1b99bb428 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:56.869833 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ac3a9-98b9-418f-9cb6-28c1b99bb428 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:56.870287 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ac3a9-98b9-418f-9cb6-28c1b99bb428 None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:56.871250 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ac3a9-98b9-418f-9cb6-28c1b99bb428 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:56.871889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ac3a9-98b9-418f-9cb6-28c1b99bb428 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:56.875994 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ac3a9-98b9-418f-9cb6-28c1b99bb428 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:56.895330 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 335/673] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:30:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:56.896728 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ac3a9-98b9-418f-9cb6-28c1b99bb428 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:56.909907 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:56.935695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 339/674] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:30:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:56.935695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95316209-f755-4f55-8a8f-6c0026a0215f None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:56.935695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95316209-f755-4f55-8a8f-6c0026a0215f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:56.935695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95316209-f755-4f55-8a8f-6c0026a0215f None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:56.936442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 340/675] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:56.937444 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95316209-f755-4f55-8a8f-6c0026a0215f None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:56.998969 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:57.091808 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95316209-f755-4f55-8a8f-6c0026a0215f None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:57.093198 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ac3a9-98b9-418f-9cb6-28c1b99bb428 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:57.146106 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd950897-0253-416b-a2f2-a3a4c26307bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:57.146926 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd950897-0253-416b-a2f2-a3a4c26307bb None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:57.147204 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd950897-0253-416b-a2f2-a3a4c26307bb None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:57.147468 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd950897-0253-416b-a2f2-a3a4c26307bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:57.160249 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd950897-0253-416b-a2f2-a3a4c26307bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:57.161896 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd950897-0253-416b-a2f2-a3a4c26307bb None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:57.167147 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf676b29-face-4e9c-9147-9c9ff3189b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:57.168811 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf676b29-face-4e9c-9147-9c9ff3189b06 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:57.169132 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf676b29-face-4e9c-9147-9c9ff3189b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:57.169567 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf676b29-face-4e9c-9147-9c9ff3189b06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:57.171140 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf676b29-face-4e9c-9147-9c9ff3189b06 None admin] RBAC: Adding query filter params (role.id=024a61996071437aa07a3faf2bb5ae69, scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8, user.id=c559a36836be411b9afd076f4c9a0655) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:57.171598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf676b29-face-4e9c-9147-9c9ff3189b06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:57.173981 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf676b29-face-4e9c-9147-9c9ff3189b06 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:57.181340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-dd950897-0253-416b-a2f2-a3a4c26307bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:57.181340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:57.181340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:57.181340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:57.181340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:57.181340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:57.181340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:57.181340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:57.181340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:57.181340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:57.181340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:57.181340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:57.181340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:57.181340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:57.181340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:57.181340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:57.183103 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:57.183103 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:57.183103 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:57.183103 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:57.183103 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:57.183103 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:57.183103 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:57.183103 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:57.183103 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:57.183103 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:57.183103 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:57.183103 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:57.183103 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:57.183103 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:57.183103 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:57.183103 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:57.183103 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:57.185704 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:57.185704 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:57.185704 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:57.185704 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 336/676] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:57.185704 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd950897-0253-416b-a2f2-a3a4c26307bb None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:57.198090 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 341/677] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:30:56 2022] GET /identity/v3/role_assignments?user.id=c559a36836be411b9afd076f4c9a0655&scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8&role.id=024a61996071437aa07a3faf2bb5ae69 => generated 608 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:57.198354 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d6f48-2cd4-4655-80ec-9ffd24b21a2c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:57.201205 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d6f48-2cd4-4655-80ec-9ffd24b21a2c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:57.201205 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d6f48-2cd4-4655-80ec-9ffd24b21a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:57.240297 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-9a0d6f48-2cd4-4655-80ec-9ffd24b21a2c None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:57.242324 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9a0d6f48-2cd4-4655-80ec-9ffd24b21a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:57.399620 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:57.422056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:57.442270 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd950897-0253-416b-a2f2-a3a4c26307bb None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:57.493531 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 342/678] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:30:57.497171 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d6f48-2cd4-4655-80ec-9ffd24b21a2c None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:57.603770 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcad808-7a29-447e-8a93-a5e762d9328f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:57.608237 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcad808-7a29-447e-8a93-a5e762d9328f None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:57.610191 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcad808-7a29-447e-8a93-a5e762d9328f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:57.610191 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcad808-7a29-447e-8a93-a5e762d9328f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:57.635885 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcad808-7a29-447e-8a93-a5e762d9328f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:57.638454 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcad808-7a29-447e-8a93-a5e762d9328f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:57.681401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-afcad808-7a29-447e-8a93-a5e762d9328f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:57.681401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:57.681401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:57.681401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:57.681401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:57.681401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:57.681401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:57.681401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:57.681401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:57.681401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:57.681401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:57.681401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:57.681401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:57.681401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:57.681401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:57.681401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:57.683175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:57.683175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:57.683175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:57.683175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:57.683175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:57.683175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:57.683175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:57.683175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:57.683175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:57.683175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:57.683175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:57.683175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:57.683175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:57.683175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:57.683175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:57.683175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:57.683175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:57.684995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:57.684995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:57.684995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:57.689644 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 337/679] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 506 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:57.706490 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcad808-7a29-447e-8a93-a5e762d9328f None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:57.763929 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d6f48-2cd4-4655-80ec-9ffd24b21a2c None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:57.831996 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5b16c-c95b-435f-9e21-c745ed76d13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:57.833466 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5b16c-c95b-435f-9e21-c745ed76d13a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:57.834219 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5b16c-c95b-435f-9e21-c745ed76d13a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:57.834830 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf5b16c-c95b-435f-9e21-c745ed76d13a None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:57.836270 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5b16c-c95b-435f-9e21-c745ed76d13a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:57.836987 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5b16c-c95b-435f-9e21-c745ed76d13a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:57.842005 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf5b16c-c95b-435f-9e21-c745ed76d13a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:57.882558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 343/680] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:57.895174 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5b16c-c95b-435f-9e21-c745ed76d13a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:57.934709 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcad808-7a29-447e-8a93-a5e762d9328f None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:57.981584 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806061f-a964-4995-87bc-e0816b34608c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:57.982945 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806061f-a964-4995-87bc-e0816b34608c None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:57.983592 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806061f-a964-4995-87bc-e0816b34608c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:57.984292 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806061f-a964-4995-87bc-e0816b34608c None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:57.985405 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806061f-a964-4995-87bc-e0816b34608c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:57.986541 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806061f-a964-4995-87bc-e0816b34608c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:57.989918 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806061f-a964-4995-87bc-e0816b34608c None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:58.011524 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:58.019774 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 338/681] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:58.026360 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806061f-a964-4995-87bc-e0816b34608c None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:58.049653 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:58.140250 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf5b16c-c95b-435f-9e21-c745ed76d13a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:58.223888 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806061f-a964-4995-87bc-e0816b34608c None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:58.266408 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807feee-9bf1-4d25-a665-4b0c5051cf30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:58.267494 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807feee-9bf1-4d25-a665-4b0c5051cf30 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:58.267494 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807feee-9bf1-4d25-a665-4b0c5051cf30 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:58.267841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d807feee-9bf1-4d25-a665-4b0c5051cf30 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:58.291767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807feee-9bf1-4d25-a665-4b0c5051cf30 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:58.291767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d807feee-9bf1-4d25-a665-4b0c5051cf30 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:58.293527 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53907bbb-e122-473f-8524-c156045dd87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:58.297607 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53907bbb-e122-473f-8524-c156045dd87e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:58.297607 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53907bbb-e122-473f-8524-c156045dd87e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:58.297607 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53907bbb-e122-473f-8524-c156045dd87e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:58.314789 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-d807feee-9bf1-4d25-a665-4b0c5051cf30 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 05:30:58.314789 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:58.314789 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:58.314789 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:58.314789 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:58.314789 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:58.314789 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:58.314789 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:58.314789 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:58.314789 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:58.314789 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:58.314789 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:58.314789 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:30:58.314789 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:30:58.314789 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:30:58.314789 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:30:58.316198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:58.316198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:58.316198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:30:58.316198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:30:58.316198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:30:58.316198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:30:58.316198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:58.316198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:58.316198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:58.316198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:58.316198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:58.316198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:58.316198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:58.316198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:58.316198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:58.316198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:58.316198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:58.316198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:58.317159 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:58.317159 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:58.317159 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:30:58.317159 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:30:58.317159 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:30:58.317159 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:30:58.317159 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:30:58.317159 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:30:58.317159 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 05:30:58.317159 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:58.317792 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53907bbb-e122-473f-8524-c156045dd87e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:58.321921 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53907bbb-e122-473f-8524-c156045dd87e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:58.322164 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 344/682] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:30:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 426 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:58.322164 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807feee-9bf1-4d25-a665-4b0c5051cf30 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:58.351784 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-53907bbb-e122-473f-8524-c156045dd87e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:30:58.351784 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:58.351784 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:58.351784 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:58.351784 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:58.351784 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:58.351784 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:58.351784 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:58.351784 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:58.351784 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:58.351784 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:58.351784 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:58.351784 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:30:58.351784 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:30:58.351784 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:30:58.353182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:30:58.353182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:58.353182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:58.353182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:58.353182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:58.353182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:58.353182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:58.353182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:58.353182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:58.353182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:58.353182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:58.353182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:58.353182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:58.353182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:58.353182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:58.353182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:58.353182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:58.354608 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:30:58.354608 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:30:58.354608 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:30:58.354608 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:30:58.354608 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:30:58.354608 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:30:58.354608 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:30:58.354608 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:30:58.360368 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 339/683] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:30:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:58.366182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53907bbb-e122-473f-8524-c156045dd87e None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:58.482090 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:58.554783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53907bbb-e122-473f-8524-c156045dd87e None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:58.619403 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d807feee-9bf1-4d25-a665-4b0c5051cf30 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:58.626314 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:58.653324 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de957d1e-38e5-4963-b721-21e2e9ed25f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:58.654020 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de957d1e-38e5-4963-b721-21e2e9ed25f4 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:58.659765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de957d1e-38e5-4963-b721-21e2e9ed25f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:58.659765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de957d1e-38e5-4963-b721-21e2e9ed25f4 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:58.659765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de957d1e-38e5-4963-b721-21e2e9ed25f4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:58.659765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de957d1e-38e5-4963-b721-21e2e9ed25f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:58.660180 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de957d1e-38e5-4963-b721-21e2e9ed25f4 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:58.706034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 340/684] 10.222.0.66 () {56 vars in 1135 bytes} [Mon Sep 26 05:30:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:58.706034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de957d1e-38e5-4963-b721-21e2e9ed25f4 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:58.735354 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef7c73-7f6e-43ca-b8d9-b25b8dc178a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:58.736311 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef7c73-7f6e-43ca-b8d9-b25b8dc178a4 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:58.736732 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef7c73-7f6e-43ca-b8d9-b25b8dc178a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:58.737139 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef7c73-7f6e-43ca-b8d9-b25b8dc178a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:58.768649 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef7c73-7f6e-43ca-b8d9-b25b8dc178a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:58.770766 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef7c73-7f6e-43ca-b8d9-b25b8dc178a4 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:58.811525 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-9bef7c73-7f6e-43ca-b8d9-b25b8dc178a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:58.811525 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:30:58.811525 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:30:58.811525 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:30:58.811525 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:30:58.811525 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:30:58.811525 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:30:58.811525 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:30:58.811525 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:30:58.811525 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:30:58.811525 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:30:58.811525 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:30:58.811525 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:30:58.811525 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:30:58.811525 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:30:58.811525 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:30:58.812673 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:30:58.812673 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:30:58.812673 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:30:58.812673 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:30:58.812673 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:30:58.812673 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:30:58.812673 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:30:58.812673 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:30:58.812673 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:30:58.812673 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:30:58.812673 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:30:58.812673 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:30:58.812673 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:30:58.812673 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:30:58.812673 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:30:58.812673 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:30:58.812673 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:30:58.813589 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:30:58.813589 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:30:58.813589 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:30:58.819771 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 345/685] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 498 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:30:58.821337 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef7c73-7f6e-43ca-b8d9-b25b8dc178a4 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:58.968344 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de957d1e-38e5-4963-b721-21e2e9ed25f4 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:59.040715 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:59.078191 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532dc49-df3e-4e78-8369-7fa1e04674bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:59.081075 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532dc49-df3e-4e78-8369-7fa1e04674bf None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:59.081643 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532dc49-df3e-4e78-8369-7fa1e04674bf None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:59.082185 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532dc49-df3e-4e78-8369-7fa1e04674bf None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:59.084620 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532dc49-df3e-4e78-8369-7fa1e04674bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:59.092370 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532dc49-df3e-4e78-8369-7fa1e04674bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:59.094318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532dc49-df3e-4e78-8369-7fa1e04674bf None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:59.104661 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef7c73-7f6e-43ca-b8d9-b25b8dc178a4 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:59.130972 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 341/686] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:30:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:59.132346 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532dc49-df3e-4e78-8369-7fa1e04674bf None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:59.194488 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a14d1-6b60-4683-b113-c8e302fb04e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:59.197083 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a14d1-6b60-4683-b113-c8e302fb04e6 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:59.197845 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a14d1-6b60-4683-b113-c8e302fb04e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:59.199489 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a14d1-6b60-4683-b113-c8e302fb04e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:59.237946 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:59.288256 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a14d1-6b60-4683-b113-c8e302fb04e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:59.290198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a14d1-6b60-4683-b113-c8e302fb04e6 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:59.299550 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532dc49-df3e-4e78-8369-7fa1e04674bf None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:59.342912 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e5486-aeaa-465e-bdda-8b225d22385f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:59.343546 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e5486-aeaa-465e-bdda-8b225d22385f None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:59.343858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e5486-aeaa-465e-bdda-8b225d22385f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:59.344115 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e5486-aeaa-465e-bdda-8b225d22385f None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:59.344776 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e5486-aeaa-465e-bdda-8b225d22385f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:59.345075 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e5486-aeaa-465e-bdda-8b225d22385f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:59.346818 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e5486-aeaa-465e-bdda-8b225d22385f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:59.366891 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 342/687] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:59.368109 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e5486-aeaa-465e-bdda-8b225d22385f None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:59.421012 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:59.422490 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 346/688] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:30:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:30:59.424264 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf599948-9cfb-499d-9b7f-60a4f5cecdb0 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:59.424558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf599948-9cfb-499d-9b7f-60a4f5cecdb0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:59.424832 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf599948-9cfb-499d-9b7f-60a4f5cecdb0 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:59.427921 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 347/689] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:30:59.427921 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf599948-9cfb-499d-9b7f-60a4f5cecdb0 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:59.488731 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e5486-aeaa-465e-bdda-8b225d22385f None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:59.493352 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:30:59.528781 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131aae5f-0cba-442b-88f7-985804df0789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:59.530015 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131aae5f-0cba-442b-88f7-985804df0789 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:59.530392 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131aae5f-0cba-442b-88f7-985804df0789 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:59.530756 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131aae5f-0cba-442b-88f7-985804df0789 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:59.531604 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131aae5f-0cba-442b-88f7-985804df0789 None admin] RBAC: Adding query filter params (role.id=024a61996071437aa07a3faf2bb5ae69, scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8, user.id=26b3d51ac6ca41cf9e535e751ac94675) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:30:59.532042 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131aae5f-0cba-442b-88f7-985804df0789 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:59.534314 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131aae5f-0cba-442b-88f7-985804df0789 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:59.552632 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf599948-9cfb-499d-9b7f-60a4f5cecdb0 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:59.560290 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 343/690] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:30:59 2022] GET /identity/v3/role_assignments?user.id=26b3d51ac6ca41cf9e535e751ac94675&scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8&role.id=024a61996071437aa07a3faf2bb5ae69 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:30:59.561341 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131aae5f-0cba-442b-88f7-985804df0789 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:30:59.597870 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff45ac8-72ca-41b9-b743-74b78da6b44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:30:59.599004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff45ac8-72ca-41b9-b743-74b78da6b44f None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:59.599511 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff45ac8-72ca-41b9-b743-74b78da6b44f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:59.600043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff45ac8-72ca-41b9-b743-74b78da6b44f None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:59.601072 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff45ac8-72ca-41b9-b743-74b78da6b44f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:30:59.603299 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff45ac8-72ca-41b9-b743-74b78da6b44f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:30:59.631410 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 348/691] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 26 05:30:59 2022] POST /identity/v3/users => generated 254 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:30:59.634688 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fb241-d123-42c8-a773-0b662982746a None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:30:59.635346 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fb241-d123-42c8-a773-0b662982746a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:30:59.636530 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1fb241-d123-42c8-a773-0b662982746a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:30:59.658975 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-1f1fb241-d123-42c8-a773-0b662982746a None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:30:59.661825 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1f1fb241-d123-42c8-a773-0b662982746a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:30:59.895871 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131aae5f-0cba-442b-88f7-985804df0789 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:30:59.921969 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 349/692] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:30:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:30:59.937493 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:00.013035 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0e940-823c-4c1f-ad6a-940ae736d919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:00.014116 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0e940-823c-4c1f-ad6a-940ae736d919 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:00.014596 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0e940-823c-4c1f-ad6a-940ae736d919 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:00.015065 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0e940-823c-4c1f-ad6a-940ae736d919 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:00.029406 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0e940-823c-4c1f-ad6a-940ae736d919 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:00.031317 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0e940-823c-4c1f-ad6a-940ae736d919 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:00.053252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-0ad0e940-823c-4c1f-ad6a-940ae736d919 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:00.053252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:00.053252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:00.053252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:00.053252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:00.053252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:00.053252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:00.053252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:00.053252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:00.053252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:00.053252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:00.053252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:00.053252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:31:00.053252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:31:00.053252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:31:00.053252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:31:00.054600 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:00.054600 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:00.054600 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:00.054600 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:00.054600 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:00.054600 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:00.054600 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:00.054600 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:00.054600 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:00.054600 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:00.054600 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:00.054600 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:00.054600 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:00.054600 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:00.054600 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:00.054600 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:00.054600 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:31:00.056455 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:31:00.056455 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:00.056455 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:00.063124 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 344/693] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:30:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 502 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:00.080120 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fb241-d123-42c8-a773-0b662982746a None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:00.113416 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeadbb9-3ca9-4c06-bf8a-193f43e85cba None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:00.114232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeadbb9-3ca9-4c06-bf8a-193f43e85cba None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:00.114929 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeadbb9-3ca9-4c06-bf8a-193f43e85cba None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:00.118672 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 345/694] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:00.124831 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27c9bf-24c7-46f6-9a1f-a5161d14bf68 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:00.125370 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27c9bf-24c7-46f6-9a1f-a5161d14bf68 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:00.125823 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27c9bf-24c7-46f6-9a1f-a5161d14bf68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:00.157863 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-7e27c9bf-24c7-46f6-9a1f-a5161d14bf68 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:00.159595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-7e27c9bf-24c7-46f6-9a1f-a5161d14bf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:00.175864 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:00.311551 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1fb241-d123-42c8-a773-0b662982746a None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:00.392674 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbce036-bf9a-4588-83e0-78ea1cb95aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:00.393580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 346/695] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:31:00.393704 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbce036-bf9a-4588-83e0-78ea1cb95aff None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:00.394139 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbce036-bf9a-4588-83e0-78ea1cb95aff None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:00.394466 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27c9bf-24c7-46f6-9a1f-a5161d14bf68 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:00.394657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbce036-bf9a-4588-83e0-78ea1cb95aff None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:00.395860 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbce036-bf9a-4588-83e0-78ea1cb95aff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:00.396380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbce036-bf9a-4588-83e0-78ea1cb95aff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:00.398967 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbce036-bf9a-4588-83e0-78ea1cb95aff None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:00.423024 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 350/696] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:31:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:00.433092 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbce036-bf9a-4588-83e0-78ea1cb95aff None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:00.619482 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:00.625084 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbce036-bf9a-4588-83e0-78ea1cb95aff None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:00.678993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95542f1-1f49-4bbe-9664-39523c9d5544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:00.681092 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95542f1-1f49-4bbe-9664-39523c9d5544 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:00.681586 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95542f1-1f49-4bbe-9664-39523c9d5544 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:00.682047 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95542f1-1f49-4bbe-9664-39523c9d5544 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:00.695305 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95542f1-1f49-4bbe-9664-39523c9d5544 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:00.699242 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95542f1-1f49-4bbe-9664-39523c9d5544 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:00.724541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-c95542f1-1f49-4bbe-9664-39523c9d5544 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:31:00.724541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:00.724541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:00.724541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:00.724541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:00.724541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:00.724541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:00.724541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:00.724541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:00.724541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:00.724541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:00.724541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:00.724541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:31:00.724541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:31:00.724541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:31:00.726293 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:31:00.726293 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:00.726293 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:00.726293 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:00.726293 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:00.726293 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:00.726293 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:00.726293 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:00.726293 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:00.726293 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:00.726293 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:00.726293 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:00.726293 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:00.726293 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:00.726293 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:00.726293 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:00.726293 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:00.728034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:31:00.728034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:31:00.728034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:31:00.728034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:31:00.728034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:31:00.728034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:31:00.728034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:31:00.728034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:00.728034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 351/697] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:31:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:00.747521 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:00.749119 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95542f1-1f49-4bbe-9664-39523c9d5544 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:00.776143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27c9bf-24c7-46f6-9a1f-a5161d14bf68 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:00.895053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65cf9d-ea86-4d5e-8358-607ed0682fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:00.895767 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65cf9d-ea86-4d5e-8358-607ed0682fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:00.896052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65cf9d-ea86-4d5e-8358-607ed0682fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:00.896905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65cf9d-ea86-4d5e-8358-607ed0682fb4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:00.896905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65cf9d-ea86-4d5e-8358-607ed0682fb4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:00.898343 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65cf9d-ea86-4d5e-8358-607ed0682fb4 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:00.912683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-2e65cf9d-ea86-4d5e-8358-607ed0682fb4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 05:31:00.912683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:00.912683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:31:00.912683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:31:00.912683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:31:00.912683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:31:00.912683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:31:00.912683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:00.912683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 05:31:00.912683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:00.912683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:31:00.912683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:00.912683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:00.912683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:00.912683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:00.912683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:00.912683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:00.914695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:00.914695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:00.914695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:00.914695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:00.914695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:00.914695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:00.914695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:31:00.914695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:31:00.914695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:31:00.914695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:31:00.914695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:00.914695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:00.914695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:00.914695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:00.914695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:00.914695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:00.916417 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:00.916417 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:00.916417 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:00.916417 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:00.916417 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:00.916417 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:00.916417 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:00.916417 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:00.916417 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:00.916417 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:00.916417 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:31:00.916417 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:00.916417 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 05:31:00.916417 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:00.919217 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 347/698] 10.222.0.66 () {56 vars in 1129 bytes} [Mon Sep 26 05:31:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 525 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:00.920239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65cf9d-ea86-4d5e-8358-607ed0682fb4 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:01.016846 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95542f1-1f49-4bbe-9664-39523c9d5544 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:01.063051 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65cf9d-ea86-4d5e-8358-607ed0682fb4 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:01.081402 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea3204-582c-43bf-bbc0-3e3e1a9a5a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:01.083042 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea3204-582c-43bf-bbc0-3e3e1a9a5a59 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:01.083918 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea3204-582c-43bf-bbc0-3e3e1a9a5a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:01.084677 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea3204-582c-43bf-bbc0-3e3e1a9a5a59 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:01.086270 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea3204-582c-43bf-bbc0-3e3e1a9a5a59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:01.087113 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea3204-582c-43bf-bbc0-3e3e1a9a5a59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:01.090255 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea3204-582c-43bf-bbc0-3e3e1a9a5a59 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:01.104537 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca1e7e-7812-45aa-840a-bb2d5fa39e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:01.105192 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca1e7e-7812-45aa-840a-bb2d5fa39e81 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:01.105468 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca1e7e-7812-45aa-840a-bb2d5fa39e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:01.105739 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca1e7e-7812-45aa-840a-bb2d5fa39e81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:01.114866 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 352/699] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:31:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:01.116266 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea3204-582c-43bf-bbc0-3e3e1a9a5a59 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:01.118578 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca1e7e-7812-45aa-840a-bb2d5fa39e81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:31:01.125422 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-03ca1e7e-7812-45aa-840a-bb2d5fa39e81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:31:01.125422 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:01.125422 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:01.125422 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:01.125422 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:01.125422 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:01.125422 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:01.125422 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:01.125422 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:01.125422 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:01.125422 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:01.125422 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:01.125422 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:31:01.125422 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:31:01.125422 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:31:01.125422 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:31:01.126445 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:31:01.126445 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:31:01.126445 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:31:01.126445 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:31:01.126445 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:01.126445 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:01.126445 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:01.126445 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:01.126445 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:01.126445 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:01.126445 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:01.126445 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:01.126445 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:01.126445 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:01.126445 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:01.126445 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:01.127326 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:01.127326 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:01.127326 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:01.127326 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:01.127326 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:31:01.127326 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:31:01.127326 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:31:01.127326 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:31:01.127326 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:31:01.127326 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:31:01.127326 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:31:01.127326 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:01.131829 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 348/700] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:31:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:01.133170 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca1e7e-7812-45aa-840a-bb2d5fa39e81 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:01.150432 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:01.152448 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:01.268173 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea3204-582c-43bf-bbc0-3e3e1a9a5a59 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:01.274459 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca1e7e-7812-45aa-840a-bb2d5fa39e81 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:01.309157 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac12b9-91ec-477f-a635-1f6577bac131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:01.309778 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac12b9-91ec-477f-a635-1f6577bac131 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:01.310052 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac12b9-91ec-477f-a635-1f6577bac131 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:01.310324 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac12b9-91ec-477f-a635-1f6577bac131 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:01.310975 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac12b9-91ec-477f-a635-1f6577bac131 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:01.311277 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac12b9-91ec-477f-a635-1f6577bac131 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:01.313283 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac12b9-91ec-477f-a635-1f6577bac131 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:01.323920 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 353/701] 10.222.0.66 () {56 vars in 1124 bytes} [Mon Sep 26 05:31:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:01.324869 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac12b9-91ec-477f-a635-1f6577bac131 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:01.344983 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f32a18-d3e6-45d8-ab52-65a8551f287d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:01.345722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f32a18-d3e6-45d8-ab52-65a8551f287d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:01.345999 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f32a18-d3e6-45d8-ab52-65a8551f287d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:01.346263 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f32a18-d3e6-45d8-ab52-65a8551f287d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:01.347010 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f32a18-d3e6-45d8-ab52-65a8551f287d None admin] RBAC: Adding query filter params (role.id=024a61996071437aa07a3faf2bb5ae69, scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8, user.id=830cd52ac42548b2ade17b5215aefd28) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:01.347345 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f32a18-d3e6-45d8-ab52-65a8551f287d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:01.348894 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f32a18-d3e6-45d8-ab52-65a8551f287d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:01.361461 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 349/702] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:31:01 2022] GET /identity/v3/role_assignments?user.id=830cd52ac42548b2ade17b5215aefd28&scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8&role.id=024a61996071437aa07a3faf2bb5ae69 => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:01.361461 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f32a18-d3e6-45d8-ab52-65a8551f287d None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:01.510240 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:01.526312 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac12b9-91ec-477f-a635-1f6577bac131 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:01.596323 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:01.605867 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c7e19-6f26-424a-836b-15f75c5d261f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:01.606813 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c7e19-6f26-424a-836b-15f75c5d261f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:01.607278 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c7e19-6f26-424a-836b-15f75c5d261f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:01.607705 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c7e19-6f26-424a-836b-15f75c5d261f None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:01.608606 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c7e19-6f26-424a-836b-15f75c5d261f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:01.609120 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c7e19-6f26-424a-836b-15f75c5d261f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:01.610750 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c7e19-6f26-424a-836b-15f75c5d261f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:01.620940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 354/703] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:31:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:01.627245 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c7e19-6f26-424a-836b-15f75c5d261f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:01.644549 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f32a18-d3e6-45d8-ab52-65a8551f287d None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:01.692656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b147f-d6f3-48b6-91fe-c2f5c9c0596c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:01.693287 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b147f-d6f3-48b6-91fe-c2f5c9c0596c None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:01.693564 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b147f-d6f3-48b6-91fe-c2f5c9c0596c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:01.693843 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b147f-d6f3-48b6-91fe-c2f5c9c0596c None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:01.694486 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b147f-d6f3-48b6-91fe-c2f5c9c0596c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:01.694826 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b147f-d6f3-48b6-91fe-c2f5c9c0596c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:01.696267 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b147f-d6f3-48b6-91fe-c2f5c9c0596c None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:01.710595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 350/704] 10.222.0.66 () {56 vars in 1124 bytes} [Mon Sep 26 05:31:01 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:01.853120 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c7e19-6f26-424a-836b-15f75c5d261f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:01.913728 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bae546-17d0-44c2-b341-cdfeb500d0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:01.914422 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bae546-17d0-44c2-b341-cdfeb500d0ec None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:01.914660 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bae546-17d0-44c2-b341-cdfeb500d0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:01.914931 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bae546-17d0-44c2-b341-cdfeb500d0ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:01.935757 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bae546-17d0-44c2-b341-cdfeb500d0ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:01.938599 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bae546-17d0-44c2-b341-cdfeb500d0ec None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:01.956447 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:01.967495 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-28bae546-17d0-44c2-b341-cdfeb500d0ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:01.967495 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:01.967495 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:01.967495 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:01.967495 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:01.967495 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:01.967495 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:01.967495 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:01.967495 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:01.967495 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:01.967495 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:01.967495 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:01.967495 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:31:01.967495 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:31:01.967495 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:31:01.967495 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:31:01.969451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:01.969451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:01.969451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:01.969451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:01.969451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:01.969451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:01.969451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:01.969451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:01.969451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:01.969451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:01.969451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:01.969451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:01.969451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:01.969451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:01.969451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:01.969451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:01.969451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:31:01.971187 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:31:01.971187 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:01.971187 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:01.971187 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 355/705] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:31:01.977880 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b147f-d6f3-48b6-91fe-c2f5c9c0596c None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:02.150393 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b147f-d6f3-48b6-91fe-c2f5c9c0596c None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:02.196641 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6be2f-d4d7-49a5-b285-ebed3403cb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:02.197685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6be2f-d4d7-49a5-b285-ebed3403cb27 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:02.198199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6be2f-d4d7-49a5-b285-ebed3403cb27 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:02.198666 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6be2f-d4d7-49a5-b285-ebed3403cb27 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:02.199596 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6be2f-d4d7-49a5-b285-ebed3403cb27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:02.200123 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6be2f-d4d7-49a5-b285-ebed3403cb27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:02.201740 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6be2f-d4d7-49a5-b285-ebed3403cb27 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:02.216875 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 351/706] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:02.223070 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bae546-17d0-44c2-b341-cdfeb500d0ec None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:02.360050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bae546-17d0-44c2-b341-cdfeb500d0ec None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:02.416685 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1312d2-c9b7-464a-8fea-a9305ce72dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:02.417372 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1312d2-c9b7-464a-8fea-a9305ce72dfa None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:02.417732 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1312d2-c9b7-464a-8fea-a9305ce72dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:02.419243 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1312d2-c9b7-464a-8fea-a9305ce72dfa None admin] PATH_INFO: `/v3/users/nova` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:02.437855 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1312d2-c9b7-464a-8fea-a9305ce72dfa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:02.441441 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1312d2-c9b7-464a-8fea-a9305ce72dfa None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:02.475916 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-0e1312d2-c9b7-464a-8fea-a9305ce72dfa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:31:02.475916 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:02.475916 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:02.475916 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:02.475916 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:02.475916 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:02.475916 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:02.475916 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:02.475916 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:02.475916 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:02.475916 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:02.475916 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:02.475916 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:31:02.475916 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:31:02.475916 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:31:02.475916 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:31:02.476993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:02.476993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:02.476993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:31:02.476993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:31:02.476993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:31:02.476993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:31:02.476993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:02.476993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:02.476993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:02.476993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:02.476993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:02.476993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:02.476993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:02.476993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:02.476993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:02.476993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:02.476993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:02.476993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:02.477953 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:02.477953 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:02.477953 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:31:02.477953 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:31:02.477953 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:31:02.477953 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:31:02.477953 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:31:02.477953 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:31:02.477953 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:31:02.477953 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:02.477953 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 356/707] 10.222.0.66 () {56 vars in 1093 bytes} [Mon Sep 26 05:31:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:02.489523 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6be2f-d4d7-49a5-b285-ebed3403cb27 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:02.492587 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:02.673693 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80582d-b7cc-48a5-948c-4ec4e1e0cae4 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:02.674031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80582d-b7cc-48a5-948c-4ec4e1e0cae4 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:02.674224 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd80582d-b7cc-48a5-948c-4ec4e1e0cae4 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:02.676170 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 357/708] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:02.682060 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac22fb1-3f72-4ed5-b0b1-096334a386bd None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:02.682357 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac22fb1-3f72-4ed5-b0b1-096334a386bd None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:02.682583 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac22fb1-3f72-4ed5-b0b1-096334a386bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:02.717774 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6be2f-d4d7-49a5-b285-ebed3403cb27 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:02.756393 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc109fa-52d7-414c-a0d5-6f099877d77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:02.757110 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-dac22fb1-3f72-4ed5-b0b1-096334a386bd None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:02.757341 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc109fa-52d7-414c-a0d5-6f099877d77a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:02.757729 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc109fa-52d7-414c-a0d5-6f099877d77a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:02.758089 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc109fa-52d7-414c-a0d5-6f099877d77a None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:02.758933 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc109fa-52d7-414c-a0d5-6f099877d77a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:02.759178 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-dac22fb1-3f72-4ed5-b0b1-096334a386bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:02.759413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc109fa-52d7-414c-a0d5-6f099877d77a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:02.761011 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc109fa-52d7-414c-a0d5-6f099877d77a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:02.781728 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 352/709] 10.222.0.66 () {56 vars in 1133 bytes} [Mon Sep 26 05:31:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:02.788961 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc109fa-52d7-414c-a0d5-6f099877d77a None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:02.851207 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:02.868793 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 358/710] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:31:02.875781 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e892ebe-d16c-4b4b-958f-118cd8e8faad None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:02.876759 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e892ebe-d16c-4b4b-958f-118cd8e8faad None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:02.877234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e892ebe-d16c-4b4b-958f-118cd8e8faad None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:02.879333 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 359/711] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:02.889341 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592768b0-0a00-4858-b738-6d5972947c53 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:02.889913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592768b0-0a00-4858-b738-6d5972947c53 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:02.890364 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592768b0-0a00-4858-b738-6d5972947c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:02.921265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:02.927507 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-592768b0-0a00-4858-b738-6d5972947c53 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:02.929624 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-592768b0-0a00-4858-b738-6d5972947c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:02.981262 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc109fa-52d7-414c-a0d5-6f099877d77a None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:03.054378 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 360/712] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 26 05:31:03.057853 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6656ef3-26c6-40e5-969e-aec6d6327f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:03.058717 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6656ef3-26c6-40e5-969e-aec6d6327f0f None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:03.059134 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6656ef3-26c6-40e5-969e-aec6d6327f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:03.059564 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6656ef3-26c6-40e5-969e-aec6d6327f0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:03.140408 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6656ef3-26c6-40e5-969e-aec6d6327f0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:03.142109 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6656ef3-26c6-40e5-969e-aec6d6327f0f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:03.210988 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:03.258281 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 353/713] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:31:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:03.265509 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592768b0-0a00-4858-b738-6d5972947c53 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:03.346389 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6656ef3-26c6-40e5-969e-aec6d6327f0f None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:03.497033 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592768b0-0a00-4858-b738-6d5972947c53 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:03.498675 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6656ef3-26c6-40e5-969e-aec6d6327f0f None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:03.518873 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:03.539761 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24c3ba-e463-4f36-9bfb-d4414fe98745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:03.540835 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24c3ba-e463-4f36-9bfb-d4414fe98745 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:03.541354 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24c3ba-e463-4f36-9bfb-d4414fe98745 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:03.541822 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24c3ba-e463-4f36-9bfb-d4414fe98745 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:03.549062 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c8372-4389-4dd7-abfd-9a6f58d8f536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:03.549733 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c8372-4389-4dd7-abfd-9a6f58d8f536 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:03.550003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c8372-4389-4dd7-abfd-9a6f58d8f536 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:03.550268 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c8372-4389-4dd7-abfd-9a6f58d8f536 None admin] PATH_INFO: `/v3/services/network` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:03.550879 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c8372-4389-4dd7-abfd-9a6f58d8f536 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:03.554957 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c8372-4389-4dd7-abfd-9a6f58d8f536 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:03.559131 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24c3ba-e463-4f36-9bfb-d4414fe98745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:03.560694 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24c3ba-e463-4f36-9bfb-d4414fe98745 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:03.574737 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-ea1c8372-4389-4dd7-abfd-9a6f58d8f536 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 05:31:03.574737 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:03.574737 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:31:03.574737 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:31:03.574737 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:31:03.574737 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:31:03.574737 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:31:03.574737 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:03.574737 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 05:31:03.574737 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:03.574737 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:31:03.574737 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:03.574737 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:03.574737 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:03.574737 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:03.574737 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:03.574737 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:03.576908 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:03.576908 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:03.576908 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:03.576908 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:03.576908 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:03.576908 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:03.576908 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:31:03.576908 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:31:03.576908 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:31:03.576908 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:31:03.576908 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:03.576908 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:03.576908 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:03.576908 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:03.576908 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:03.576908 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:03.578888 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:03.578888 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:03.578888 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:03.578888 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:03.578888 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:03.578888 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:03.578888 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:03.578888 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:03.578888 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:03.578888 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:03.578888 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:31:03.578888 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:03.578888 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 05:31:03.578888 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:03.578888 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 354/714] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:31:03 2022] GET /identity/v3/services/network => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:03.584746 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c8372-4389-4dd7-abfd-9a6f58d8f536 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:03.594043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-0e24c3ba-e463-4f36-9bfb-d4414fe98745 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:03.594043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:03.594043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:03.594043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:03.594043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:03.594043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:03.594043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:03.594043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:03.594043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:03.594043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:03.594043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:03.594043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:03.594043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:31:03.594043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:31:03.594043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:31:03.594043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:31:03.595075 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:03.595075 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:03.595075 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:03.595075 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:03.595075 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:03.595075 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:03.595075 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:03.595075 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:03.595075 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:03.595075 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:03.595075 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:03.595075 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:03.595075 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:03.595075 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:03.595075 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:03.595075 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:03.595075 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:31:03.596043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:31:03.596043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:03.596043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:03.598515 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 361/715] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:03.599657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24c3ba-e463-4f36-9bfb-d4414fe98745 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:03.630317 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:03.765034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c8372-4389-4dd7-abfd-9a6f58d8f536 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:03.806777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165f357-d4cf-4f7f-84bd-e7bc2144fc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:03.807457 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165f357-d4cf-4f7f-84bd-e7bc2144fc92 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:03.807748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165f357-d4cf-4f7f-84bd-e7bc2144fc92 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:03.808017 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165f357-d4cf-4f7f-84bd-e7bc2144fc92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:03.820757 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165f357-d4cf-4f7f-84bd-e7bc2144fc92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:31:03.825764 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24c3ba-e463-4f36-9bfb-d4414fe98745 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:03.826360 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-6165f357-d4cf-4f7f-84bd-e7bc2144fc92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:31:03.826360 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:03.826360 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:03.826360 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:03.826360 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:03.826360 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:03.826360 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:03.826360 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:03.826360 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:03.826360 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:03.826360 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:03.826360 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:03.826360 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:31:03.826360 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:31:03.826360 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:31:03.826360 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:31:03.827637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:31:03.827637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:31:03.827637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:31:03.827637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:31:03.827637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:03.827637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:03.827637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:03.827637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:03.827637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:03.827637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:03.827637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:03.827637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:03.827637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:03.827637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:03.827637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:03.827637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:03.828518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:03.828518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:03.828518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:03.828518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:03.828518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:31:03.828518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:31:03.828518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:31:03.828518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:31:03.828518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:31:03.828518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:31:03.828518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:31:03.828518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:03.828518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 355/716] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 26 05:31:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:03.829246 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165f357-d4cf-4f7f-84bd-e7bc2144fc92 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:03.876343 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769dccc-d702-470b-b316-2385e8dd5e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:03.877033 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769dccc-d702-470b-b316-2385e8dd5e41 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:03.877215 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769dccc-d702-470b-b316-2385e8dd5e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:03.877486 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769dccc-d702-470b-b316-2385e8dd5e41 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:03.878127 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a769dccc-d702-470b-b316-2385e8dd5e41 None admin] RBAC: Adding query filter params (name=network) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:03.878430 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a769dccc-d702-470b-b316-2385e8dd5e41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:03.879865 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a769dccc-d702-470b-b316-2385e8dd5e41 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:03.889926 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 362/717] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Sep 26 05:31:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:03.890911 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769dccc-d702-470b-b316-2385e8dd5e41 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:03.943239 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:04.022721 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:04.032186 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769dccc-d702-470b-b316-2385e8dd5e41 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:04.069382 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165f357-d4cf-4f7f-84bd-e7bc2144fc92 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:04.075123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cdb7f-6e49-4d14-a339-dacdcad216e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:04.076748 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cdb7f-6e49-4d14-a339-dacdcad216e7 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:04.076748 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cdb7f-6e49-4d14-a339-dacdcad216e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:04.076748 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cdb7f-6e49-4d14-a339-dacdcad216e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:04.077825 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9cdb7f-6e49-4d14-a339-dacdcad216e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:04.078227 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9cdb7f-6e49-4d14-a339-dacdcad216e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:04.079847 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9cdb7f-6e49-4d14-a339-dacdcad216e7 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:04.091512 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 363/718] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 26 05:31:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:04.092640 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cdb7f-6e49-4d14-a339-dacdcad216e7 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:04.157677 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b9261-6234-4860-a76a-649960cf796b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:04.159090 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b9261-6234-4860-a76a-649960cf796b None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:04.160407 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b9261-6234-4860-a76a-649960cf796b None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:04.161067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b9261-6234-4860-a76a-649960cf796b None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:04.162788 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b9261-6234-4860-a76a-649960cf796b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:04.163591 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b9261-6234-4860-a76a-649960cf796b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:04.167581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b9261-6234-4860-a76a-649960cf796b None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:04.198484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 356/719] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:04.200520 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b9261-6234-4860-a76a-649960cf796b None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:04.265501 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:04.273621 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cdb7f-6e49-4d14-a339-dacdcad216e7 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:04.330680 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686779d-3770-47e2-b8ae-a3708f5ad376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:04.331861 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686779d-3770-47e2-b8ae-a3708f5ad376 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:04.332133 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686779d-3770-47e2-b8ae-a3708f5ad376 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:04.332405 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686779d-3770-47e2-b8ae-a3708f5ad376 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:04.333422 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4686779d-3770-47e2-b8ae-a3708f5ad376 None admin] RBAC: Adding query filter params (type=network) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:04.333722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4686779d-3770-47e2-b8ae-a3708f5ad376 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:04.336565 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4686779d-3770-47e2-b8ae-a3708f5ad376 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:04.355774 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 364/720] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Sep 26 05:31:04 2022] GET /identity/v3/services?type=network => generated 124 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:04.355774 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686779d-3770-47e2-b8ae-a3708f5ad376 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:04.378708 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b9261-6234-4860-a76a-649960cf796b None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:04.456454 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a84cd-01d7-4fc3-9c51-e767bd64dbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:04.457449 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a84cd-01d7-4fc3-9c51-e767bd64dbfb None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:04.458203 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a84cd-01d7-4fc3-9c51-e767bd64dbfb None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:04.458644 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a84cd-01d7-4fc3-9c51-e767bd64dbfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:04.481163 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a84cd-01d7-4fc3-9c51-e767bd64dbfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:04.484644 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a84cd-01d7-4fc3-9c51-e767bd64dbfb None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:04.498758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:04.517690 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-744a84cd-01d7-4fc3-9c51-e767bd64dbfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:04.517690 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:04.517690 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:04.517690 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:04.517690 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:04.517690 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:04.517690 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:04.517690 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:04.517690 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:04.517690 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:04.517690 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:04.517690 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:04.517690 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:31:04.517690 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:31:04.517690 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:31:04.517690 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:31:04.519639 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:04.519639 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:04.519639 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:04.519639 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:04.519639 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:04.519639 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:04.519639 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:04.519639 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:04.519639 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:04.519639 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:04.519639 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:04.519639 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:04.519639 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:04.519639 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:04.519639 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:04.519639 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:04.519639 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:31:04.521482 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:31:04.521482 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:04.521482 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:04.521482 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 357/721] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:04.524942 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89832222-f473-4cdb-b188-ffa96a27a61a None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:04.525296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89832222-f473-4cdb-b188-ffa96a27a61a None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:04.525988 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89832222-f473-4cdb-b188-ffa96a27a61a None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:04.534984 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 358/722] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:04.537182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89832222-f473-4cdb-b188-ffa96a27a61a None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:04.539984 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686779d-3770-47e2-b8ae-a3708f5ad376 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:04.599398 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d40736-10ae-4e96-9069-5233dfb69a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:04.600567 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d40736-10ae-4e96-9069-5233dfb69a85 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:04.601077 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d40736-10ae-4e96-9069-5233dfb69a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:04.601510 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d40736-10ae-4e96-9069-5233dfb69a85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:04.614359 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d40736-10ae-4e96-9069-5233dfb69a85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:04.617195 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d40736-10ae-4e96-9069-5233dfb69a85 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:04.639518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-c2d40736-10ae-4e96-9069-5233dfb69a85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:31:04.639518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:04.639518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:04.639518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:04.639518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:04.639518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:04.639518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:04.639518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:04.639518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:04.639518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:04.639518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:04.639518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:04.639518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:31:04.639518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:31:04.639518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:31:04.641300 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:31:04.641300 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:04.641300 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:04.641300 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:04.641300 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:04.641300 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:04.641300 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:04.641300 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:04.641300 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:04.641300 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:04.641300 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:04.641300 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:04.641300 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:04.641300 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:04.641300 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:04.641300 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:04.641300 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:04.643035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:31:04.643035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:31:04.643035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:31:04.643035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:31:04.643035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:31:04.643035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:31:04.643035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:31:04.643035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:04.643035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 365/723] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:31:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:04.645067 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb263d3-18f9-44c1-8a11-c714292dd757 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:04.645067 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb263d3-18f9-44c1-8a11-c714292dd757 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:04.645067 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb263d3-18f9-44c1-8a11-c714292dd757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:04.675213 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-3cb263d3-18f9-44c1-8a11-c714292dd757 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:04.677154 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3cb263d3-18f9-44c1-8a11-c714292dd757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:04.703548 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:04.730611 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89832222-f473-4cdb-b188-ffa96a27a61a None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:04.770852 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fe032-8252-4bdb-a67a-cd4b73d442f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:04.771539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fe032-8252-4bdb-a67a-cd4b73d442f7 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:04.772030 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fe032-8252-4bdb-a67a-cd4b73d442f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:04.772428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fe032-8252-4bdb-a67a-cd4b73d442f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:04.773455 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fe032-8252-4bdb-a67a-cd4b73d442f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:04.773893 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fe032-8252-4bdb-a67a-cd4b73d442f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:04.776015 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fe032-8252-4bdb-a67a-cd4b73d442f7 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:04.784853 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 366/724] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:31:04.786912 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a06fa-4b46-4403-b50d-02e987fd5c34 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:04.787434 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a06fa-4b46-4403-b50d-02e987fd5c34 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:04.787916 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a06fa-4b46-4403-b50d-02e987fd5c34 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:04.790063 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 367/725] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:04.790855 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a06fa-4b46-4403-b50d-02e987fd5c34 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:04.803881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 359/726] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:04.809924 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901095e-6f76-4bc1-b821-0673613b0fa3 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:04.810318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901095e-6f76-4bc1-b821-0673613b0fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:04.810582 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901095e-6f76-4bc1-b821-0673613b0fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:04.835543 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-d901095e-6f76-4bc1-b821-0673613b0fa3 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:04.836811 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d901095e-6f76-4bc1-b821-0673613b0fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:04.911611 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:04.948439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 360/727] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:31:04.950190 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901095e-6f76-4bc1-b821-0673613b0fa3 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:04.971595 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a06fa-4b46-4403-b50d-02e987fd5c34 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:05.053995 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbe402-4677-4471-8ff6-fd97d77a0c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:05.055411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbe402-4677-4471-8ff6-fd97d77a0c30 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:05.058491 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbe402-4677-4471-8ff6-fd97d77a0c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:05.059181 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbe402-4677-4471-8ff6-fd97d77a0c30 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:05.062383 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedbe402-4677-4471-8ff6-fd97d77a0c30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:05.064445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedbe402-4677-4471-8ff6-fd97d77a0c30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:05.069553 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedbe402-4677-4471-8ff6-fd97d77a0c30 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:05.115925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 368/728] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:31:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:05.125663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbe402-4677-4471-8ff6-fd97d77a0c30 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:05.179554 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:05.193126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901095e-6f76-4bc1-b821-0673613b0fa3 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:05.262990 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b9404-8e95-4040-934a-2ba3063143db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:05.264706 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b9404-8e95-4040-934a-2ba3063143db None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:05.265426 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b9404-8e95-4040-934a-2ba3063143db None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:05.266131 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b9404-8e95-4040-934a-2ba3063143db None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:05.280872 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b9404-8e95-4040-934a-2ba3063143db None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:05.283842 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b9404-8e95-4040-934a-2ba3063143db None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:05.307193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-e25b9404-8e95-4040-934a-2ba3063143db None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 05:31:05.307193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:05.307193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:05.307193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:05.307193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:05.307193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:05.307193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:05.307193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:05.307193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:05.307193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:05.307193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:05.307193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:05.307193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:31:05.307193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:31:05.307193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:31:05.307193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:31:05.309019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:05.309019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:05.309019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:31:05.309019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:31:05.309019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:31:05.309019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:31:05.309019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:05.309019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:05.309019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:05.309019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:05.309019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:05.309019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:05.309019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:05.309019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:05.309019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:05.309019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:05.309019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:05.309019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:05.310871 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:05.310871 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:05.310871 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:31:05.310871 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:31:05.310871 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:31:05.310871 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:31:05.310871 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:31:05.310871 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:31:05.310871 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 05:31:05.310871 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:05.314970 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 361/729] 10.222.0.66 () {56 vars in 1117 bytes} [Mon Sep 26 05:31:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:05.316551 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b9404-8e95-4040-934a-2ba3063143db None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:05.342126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbe402-4677-4471-8ff6-fd97d77a0c30 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:05.379726 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb239f-426c-4c7e-ad13-8ee1e0ef9000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:05.380366 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb239f-426c-4c7e-ad13-8ee1e0ef9000 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:05.380640 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb239f-426c-4c7e-ad13-8ee1e0ef9000 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:05.380906 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb239f-426c-4c7e-ad13-8ee1e0ef9000 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:05.381213 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:05.381640 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb239f-426c-4c7e-ad13-8ee1e0ef9000 None admin] RBAC: Adding query filter params (role.id=cf58d66369044fb09fa65a4366dc7446, scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8, user.id=c559a36836be411b9afd076f4c9a0655) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:05.381986 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb239f-426c-4c7e-ad13-8ee1e0ef9000 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:05.383896 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb239f-426c-4c7e-ad13-8ee1e0ef9000 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:05.392628 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 369/730] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:31:05 2022] GET /identity/v3/role_assignments?user.id=c559a36836be411b9afd076f4c9a0655&scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8&role.id=cf58d66369044fb09fa65a4366dc7446 => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:31:05.393483 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb239f-426c-4c7e-ad13-8ee1e0ef9000 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:05.462063 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b9404-8e95-4040-934a-2ba3063143db None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:05.503469 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:05.515235 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6f714-8b46-4c49-b1cd-79e58c00377d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:05.515941 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6f714-8b46-4c49-b1cd-79e58c00377d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:05.516218 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6f714-8b46-4c49-b1cd-79e58c00377d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:05.516493 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb6f714-8b46-4c49-b1cd-79e58c00377d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:05.531658 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb6f714-8b46-4c49-b1cd-79e58c00377d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:31:05.539284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-efb6f714-8b46-4c49-b1cd-79e58c00377d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:31:05.539284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:05.539284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:05.539284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:05.539284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:05.539284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:05.539284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:05.539284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:05.539284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:05.539284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:05.539284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:05.539284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:05.539284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:31:05.539284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:31:05.539284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:31:05.539284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:31:05.548199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:31:05.548199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:31:05.548199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:31:05.548199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:31:05.548199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:05.548199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:05.548199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:05.548199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:05.548199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:05.548199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:05.548199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:05.548199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:05.548199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:05.548199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:05.548199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:05.548199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:05.549461 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:05.549461 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:05.549461 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:05.549461 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:05.549461 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:31:05.549461 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:31:05.549461 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:31:05.549461 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:31:05.549461 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:31:05.549461 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:31:05.549461 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:31:05.549461 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:05.549461 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 362/731] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:31:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:05.549461 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6f714-8b46-4c49-b1cd-79e58c00377d None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:05.565185 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb239f-426c-4c7e-ad13-8ee1e0ef9000 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:05.617567 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247708a-2fba-4150-b0c9-eea55d043eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:05.618636 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247708a-2fba-4150-b0c9-eea55d043eef None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:05.619177 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247708a-2fba-4150-b0c9-eea55d043eef None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:05.619682 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247708a-2fba-4150-b0c9-eea55d043eef None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:05.620736 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e247708a-2fba-4150-b0c9-eea55d043eef None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:05.622653 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e247708a-2fba-4150-b0c9-eea55d043eef None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:05.656336 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 370/732] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Sep 26 05:31:05 2022] POST /identity/v3/services => generated 251 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:31:05.657734 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247708a-2fba-4150-b0c9-eea55d043eef None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:05.800481 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb6f714-8b46-4c49-b1cd-79e58c00377d None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:05.817947 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:05.934580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163448db-5aa3-4d32-9b92-ffa0c5895c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:05.935583 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163448db-5aa3-4d32-9b92-ffa0c5895c0a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:05.936065 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163448db-5aa3-4d32-9b92-ffa0c5895c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:05.936510 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163448db-5aa3-4d32-9b92-ffa0c5895c0a None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:05.937829 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163448db-5aa3-4d32-9b92-ffa0c5895c0a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:05.938311 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163448db-5aa3-4d32-9b92-ffa0c5895c0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:05.941248 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163448db-5aa3-4d32-9b92-ffa0c5895c0a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:05.980563 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247708a-2fba-4150-b0c9-eea55d043eef None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:05.981401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 363/733] 10.222.0.66 () {56 vars in 1149 bytes} [Mon Sep 26 05:31:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:05.987384 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163448db-5aa3-4d32-9b92-ffa0c5895c0a None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:06.045517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1670d4-3c8a-4c05-8f43-3d60d4f5c334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:06.046890 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1670d4-3c8a-4c05-8f43-3d60d4f5c334 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:06.047407 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1670d4-3c8a-4c05-8f43-3d60d4f5c334 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:06.047962 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1670d4-3c8a-4c05-8f43-3d60d4f5c334 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:06.049128 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1670d4-3c8a-4c05-8f43-3d60d4f5c334 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:06.049734 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1670d4-3c8a-4c05-8f43-3d60d4f5c334 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:06.053854 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1670d4-3c8a-4c05-8f43-3d60d4f5c334 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:06.056430 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:06.076070 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 371/734] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:31:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:06.081822 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1670d4-3c8a-4c05-8f43-3d60d4f5c334 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:06.203406 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163448db-5aa3-4d32-9b92-ffa0c5895c0a None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:06.285142 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7d6d6-fae0-4bf8-b924-b392c5252ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:06.286126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7d6d6-fae0-4bf8-b924-b392c5252ef5 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:06.286594 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7d6d6-fae0-4bf8-b924-b392c5252ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:06.287125 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7d6d6-fae0-4bf8-b924-b392c5252ef5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:06.327591 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1670d4-3c8a-4c05-8f43-3d60d4f5c334 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:06.369683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:06.389051 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e5d50-2f2a-4e06-a142-e0291bf31de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:06.390071 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e5d50-2f2a-4e06-a142-e0291bf31de3 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:06.390561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e5d50-2f2a-4e06-a142-e0291bf31de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:06.390984 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e5d50-2f2a-4e06-a142-e0291bf31de3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:06.410381 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e5d50-2f2a-4e06-a142-e0291bf31de3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:06.413066 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e5d50-2f2a-4e06-a142-e0291bf31de3 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:06.445726 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-ea6e5d50-2f2a-4e06-a142-e0291bf31de3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:06.445726 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:06.445726 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:06.445726 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:06.445726 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:06.445726 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:06.445726 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:06.445726 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:06.445726 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:06.445726 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:06.445726 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:06.445726 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:06.445726 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:31:06.445726 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:31:06.445726 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:31:06.445726 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:31:06.447642 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:06.447642 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:06.447642 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:06.447642 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:06.447642 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:06.447642 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:06.447642 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:06.447642 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:06.447642 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:06.447642 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:06.447642 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:06.447642 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:06.447642 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:06.447642 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:06.447642 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:06.447642 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:06.447642 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:31:06.449374 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:31:06.449374 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:06.449374 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:06.455872 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 372/735] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:06.460372 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e5d50-2f2a-4e06-a142-e0291bf31de3 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:06.506855 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7d6d6-fae0-4bf8-b924-b392c5252ef5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:06.509736 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7d6d6-fae0-4bf8-b924-b392c5252ef5 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:06.564306 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:06.611605 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e5d50-2f2a-4e06-a142-e0291bf31de3 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:06.654467 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7efa02-dd07-4071-8100-d7a0c3f96635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:06.655099 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7efa02-dd07-4071-8100-d7a0c3f96635 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:06.655372 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7efa02-dd07-4071-8100-d7a0c3f96635 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:06.655640 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7efa02-dd07-4071-8100-d7a0c3f96635 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:06.656321 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7efa02-dd07-4071-8100-d7a0c3f96635 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:06.657481 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7efa02-dd07-4071-8100-d7a0c3f96635 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:06.658937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7efa02-dd07-4071-8100-d7a0c3f96635 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:06.677452 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 373/736] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:31:06.686539 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7efa02-dd07-4071-8100-d7a0c3f96635 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:06.827000 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 364/737] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:31:05 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 840 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:06.832801 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7d6d6-fae0-4bf8-b924-b392c5252ef5 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:06.948321 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7efa02-dd07-4071-8100-d7a0c3f96635 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:06.972151 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:07.009594 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:07.029993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef721a-8f27-4c59-8fed-5514b8b4b6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:07.032378 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef721a-8f27-4c59-8fed-5514b8b4b6d0 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:07.033125 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef721a-8f27-4c59-8fed-5514b8b4b6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:07.034171 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef721a-8f27-4c59-8fed-5514b8b4b6d0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:07.049812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef721a-8f27-4c59-8fed-5514b8b4b6d0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:07.052811 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef721a-8f27-4c59-8fed-5514b8b4b6d0 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:07.078875 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-aaef721a-8f27-4c59-8fed-5514b8b4b6d0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 05:31:07.078875 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:07.078875 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:07.078875 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:07.078875 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:07.078875 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:07.078875 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:07.078875 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:07.078875 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:07.078875 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:07.078875 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:07.078875 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:07.078875 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:31:07.078875 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:31:07.078875 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:31:07.078875 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:31:07.080609 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:07.080609 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:07.080609 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:31:07.080609 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:31:07.080609 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:31:07.080609 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:31:07.080609 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:07.080609 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:07.080609 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:07.080609 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:07.080609 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:07.080609 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:07.080609 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:07.080609 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:07.080609 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:07.080609 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:07.080609 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:07.080609 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:07.082329 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:07.082329 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:07.082329 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:31:07.082329 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:31:07.082329 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:31:07.082329 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:31:07.082329 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:31:07.082329 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:31:07.082329 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 05:31:07.082329 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:07.092148 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 374/738] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:31:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:07.098488 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef721a-8f27-4c59-8fed-5514b8b4b6d0 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:07.141492 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7d6d6-fae0-4bf8-b924-b392c5252ef5 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:07.212216 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e90256f-5265-4b5a-9643-1237b956d067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:07.213078 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90256f-5265-4b5a-9643-1237b956d067 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:07.213078 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90256f-5265-4b5a-9643-1237b956d067 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:07.213288 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90256f-5265-4b5a-9643-1237b956d067 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:07.236759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e90256f-5265-4b5a-9643-1237b956d067 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:07.238251 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e90256f-5265-4b5a-9643-1237b956d067 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:07.268469 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-3e90256f-5265-4b5a-9643-1237b956d067 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:07.268469 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:07.268469 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:07.268469 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:07.268469 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:07.268469 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:07.268469 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:07.268469 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:07.268469 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:07.268469 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:07.268469 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:07.268469 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:07.268469 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:31:07.268469 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:31:07.268469 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:31:07.268469 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:31:07.270058 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:07.270058 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:07.270058 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:07.270058 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:07.270058 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:07.270058 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:07.270058 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:07.270058 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:07.270058 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:07.270058 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:07.270058 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:07.270058 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:07.270058 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:07.270058 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:07.270058 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:07.270058 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:07.270058 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:31:07.280834 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:31:07.280834 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:07.280834 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:07.283933 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 365/739] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 451 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:07.286674 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef721a-8f27-4c59-8fed-5514b8b4b6d0 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:07.289609 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e90256f-5265-4b5a-9643-1237b956d067 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:07.333235 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd796771-9210-42a1-9497-dd9e8122767f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:07.333863 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd796771-9210-42a1-9497-dd9e8122767f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:07.334138 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd796771-9210-42a1-9497-dd9e8122767f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:07.334404 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd796771-9210-42a1-9497-dd9e8122767f None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:07.335153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd796771-9210-42a1-9497-dd9e8122767f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:07.335504 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd796771-9210-42a1-9497-dd9e8122767f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:07.338163 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd796771-9210-42a1-9497-dd9e8122767f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:07.377185 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 375/740] 10.222.0.66 () {56 vars in 1135 bytes} [Mon Sep 26 05:31:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:31:07.388899 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd796771-9210-42a1-9497-dd9e8122767f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:07.449912 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:07.510874 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e90256f-5265-4b5a-9643-1237b956d067 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:07.536725 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:07.589577 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef47814-99c4-4acc-ac99-5abb7539e3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:07.590370 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef47814-99c4-4acc-ac99-5abb7539e3ea None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:07.590745 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef47814-99c4-4acc-ac99-5abb7539e3ea None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:07.591111 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef47814-99c4-4acc-ac99-5abb7539e3ea None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:07.591894 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef47814-99c4-4acc-ac99-5abb7539e3ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:07.592313 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef47814-99c4-4acc-ac99-5abb7539e3ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:07.593871 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef47814-99c4-4acc-ac99-5abb7539e3ea None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:07.608974 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 366/741] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:31:07.610571 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb998514-2e70-4b15-85de-5f1579c17a43 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:07.610959 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb998514-2e70-4b15-85de-5f1579c17a43 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:07.611321 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb998514-2e70-4b15-85de-5f1579c17a43 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:07.617240 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 367/742] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:07.618535 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb998514-2e70-4b15-85de-5f1579c17a43 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:07.632593 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd796771-9210-42a1-9497-dd9e8122767f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:07.676965 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b317ba-9286-4681-9ced-fcd5dd8a4dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:07.677628 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b317ba-9286-4681-9ced-fcd5dd8a4dfd None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:07.678040 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b317ba-9286-4681-9ced-fcd5dd8a4dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:07.678308 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b317ba-9286-4681-9ced-fcd5dd8a4dfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:07.748221 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb998514-2e70-4b15-85de-5f1579c17a43 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:07.767051 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b317ba-9286-4681-9ced-fcd5dd8a4dfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:07.768535 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b317ba-9286-4681-9ced-fcd5dd8a4dfd None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:07.791124 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ae9ed-0002-45b4-89ed-a69e922e1a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:07.791836 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ae9ed-0002-45b4-89ed-a69e922e1a04 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:07.792118 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ae9ed-0002-45b4-89ed-a69e922e1a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:07.792382 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ae9ed-0002-45b4-89ed-a69e922e1a04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:07.801221 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:07.804740 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ae9ed-0002-45b4-89ed-a69e922e1a04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:07.808003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ae9ed-0002-45b4-89ed-a69e922e1a04 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:07.825119 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-f55ae9ed-0002-45b4-89ed-a69e922e1a04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:31:07.825119 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:07.825119 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:07.825119 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:07.825119 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:07.825119 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:07.825119 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:07.825119 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:07.825119 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:07.825119 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:07.825119 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:07.825119 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:07.825119 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:31:07.825119 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:31:07.825119 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:31:07.826224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:31:07.826224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:07.826224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:07.826224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:07.826224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:07.826224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:07.826224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:07.826224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:07.826224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:07.826224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:07.826224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:07.826224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:07.826224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:07.826224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:07.826224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:07.826224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:07.826224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:07.827630 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:31:07.827630 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:31:07.827630 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:31:07.827630 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:31:07.827630 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:31:07.827630 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:31:07.827630 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:31:07.827630 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:07.834919 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 368/743] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:31:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:07.834919 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dafb7-ea7c-4fee-afd9-a18045ad0d00 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:07.834919 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dafb7-ea7c-4fee-afd9-a18045ad0d00 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:07.834919 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194dafb7-ea7c-4fee-afd9-a18045ad0d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:07.859455 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-194dafb7-ea7c-4fee-afd9-a18045ad0d00 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:07.862059 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-194dafb7-ea7c-4fee-afd9-a18045ad0d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:07.895579 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:07.930725 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 376/744] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:31:07 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 26 05:31:07.932246 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b317ba-9286-4681-9ced-fcd5dd8a4dfd None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:07.975681 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 369/745] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:07 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:31:07.977865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194dafb7-ea7c-4fee-afd9-a18045ad0d00 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:08.117246 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b317ba-9286-4681-9ced-fcd5dd8a4dfd None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:08.163321 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:08.179127 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b21fe-6cf2-48db-9f6f-3dcac07d5021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:08.180134 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b21fe-6cf2-48db-9f6f-3dcac07d5021 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:08.180600 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b21fe-6cf2-48db-9f6f-3dcac07d5021 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:08.181058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b21fe-6cf2-48db-9f6f-3dcac07d5021 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:08.182274 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b21fe-6cf2-48db-9f6f-3dcac07d5021 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:08.182797 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b21fe-6cf2-48db-9f6f-3dcac07d5021 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:08.185479 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b21fe-6cf2-48db-9f6f-3dcac07d5021 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:08.202407 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194dafb7-ea7c-4fee-afd9-a18045ad0d00 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:08.207212 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 377/746] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:31:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:08.209398 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318e7f2-f978-4627-9ab0-93dac1ca04f9 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:08.209872 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318e7f2-f978-4627-9ab0-93dac1ca04f9 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:08.210366 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318e7f2-f978-4627-9ab0-93dac1ca04f9 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:08.213176 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 378/747] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:08.216900 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318e7f2-f978-4627-9ab0-93dac1ca04f9 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:08.252823 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd19e1b-48ec-4557-95ef-faa02e8ff421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:08.253655 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd19e1b-48ec-4557-95ef-faa02e8ff421 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:08.253830 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd19e1b-48ec-4557-95ef-faa02e8ff421 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:08.254799 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd19e1b-48ec-4557-95ef-faa02e8ff421 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:08.269550 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd19e1b-48ec-4557-95ef-faa02e8ff421 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:08.271643 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd19e1b-48ec-4557-95ef-faa02e8ff421 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:08.290762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-7cd19e1b-48ec-4557-95ef-faa02e8ff421 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:08.290762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:08.290762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:08.290762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:08.290762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:08.290762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:08.290762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:08.290762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:08.290762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:08.290762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:08.290762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:08.290762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:08.290762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:31:08.290762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:31:08.290762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:31:08.290762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:31:08.292889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:08.292889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:08.292889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:08.292889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:08.292889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:08.292889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:08.292889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:08.292889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:08.292889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:08.292889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:08.292889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:08.292889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:08.292889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:08.292889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:08.292889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:08.292889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:08.292889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:31:08.294902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:31:08.294902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:08.294902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:08.300006 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 370/748] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:08.300006 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4bde2a-abb4-4b61-bc95-ba734126c239 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:08.300006 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4bde2a-abb4-4b61-bc95-ba734126c239 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:08.300006 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4bde2a-abb4-4b61-bc95-ba734126c239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:08.323088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-6f4bde2a-abb4-4b61-bc95-ba734126c239 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:08.324349 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-6f4bde2a-abb4-4b61-bc95-ba734126c239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:08.338680 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:08.406123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318e7f2-f978-4627-9ab0-93dac1ca04f9 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:08.419236 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 371/749] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:08 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 26 05:31:08.420276 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4bde2a-abb4-4b61-bc95-ba734126c239 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:08.516593 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c006c8-0b5b-4e0c-ad2d-2662efb2291b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:08.517226 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c006c8-0b5b-4e0c-ad2d-2662efb2291b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:08.517499 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c006c8-0b5b-4e0c-ad2d-2662efb2291b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:08.517759 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c006c8-0b5b-4e0c-ad2d-2662efb2291b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:08.518498 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c006c8-0b5b-4e0c-ad2d-2662efb2291b None admin] RBAC: Adding query filter params (role.id=024a61996071437aa07a3faf2bb5ae69, scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8, user.id=5bdaf32400b94aa291ad43a3131e1d0a) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:08.518805 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c006c8-0b5b-4e0c-ad2d-2662efb2291b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:08.520367 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c006c8-0b5b-4e0c-ad2d-2662efb2291b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:08.536583 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 379/750] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:31:08 2022] GET /identity/v3/role_assignments?user.id=5bdaf32400b94aa291ad43a3131e1d0a&scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8&role.id=024a61996071437aa07a3faf2bb5ae69 => generated 259 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:31:08.569558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c006c8-0b5b-4e0c-ad2d-2662efb2291b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:08.600414 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4bde2a-abb4-4b61-bc95-ba734126c239 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:08.655569 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf04ca-6e01-4644-a74a-4f68e63e623e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:08.656610 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf04ca-6e01-4644-a74a-4f68e63e623e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:08.656883 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf04ca-6e01-4644-a74a-4f68e63e623e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:08.657134 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf04ca-6e01-4644-a74a-4f68e63e623e None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:08.657753 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf04ca-6e01-4644-a74a-4f68e63e623e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:08.658044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf04ca-6e01-4644-a74a-4f68e63e623e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:08.660040 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf04ca-6e01-4644-a74a-4f68e63e623e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:08.665938 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:08.679857 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 372/751] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:08.684210 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf04ca-6e01-4644-a74a-4f68e63e623e None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:08.691239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:08.762426 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c006c8-0b5b-4e0c-ad2d-2662efb2291b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:08.823985 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d69718-4bb9-466e-a083-2b3777d55d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:08.825644 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d69718-4bb9-466e-a083-2b3777d55d1c None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:08.826431 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d69718-4bb9-466e-a083-2b3777d55d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:08.827646 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d69718-4bb9-466e-a083-2b3777d55d1c None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:08.829292 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d69718-4bb9-466e-a083-2b3777d55d1c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:08.831200 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf04ca-6e01-4644-a74a-4f68e63e623e None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:08.832590 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d69718-4bb9-466e-a083-2b3777d55d1c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:08.860917 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 380/752] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Sep 26 05:31:08 2022] POST /identity/v3/services => generated 240 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:31:08.863655 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c521d-36f5-440b-93bd-9ba9158b3974 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:08.864541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c521d-36f5-440b-93bd-9ba9158b3974 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:08.865196 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c521d-36f5-440b-93bd-9ba9158b3974 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:08.868329 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 381/753] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:08.874624 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834023c-32a5-4d89-b1e5-39e3f88c1020 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:08.874624 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834023c-32a5-4d89-b1e5-39e3f88c1020 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:08.874624 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834023c-32a5-4d89-b1e5-39e3f88c1020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:08.900371 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-d834023c-32a5-4d89-b1e5-39e3f88c1020 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:08.900850 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca680f3-6247-46ae-bccf-24e6e0c7efc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:08.901596 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d834023c-32a5-4d89-b1e5-39e3f88c1020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:08.901888 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca680f3-6247-46ae-bccf-24e6e0c7efc0 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:08.902308 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca680f3-6247-46ae-bccf-24e6e0c7efc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:08.902718 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca680f3-6247-46ae-bccf-24e6e0c7efc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:08.914274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca680f3-6247-46ae-bccf-24e6e0c7efc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:08.916726 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca680f3-6247-46ae-bccf-24e6e0c7efc0 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:08.934199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-7ca680f3-6247-46ae-bccf-24e6e0c7efc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:31:08.934199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:08.934199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:08.934199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:08.934199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:08.934199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:08.934199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:08.934199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:08.934199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:08.934199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:08.934199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:08.934199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:08.934199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:31:08.934199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:31:08.934199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:31:08.935305 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:31:08.935305 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:08.935305 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:08.935305 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:08.935305 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:08.935305 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:08.935305 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:08.935305 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:08.935305 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:08.935305 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:08.935305 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:08.935305 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:08.935305 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:08.935305 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:08.935305 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:08.935305 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:08.935305 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:08.936420 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:31:08.936420 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:31:08.936420 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:31:08.936420 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:31:08.936420 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:31:08.936420 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:31:08.936420 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:31:08.936420 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:08.939338 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 373/754] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:31:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:08.940408 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca680f3-6247-46ae-bccf-24e6e0c7efc0 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:09.006257 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 382/755] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:31:09.006257 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834023c-32a5-4d89-b1e5-39e3f88c1020 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:09.037611 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:09.092377 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:09.123371 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca680f3-6247-46ae-bccf-24e6e0c7efc0 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:09.176051 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75435d13-df1a-41f4-a657-d099879269d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:09.176688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75435d13-df1a-41f4-a657-d099879269d3 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:09.176969 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75435d13-df1a-41f4-a657-d099879269d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:09.177237 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75435d13-df1a-41f4-a657-d099879269d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:09.191532 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75435d13-df1a-41f4-a657-d099879269d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:31:09.198026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-75435d13-df1a-41f4-a657-d099879269d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:31:09.198026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:09.198026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:09.198026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:09.198026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:09.198026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:09.198026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:09.198026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:09.198026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:09.198026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:09.198026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:09.198026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:09.198026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:31:09.198026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:31:09.198026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:31:09.198026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:31:09.199044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:31:09.199044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:31:09.199044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:31:09.199044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:31:09.199044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:09.199044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:09.199044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:09.199044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:09.199044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:09.199044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:09.199044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:09.199044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:09.199044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:09.199044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:09.199044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:09.199044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:09.199931 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:09.199931 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:09.199931 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:09.199931 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:09.199931 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:31:09.199931 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:31:09.199931 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:31:09.199931 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:31:09.199931 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:31:09.199931 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:31:09.199931 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:31:09.199931 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:09.199931 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 374/756] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:31:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:09.209500 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75435d13-df1a-41f4-a657-d099879269d3 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:09.231552 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834023c-32a5-4d89-b1e5-39e3f88c1020 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:09.299305 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67178ffa-b3be-4fc3-bfa1-cc93716c5837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:09.300088 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67178ffa-b3be-4fc3-bfa1-cc93716c5837 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:09.300433 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67178ffa-b3be-4fc3-bfa1-cc93716c5837 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:09.300771 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67178ffa-b3be-4fc3-bfa1-cc93716c5837 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:09.301612 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67178ffa-b3be-4fc3-bfa1-cc93716c5837 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:09.301989 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67178ffa-b3be-4fc3-bfa1-cc93716c5837 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:09.303766 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67178ffa-b3be-4fc3-bfa1-cc93716c5837 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:09.327872 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 383/757] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:31:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:09.334463 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67178ffa-b3be-4fc3-bfa1-cc93716c5837 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:09.363436 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75435d13-df1a-41f4-a657-d099879269d3 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:09.386445 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:09.421571 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb89bf-e164-4dc5-a743-69b6bf334333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:09.422205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb89bf-e164-4dc5-a743-69b6bf334333 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:09.422487 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb89bf-e164-4dc5-a743-69b6bf334333 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:09.422759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb89bf-e164-4dc5-a743-69b6bf334333 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:09.423756 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb89bf-e164-4dc5-a743-69b6bf334333 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:09.424069 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb89bf-e164-4dc5-a743-69b6bf334333 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:09.425956 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb89bf-e164-4dc5-a743-69b6bf334333 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:09.438682 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 375/758] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:31:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:31:09.444641 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb89bf-e164-4dc5-a743-69b6bf334333 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:09.480624 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:09.484137 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67178ffa-b3be-4fc3-bfa1-cc93716c5837 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:09.522864 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89834251-aa43-4d82-a6e3-ec4a22eb3a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:09.523488 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89834251-aa43-4d82-a6e3-ec4a22eb3a7a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:09.523798 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89834251-aa43-4d82-a6e3-ec4a22eb3a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:09.524074 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89834251-aa43-4d82-a6e3-ec4a22eb3a7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:09.524925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89834251-aa43-4d82-a6e3-ec4a22eb3a7a None admin] RBAC: Adding query filter params (role.id=cf58d66369044fb09fa65a4366dc7446, scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8, user.id=830cd52ac42548b2ade17b5215aefd28) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:09.525231 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89834251-aa43-4d82-a6e3-ec4a22eb3a7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:09.526704 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89834251-aa43-4d82-a6e3-ec4a22eb3a7a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:09.539949 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 384/759] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:31:09 2022] GET /identity/v3/role_assignments?user.id=830cd52ac42548b2ade17b5215aefd28&scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8&role.id=cf58d66369044fb09fa65a4366dc7446 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:31:09.541010 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89834251-aa43-4d82-a6e3-ec4a22eb3a7a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:09.558307 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb89bf-e164-4dc5-a743-69b6bf334333 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:09.598185 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c2dc6-bacb-465a-87c1-e1c811178c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:09.598829 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c2dc6-bacb-465a-87c1-e1c811178c50 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:09.599105 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c2dc6-bacb-465a-87c1-e1c811178c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:09.599358 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c2dc6-bacb-465a-87c1-e1c811178c50 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:09.599983 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c2dc6-bacb-465a-87c1-e1c811178c50 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:09.601448 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c2dc6-bacb-465a-87c1-e1c811178c50 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:09.611337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-363c2dc6-bacb-465a-87c1-e1c811178c50 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 05:31:09.611337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:09.611337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:31:09.611337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:31:09.611337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:31:09.611337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:31:09.611337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:31:09.611337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:09.611337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 05:31:09.611337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:09.611337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:31:09.611337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:09.611337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:09.611337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:09.611337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:09.611337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:09.611337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:09.613847 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:09.613847 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:09.613847 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:09.613847 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:09.613847 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:09.613847 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:09.613847 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:31:09.613847 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:31:09.613847 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:31:09.613847 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:31:09.613847 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:09.613847 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:09.613847 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:09.613847 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:09.613847 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:09.613847 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:09.615405 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:09.615405 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:09.615405 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:09.615405 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:09.615405 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:09.615405 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:09.615405 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:09.615405 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:09.615405 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:09.615405 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:09.615405 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:31:09.615405 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:09.615405 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 05:31:09.615405 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:09.615405 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 376/760] 10.222.0.66 () {56 vars in 1129 bytes} [Mon Sep 26 05:31:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:09.624838 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c2dc6-bacb-465a-87c1-e1c811178c50 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:09.744351 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:09.786161 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89834251-aa43-4d82-a6e3-ec4a22eb3a7a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:09.895877 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa02ac3-62b5-4730-a3b6-ea73366ecb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:09.897669 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa02ac3-62b5-4730-a3b6-ea73366ecb1d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:09.898636 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa02ac3-62b5-4730-a3b6-ea73366ecb1d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:09.899380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa02ac3-62b5-4730-a3b6-ea73366ecb1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:09.902025 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c2dc6-bacb-465a-87c1-e1c811178c50 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:09.931558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa02ac3-62b5-4730-a3b6-ea73366ecb1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:09.934942 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa02ac3-62b5-4730-a3b6-ea73366ecb1d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:09.942047 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403bd7be-9d9d-4bd8-b6fc-e3b3f4f1f647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:09.942676 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bd7be-9d9d-4bd8-b6fc-e3b3f4f1f647 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:09.942952 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bd7be-9d9d-4bd8-b6fc-e3b3f4f1f647 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:09.943289 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bd7be-9d9d-4bd8-b6fc-e3b3f4f1f647 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:09.943952 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403bd7be-9d9d-4bd8-b6fc-e3b3f4f1f647 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:09.944249 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403bd7be-9d9d-4bd8-b6fc-e3b3f4f1f647 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:09.947508 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403bd7be-9d9d-4bd8-b6fc-e3b3f4f1f647 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:09.951133 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 377/761] 10.222.0.66 () {56 vars in 1124 bytes} [Mon Sep 26 05:31:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:31:09.967471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403bd7be-9d9d-4bd8-b6fc-e3b3f4f1f647 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:09.978635 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-1aa02ac3-62b5-4730-a3b6-ea73366ecb1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:09.978635 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:09.978635 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:09.978635 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:09.978635 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:09.978635 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:09.978635 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:09.978635 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:09.978635 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:09.978635 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:09.978635 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:09.978635 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:09.978635 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:31:09.978635 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:31:09.978635 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:31:09.978635 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:31:09.980442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:09.980442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:09.980442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:09.980442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:09.980442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:09.980442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:09.980442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:09.980442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:09.980442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:09.980442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:09.980442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:09.980442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:09.980442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:09.980442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:09.980442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:09.980442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:09.980442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:31:09.982051 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:31:09.982051 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:09.982051 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:09.990293 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 385/762] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 450 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:10.002037 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa02ac3-62b5-4730-a3b6-ea73366ecb1d None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:10.026127 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:10.201288 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa02ac3-62b5-4730-a3b6-ea73366ecb1d None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:10.203930 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403bd7be-9d9d-4bd8-b6fc-e3b3f4f1f647 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:10.228780 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:10.280217 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076c209-d4bd-48ac-89a3-df19815096c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:10.280902 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076c209-d4bd-48ac-89a3-df19815096c4 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:10.281127 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076c209-d4bd-48ac-89a3-df19815096c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:10.281393 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076c209-d4bd-48ac-89a3-df19815096c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:10.282687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bbe7a3-4d23-488b-8c50-bba789439a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:10.283355 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbe7a3-4d23-488b-8c50-bba789439a7a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:10.283625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbe7a3-4d23-488b-8c50-bba789439a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:10.283912 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bbe7a3-4d23-488b-8c50-bba789439a7a None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:10.284545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bbe7a3-4d23-488b-8c50-bba789439a7a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:10.284838 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bbe7a3-4d23-488b-8c50-bba789439a7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:10.285264 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076c209-d4bd-48ac-89a3-df19815096c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:10.285600 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076c209-d4bd-48ac-89a3-df19815096c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:10.287007 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076c209-d4bd-48ac-89a3-df19815096c4 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:10.290087 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bbe7a3-4d23-488b-8c50-bba789439a7a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:10.302296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 378/763] 10.222.0.66 () {56 vars in 1124 bytes} [Mon Sep 26 05:31:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:10.309236 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bbe7a3-4d23-488b-8c50-bba789439a7a None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:10.324157 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 386/764] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:10.325168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076c209-d4bd-48ac-89a3-df19815096c4 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:10.435766 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bbe7a3-4d23-488b-8c50-bba789439a7a None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:10.477699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fa210-9fc9-45fd-a772-37384919c603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:10.477699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fa210-9fc9-45fd-a772-37384919c603 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:10.477699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fa210-9fc9-45fd-a772-37384919c603 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:10.477699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fa210-9fc9-45fd-a772-37384919c603 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:10.478137 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727fa210-9fc9-45fd-a772-37384919c603 None admin] RBAC: Adding query filter params (interface=public, service_id=b7c5bb7105aa44aeb60ba0b406096252, region_id=RegionOne) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:10.478137 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727fa210-9fc9-45fd-a772-37384919c603 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:10.478137 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727fa210-9fc9-45fd-a772-37384919c603 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:10.484200 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 379/765] 10.222.0.66 () {56 vars in 1251 bytes} [Mon Sep 26 05:31:10 2022] GET /identity/v3/endpoints?service_id=b7c5bb7105aa44aeb60ba0b406096252&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:10.490587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:10.495769 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fa210-9fc9-45fd-a772-37384919c603 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:10.528649 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076c209-d4bd-48ac-89a3-df19815096c4 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:10.557304 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:10.608484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fa210-9fc9-45fd-a772-37384919c603 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:10.645916 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c3d45-6efd-45ef-9efc-9403c71b8db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:10.646626 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c3d45-6efd-45ef-9efc-9403c71b8db8 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:10.646907 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c3d45-6efd-45ef-9efc-9403c71b8db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:10.647174 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c3d45-6efd-45ef-9efc-9403c71b8db8 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:10.647798 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd0153-9ba3-4154-83bf-8bf77d594434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:10.647922 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c3d45-6efd-45ef-9efc-9403c71b8db8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:10.648514 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd0153-9ba3-4154-83bf-8bf77d594434 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:10.648797 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd0153-9ba3-4154-83bf-8bf77d594434 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:10.649068 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd0153-9ba3-4154-83bf-8bf77d594434 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:10.649233 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c3d45-6efd-45ef-9efc-9403c71b8db8 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:10.655237 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 380/766] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Sep 26 05:31:10 2022] GET /identity/v3/services => generated 772 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:10.672843 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd0153-9ba3-4154-83bf-8bf77d594434 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:10.674428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd0153-9ba3-4154-83bf-8bf77d594434 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:10.697808 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-3fbd0153-9ba3-4154-83bf-8bf77d594434 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:31:10.697808 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:10.697808 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:10.697808 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:10.697808 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:10.697808 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:10.697808 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:10.697808 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:10.697808 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:10.697808 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:10.697808 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:10.697808 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:10.697808 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:31:10.697808 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:31:10.697808 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:31:10.697808 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:31:10.698844 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:10.698844 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:10.698844 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:31:10.698844 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:31:10.698844 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:31:10.698844 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:31:10.698844 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:10.698844 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:10.698844 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:10.698844 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:10.698844 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:10.698844 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:10.698844 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:10.698844 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:10.698844 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:10.698844 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:10.698844 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:10.698844 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:10.699853 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:10.699853 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:10.699853 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:31:10.699853 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:31:10.699853 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:31:10.699853 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:31:10.699853 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:31:10.699853 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:31:10.699853 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:31:10.699853 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:10.707451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 387/767] 10.222.0.66 () {56 vars in 1093 bytes} [Mon Sep 26 05:31:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:10.715389 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c3d45-6efd-45ef-9efc-9403c71b8db8 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:10.904185 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c3d45-6efd-45ef-9efc-9403c71b8db8 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:10.906401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:10.946921 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89f6aa-f366-4a1f-a83f-7e08db49592f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:10.947553 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89f6aa-f366-4a1f-a83f-7e08db49592f None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:10.947854 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89f6aa-f366-4a1f-a83f-7e08db49592f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:10.948183 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89f6aa-f366-4a1f-a83f-7e08db49592f None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:10.948919 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89f6aa-f366-4a1f-a83f-7e08db49592f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:10.949264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89f6aa-f366-4a1f-a83f-7e08db49592f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:10.950693 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89f6aa-f366-4a1f-a83f-7e08db49592f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:10.971504 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 381/768] 10.222.0.66 () {56 vars in 1133 bytes} [Mon Sep 26 05:31:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:10.980876 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd0153-9ba3-4154-83bf-8bf77d594434 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:11.154152 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd0153-9ba3-4154-83bf-8bf77d594434 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:11.208449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba6190-8864-4ade-9298-602eb9baa2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:11.209118 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba6190-8864-4ade-9298-602eb9baa2f9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:11.209392 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba6190-8864-4ade-9298-602eb9baa2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:11.209659 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba6190-8864-4ade-9298-602eb9baa2f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:11.216450 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:11.230598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba6190-8864-4ade-9298-602eb9baa2f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:11.232476 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba6190-8864-4ade-9298-602eb9baa2f9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:11.256165 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-a0ba6190-8864-4ade-9298-602eb9baa2f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:11.256165 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:11.256165 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:11.256165 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:11.256165 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:11.256165 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:11.256165 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:11.256165 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:11.256165 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:11.256165 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:11.256165 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:11.256165 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:11.256165 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:31:11.256165 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:31:11.256165 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:31:11.256165 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:31:11.257285 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:11.257285 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:11.257285 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:11.257285 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:11.257285 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:11.257285 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:11.257285 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:11.257285 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:11.257285 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:11.257285 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:11.257285 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:11.257285 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:11.257285 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:11.257285 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:11.257285 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:11.257285 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:11.257285 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:31:11.258192 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:31:11.258192 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:11.258192 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:11.259016 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 388/769] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:11.264473 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89f6aa-f366-4a1f-a83f-7e08db49592f None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:11.383220 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89f6aa-f366-4a1f-a83f-7e08db49592f None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:11.424440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc30fcd-9507-43ef-8bcb-3611d5f0b922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:11.425079 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc30fcd-9507-43ef-8bcb-3611d5f0b922 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:11.425355 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc30fcd-9507-43ef-8bcb-3611d5f0b922 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:11.425627 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc30fcd-9507-43ef-8bcb-3611d5f0b922 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:11.426298 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc30fcd-9507-43ef-8bcb-3611d5f0b922 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:11.426594 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc30fcd-9507-43ef-8bcb-3611d5f0b922 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:11.428052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc30fcd-9507-43ef-8bcb-3611d5f0b922 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:11.443082 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 382/770] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:11.449323 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba6190-8864-4ade-9298-602eb9baa2f9 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:11.591900 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba6190-8864-4ade-9298-602eb9baa2f9 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:11.632051 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662474ec-9367-4372-9199-a38644d457dc None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:11.632753 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662474ec-9367-4372-9199-a38644d457dc None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:11.633235 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662474ec-9367-4372-9199-a38644d457dc None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:11.635188 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 383/771] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:31:11.641176 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3e53d-4faa-45b9-a84d-554c6ee7d550 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:11.641696 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb57b7-b4ac-4ea7-a054-aef32412df3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:11.642049 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3e53d-4faa-45b9-a84d-554c6ee7d550 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:11.642348 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb57b7-b4ac-4ea7-a054-aef32412df3e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:11.642624 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb57b7-b4ac-4ea7-a054-aef32412df3e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:11.642891 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb57b7-b4ac-4ea7-a054-aef32412df3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:11.643117 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d3e53d-4faa-45b9-a84d-554c6ee7d550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:11.654919 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb57b7-b4ac-4ea7-a054-aef32412df3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:11.657209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cb57b7-b4ac-4ea7-a054-aef32412df3e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:11.677898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-32cb57b7-b4ac-4ea7-a054-aef32412df3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:31:11.677898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:11.677898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:11.677898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:11.677898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:11.677898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:11.677898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:11.677898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:11.677898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:11.677898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:11.677898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:11.677898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:11.677898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:31:11.677898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:31:11.677898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:31:11.678900 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:31:11.678900 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:11.678900 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:11.678900 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:11.678900 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:11.678900 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:11.678900 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:11.678900 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:11.678900 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:11.678900 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:11.678900 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:11.678900 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:11.678900 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:11.678900 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:11.678900 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:11.678900 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:11.678900 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:11.679925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:31:11.679925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:31:11.679925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:31:11.679925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:31:11.679925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:31:11.679925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:31:11.679925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:31:11.679925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:11.683999 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-49d3e53d-4faa-45b9-a84d-554c6ee7d550 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:11.685503 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-49d3e53d-4faa-45b9-a84d-554c6ee7d550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:11.688006 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 389/772] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:31:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:11.694556 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb57b7-b4ac-4ea7-a054-aef32412df3e None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:11.724753 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:11.827713 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:11.893578 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 384/773] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 05:31:11.919058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb57b7-b4ac-4ea7-a054-aef32412df3e None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:11.979092 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ee12e-cd2a-48f9-928d-7a718b20c34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:11.979764 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ee12e-cd2a-48f9-928d-7a718b20c34f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:11.980052 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ee12e-cd2a-48f9-928d-7a718b20c34f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:11.980325 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ee12e-cd2a-48f9-928d-7a718b20c34f None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:11.981054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ee12e-cd2a-48f9-928d-7a718b20c34f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:11.981362 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ee12e-cd2a-48f9-928d-7a718b20c34f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:11.982894 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ee12e-cd2a-48f9-928d-7a718b20c34f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:12.003104 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 390/774] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:31:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:31:12.010126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3e53d-4faa-45b9-a84d-554c6ee7d550 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:12.083987 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdd24d-d2de-4dce-9c91-c5927a1456b0 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:12.084291 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdd24d-d2de-4dce-9c91-c5927a1456b0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:12.084538 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdd24d-d2de-4dce-9c91-c5927a1456b0 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:12.086140 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 391/775] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:12.093021 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934bb8c-859f-4482-aeec-4c8635de7ca2 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:12.093498 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934bb8c-859f-4482-aeec-4c8635de7ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:12.093962 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934bb8c-859f-4482-aeec-4c8635de7ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:12.139394 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-f934bb8c-859f-4482-aeec-4c8635de7ca2 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:12.142477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f934bb8c-859f-4482-aeec-4c8635de7ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:12.248688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d3e53d-4faa-45b9-a84d-554c6ee7d550 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:12.307968 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 392/776] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:31:12.307968 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934bb8c-859f-4482-aeec-4c8635de7ca2 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:12.320372 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23d357-6890-497e-87f7-0e9bd68e3088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:12.321552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23d357-6890-497e-87f7-0e9bd68e3088 None admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:12.322028 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23d357-6890-497e-87f7-0e9bd68e3088 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:12.322554 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23d357-6890-497e-87f7-0e9bd68e3088 None admin] PATH_INFO: `/v3/projects/953bb95b0ba84d4f99a73afb426bb8c8/users/c559a36836be411b9afd076f4c9a0655/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:12.329312 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23d357-6890-497e-87f7-0e9bd68e3088 None admin] RBAC: Authorizing `identity:create_grant(project_id=953bb95b0ba84d4f99a73afb426bb8c8, user_id=c559a36836be411b9afd076f4c9a0655, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:12.331337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23d357-6890-497e-87f7-0e9bd68e3088 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:12.348068 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:12.360175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 385/777] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 26 05:31:12 2022] PUT /identity/v3/projects/953bb95b0ba84d4f99a73afb426bb8c8/users/c559a36836be411b9afd076f4c9a0655/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:31:12.455653 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934bb8c-859f-4482-aeec-4c8635de7ca2 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:12.506589 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d702c97-6af3-4343-bf41-cd18d6b3565f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:12.507337 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d702c97-6af3-4343-bf41-cd18d6b3565f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:12.507617 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d702c97-6af3-4343-bf41-cd18d6b3565f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:12.507927 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d702c97-6af3-4343-bf41-cd18d6b3565f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:12.522837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d702c97-6af3-4343-bf41-cd18d6b3565f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:31:12.529145 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-8d702c97-6af3-4343-bf41-cd18d6b3565f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:31:12.529145 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:12.529145 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:12.529145 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:12.529145 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:12.529145 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:12.529145 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:12.529145 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:12.529145 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:12.529145 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:12.529145 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:12.529145 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:12.529145 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:31:12.529145 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:31:12.529145 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:31:12.529145 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:31:12.530199 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:31:12.530199 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:31:12.530199 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:31:12.530199 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:31:12.530199 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:12.530199 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:12.530199 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:12.530199 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:12.530199 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:12.530199 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:12.530199 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:12.530199 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:12.530199 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:12.530199 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:12.530199 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:12.530199 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:12.531055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:12.531055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:12.531055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:12.531055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:12.531055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:31:12.531055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:31:12.531055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:31:12.531055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:31:12.531055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:31:12.531055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:31:12.531055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:31:12.531055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:12.531055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 393/778] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 26 05:31:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:12.536709 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23d357-6890-497e-87f7-0e9bd68e3088 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:12.551455 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:12.629063 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d702c97-6af3-4343-bf41-cd18d6b3565f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:12.742968 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23d357-6890-497e-87f7-0e9bd68e3088 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:12.782017 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:12.788179 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d702c97-6af3-4343-bf41-cd18d6b3565f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:12.796708 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d2662-2324-4ac2-8b28-a321eb532d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:12.797309 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d2662-2324-4ac2-8b28-a321eb532d11 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:12.797573 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d2662-2324-4ac2-8b28-a321eb532d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:12.797827 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d2662-2324-4ac2-8b28-a321eb532d11 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:12.798503 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d2662-2324-4ac2-8b28-a321eb532d11 None admin] RBAC: Adding query filter params (name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:12.798797 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d2662-2324-4ac2-8b28-a321eb532d11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:12.800237 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d2662-2324-4ac2-8b28-a321eb532d11 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:12.815133 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 386/779] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 26 05:31:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:31:12.816270 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d2662-2324-4ac2-8b28-a321eb532d11 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:12.832875 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592a3f2-eb40-4ca2-839c-18de22257f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:12.833656 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592a3f2-eb40-4ca2-839c-18de22257f2f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:12.833933 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592a3f2-eb40-4ca2-839c-18de22257f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:12.834202 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592a3f2-eb40-4ca2-839c-18de22257f2f None admin] PATH_INFO: `/v3/services/network` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:12.835060 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592a3f2-eb40-4ca2-839c-18de22257f2f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:12.837170 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592a3f2-eb40-4ca2-839c-18de22257f2f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:12.853060 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-f592a3f2-eb40-4ca2-839c-18de22257f2f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 05:31:12.853060 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:12.853060 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:31:12.853060 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:31:12.853060 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:31:12.853060 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:31:12.853060 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:31:12.853060 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:12.853060 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 05:31:12.853060 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:12.853060 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:31:12.853060 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:12.853060 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:12.853060 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:12.853060 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:12.853060 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:12.853060 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:12.854148 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:12.854148 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:12.854148 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:12.854148 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:12.854148 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:12.854148 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:12.854148 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:31:12.854148 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:31:12.854148 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:31:12.854148 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:31:12.854148 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:12.854148 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:12.854148 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:12.854148 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:12.854148 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:12.854148 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:12.855004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:12.855004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:12.855004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:12.855004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:12.855004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:12.855004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:12.855004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:12.855004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:12.855004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:12.855004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:12.855004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:31:12.855004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:12.855004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 05:31:12.855004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:12.855839 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 394/780] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:31:12 2022] GET /identity/v3/services/network => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:31:12.861250 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592a3f2-eb40-4ca2-839c-18de22257f2f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:12.911800 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:12.951814 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d2662-2324-4ac2-8b28-a321eb532d11 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:12.990700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0447f-9287-4a91-9a34-0425077ecea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:12.991386 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0447f-9287-4a91-9a34-0425077ecea5 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:12.991764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0447f-9287-4a91-9a34-0425077ecea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:12.992038 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0447f-9287-4a91-9a34-0425077ecea5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:13.004906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0447f-9287-4a91-9a34-0425077ecea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:13.007914 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0447f-9287-4a91-9a34-0425077ecea5 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:13.024503 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-46f0447f-9287-4a91-9a34-0425077ecea5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:13.024503 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:13.024503 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:13.024503 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:13.024503 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:13.024503 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:13.024503 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:13.024503 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:13.024503 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:13.024503 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:13.024503 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:13.024503 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:13.024503 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:31:13.024503 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:31:13.024503 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:31:13.024503 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:31:13.025545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:13.025545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:13.025545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:13.025545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:13.025545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:13.025545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:13.025545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:13.025545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:13.025545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:13.025545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:13.025545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:13.025545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:13.025545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:13.025545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:13.025545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:13.025545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:13.025545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:31:13.026460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:31:13.026460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:13.026460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:13.028603 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 387/781] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:13.030376 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200daad-0c73-497c-be19-157c4c7a01fd None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:13.030864 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200daad-0c73-497c-be19-157c4c7a01fd None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:13.031308 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200daad-0c73-497c-be19-157c4c7a01fd None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:13.033346 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 388/782] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:13.034375 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200daad-0c73-497c-be19-157c4c7a01fd None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:13.067300 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592a3f2-eb40-4ca2-839c-18de22257f2f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:13.138237 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d17af-10cc-4687-8271-e74902ce1ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:13.139397 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d17af-10cc-4687-8271-e74902ce1ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:13.140007 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d17af-10cc-4687-8271-e74902ce1ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:13.140860 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d17af-10cc-4687-8271-e74902ce1ba0 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:13.141984 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d17af-10cc-4687-8271-e74902ce1ba0 None admin] RBAC: Adding query filter params (name=network) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:13.142661 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d17af-10cc-4687-8271-e74902ce1ba0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:13.145680 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d17af-10cc-4687-8271-e74902ce1ba0 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:13.155655 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 395/783] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Sep 26 05:31:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:13.158355 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b0dc6-bc23-4040-924b-dcfa07e1174a None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:13.158945 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b0dc6-bc23-4040-924b-dcfa07e1174a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:13.159817 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b0dc6-bc23-4040-924b-dcfa07e1174a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:13.168137 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200daad-0c73-497c-be19-157c4c7a01fd None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:13.194136 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-2b0b0dc6-bc23-4040-924b-dcfa07e1174a None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:13.196754 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:13.197283 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2b0b0dc6-bc23-4040-924b-dcfa07e1174a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:13.209132 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec2b7d-8ee8-4b1b-8775-3cb1f02456c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:13.210451 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec2b7d-8ee8-4b1b-8775-3cb1f02456c6 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:13.211034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec2b7d-8ee8-4b1b-8775-3cb1f02456c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:13.211722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec2b7d-8ee8-4b1b-8775-3cb1f02456c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:13.212590 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec2b7d-8ee8-4b1b-8775-3cb1f02456c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:13.213098 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec2b7d-8ee8-4b1b-8775-3cb1f02456c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:13.214677 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec2b7d-8ee8-4b1b-8775-3cb1f02456c6 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:13.229185 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 389/784] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:13.230539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec2b7d-8ee8-4b1b-8775-3cb1f02456c6 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:13.246566 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:13.336276 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 396/785] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:31:13.337793 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b0dc6-bc23-4040-924b-dcfa07e1174a None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:13.344620 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec2b7d-8ee8-4b1b-8775-3cb1f02456c6 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:13.387449 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2dcc1-0c20-4149-a461-729a149c1e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:13.391188 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2dcc1-0c20-4149-a461-729a149c1e59 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:13.391719 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2dcc1-0c20-4149-a461-729a149c1e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:13.392221 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2dcc1-0c20-4149-a461-729a149c1e59 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:13.393069 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2dcc1-0c20-4149-a461-729a149c1e59 None admin] RBAC: Adding query filter params (type=network) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:13.393569 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2dcc1-0c20-4149-a461-729a149c1e59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:13.395424 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2dcc1-0c20-4149-a461-729a149c1e59 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:13.405931 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 390/786] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Sep 26 05:31:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:13.410574 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2dcc1-0c20-4149-a461-729a149c1e59 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:13.484322 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:13.537899 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2dcc1-0c20-4149-a461-729a149c1e59 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:13.582386 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be73f8-187f-46a9-81d1-ad1893eced40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:13.583448 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be73f8-187f-46a9-81d1-ad1893eced40 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:13.583988 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be73f8-187f-46a9-81d1-ad1893eced40 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:13.584453 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be73f8-187f-46a9-81d1-ad1893eced40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:13.585425 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be73f8-187f-46a9-81d1-ad1893eced40 None admin] RBAC: Adding query filter params (interface=public, service_id=eb8f91dd8b4c4b469e68476051055aa5, region_id=RegionOne) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:13.585963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be73f8-187f-46a9-81d1-ad1893eced40 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:13.587658 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be73f8-187f-46a9-81d1-ad1893eced40 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:13.594332 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 391/787] 10.222.0.66 () {56 vars in 1251 bytes} [Mon Sep 26 05:31:13 2022] GET /identity/v3/endpoints?service_id=eb8f91dd8b4c4b469e68476051055aa5&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:13.602587 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be73f8-187f-46a9-81d1-ad1893eced40 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:13.625079 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b0dc6-bc23-4040-924b-dcfa07e1174a None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:13.689942 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769f41c-8e7a-4881-8413-8ffa644d9712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:13.690901 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769f41c-8e7a-4881-8413-8ffa644d9712 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:13.691179 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769f41c-8e7a-4881-8413-8ffa644d9712 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:13.691690 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769f41c-8e7a-4881-8413-8ffa644d9712 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:13.703201 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769f41c-8e7a-4881-8413-8ffa644d9712 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:13.705682 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769f41c-8e7a-4881-8413-8ffa644d9712 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:13.723098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-d769f41c-8e7a-4881-8413-8ffa644d9712 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 05:31:13.723098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:13.723098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:13.723098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:13.723098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:13.723098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:13.723098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:13.723098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:13.723098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:13.723098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:13.723098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:13.723098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:13.723098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:31:13.723098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:31:13.723098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:31:13.723098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:31:13.724123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:13.724123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:13.724123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:31:13.724123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:31:13.724123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:31:13.724123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:31:13.724123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:13.724123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:13.724123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:13.724123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:13.724123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:13.724123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:13.724123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:13.724123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:13.724123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:13.724123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:13.724123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:13.724123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:13.725119 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:13.725119 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:13.725119 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:31:13.725119 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:31:13.725119 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:31:13.725119 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:31:13.725119 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:31:13.725119 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:31:13.725119 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 05:31:13.725119 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:13.725657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 397/788] 10.222.0.66 () {56 vars in 1117 bytes} [Mon Sep 26 05:31:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:13.731792 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31116ee3-9ce9-4036-9722-3d5f9fc4b808 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:13.731792 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31116ee3-9ce9-4036-9722-3d5f9fc4b808 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:13.731792 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31116ee3-9ce9-4036-9722-3d5f9fc4b808 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:13.733282 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 398/789] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:13.735185 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31116ee3-9ce9-4036-9722-3d5f9fc4b808 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:13.748854 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be73f8-187f-46a9-81d1-ad1893eced40 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:13.764446 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:13.766038 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:13.795358 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76a2f5-7941-4925-a9f5-5b7d416b9fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:13.796038 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76a2f5-7941-4925-a9f5-5b7d416b9fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:13.796315 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76a2f5-7941-4925-a9f5-5b7d416b9fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:13.796585 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76a2f5-7941-4925-a9f5-5b7d416b9fa2 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:13.797262 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76a2f5-7941-4925-a9f5-5b7d416b9fa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:13.799264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76a2f5-7941-4925-a9f5-5b7d416b9fa2 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:13.807852 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 392/790] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Sep 26 05:31:13 2022] GET /identity/v3/services => generated 772 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:13.809224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f658b5f-c5e3-4cf3-a6d9-78d3531caa67 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:13.809499 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f658b5f-c5e3-4cf3-a6d9-78d3531caa67 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:13.809762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f658b5f-c5e3-4cf3-a6d9-78d3531caa67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:13.873621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-0f658b5f-c5e3-4cf3-a6d9-78d3531caa67 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:13.875629 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0f658b5f-c5e3-4cf3-a6d9-78d3531caa67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:13.912420 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31116ee3-9ce9-4036-9722-3d5f9fc4b808 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:13.969711 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae18a5-0dc0-41c5-9be5-aff2ce9a2f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:13.970346 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae18a5-0dc0-41c5-9be5-aff2ce9a2f71 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:13.970623 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae18a5-0dc0-41c5-9be5-aff2ce9a2f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:13.970893 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae18a5-0dc0-41c5-9be5-aff2ce9a2f71 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:13.971643 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae18a5-0dc0-41c5-9be5-aff2ce9a2f71 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:13.971983 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae18a5-0dc0-41c5-9be5-aff2ce9a2f71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:13.973558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adae18a5-0dc0-41c5-9be5-aff2ce9a2f71 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:13.994578 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 399/791] 10.222.0.66 () {56 vars in 1149 bytes} [Mon Sep 26 05:31:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:14.001211 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae18a5-0dc0-41c5-9be5-aff2ce9a2f71 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:14.042821 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 393/792] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:31:14.044432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f658b5f-c5e3-4cf3-a6d9-78d3531caa67 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:14.128252 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:14.162416 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adae18a5-0dc0-41c5-9be5-aff2ce9a2f71 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:14.204093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73ae3c-807d-4672-9b2b-d28537906bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:14.205058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73ae3c-807d-4672-9b2b-d28537906bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:14.205334 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73ae3c-807d-4672-9b2b-d28537906bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:14.205603 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73ae3c-807d-4672-9b2b-d28537906bf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:14.218868 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73ae3c-807d-4672-9b2b-d28537906bf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:14.221002 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73ae3c-807d-4672-9b2b-d28537906bf2 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:14.239901 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-0e73ae3c-807d-4672-9b2b-d28537906bf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:14.239901 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:14.239901 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:14.239901 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:14.239901 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:14.239901 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:14.239901 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:14.239901 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:14.239901 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:14.239901 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:14.239901 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:14.239901 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:14.239901 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:31:14.239901 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:31:14.239901 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:31:14.239901 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:31:14.240940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:14.240940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:14.240940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:14.240940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:14.240940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:14.240940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:14.240940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:14.240940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:14.240940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:14.240940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:14.240940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:14.240940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:14.240940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:14.240940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:14.240940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:14.240940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:14.240940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:31:14.241891 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:31:14.241891 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:14.241891 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:14.241891 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 400/793] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:31:14.248312 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73ae3c-807d-4672-9b2b-d28537906bf2 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:14.254188 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f658b5f-c5e3-4cf3-a6d9-78d3531caa67 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:14.269319 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:14.355413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ae202-7835-42c3-ba90-d31d4a33bcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:14.356124 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ae202-7835-42c3-ba90-d31d4a33bcf1 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:14.356406 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ae202-7835-42c3-ba90-d31d4a33bcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:14.356679 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ae202-7835-42c3-ba90-d31d4a33bcf1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:14.374692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ae202-7835-42c3-ba90-d31d4a33bcf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:31:14.376128 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73ae3c-807d-4672-9b2b-d28537906bf2 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:14.379815 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-6f6ae202-7835-42c3-ba90-d31d4a33bcf1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:31:14.379815 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:14.379815 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:14.379815 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:14.379815 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:14.379815 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:14.379815 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:14.379815 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:14.379815 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:14.379815 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:14.379815 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:14.379815 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:14.379815 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:31:14.379815 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:31:14.379815 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:31:14.379815 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:31:14.381692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:31:14.381692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:31:14.381692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:31:14.381692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:31:14.381692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:14.381692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:14.381692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:14.381692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:14.381692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:14.381692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:14.381692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:14.381692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:14.381692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:14.381692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:14.381692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:14.381692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:14.382790 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:14.382790 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:14.382790 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:14.382790 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:14.382790 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:31:14.382790 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:31:14.382790 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:31:14.382790 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:31:14.382790 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:31:14.382790 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:31:14.382790 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:31:14.382790 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:14.382790 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 394/794] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:31:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:14.390328 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ae202-7835-42c3-ba90-d31d4a33bcf1 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:14.406736 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:14.418805 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11b317-dfc9-420e-9be5-f06297fe84b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:14.419442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11b317-dfc9-420e-9be5-f06297fe84b4 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:14.419714 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11b317-dfc9-420e-9be5-f06297fe84b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:14.420605 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc11b317-dfc9-420e-9be5-f06297fe84b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:14.421284 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11b317-dfc9-420e-9be5-f06297fe84b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:14.421589 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11b317-dfc9-420e-9be5-f06297fe84b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:14.423690 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc11b317-dfc9-420e-9be5-f06297fe84b4 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:14.439036 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 401/795] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:31:14.445206 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11b317-dfc9-420e-9be5-f06297fe84b4 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:14.547954 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ae202-7835-42c3-ba90-d31d4a33bcf1 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:14.587232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102758a1-e877-46cb-9791-28c2c0b6482a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:14.587885 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102758a1-e877-46cb-9791-28c2c0b6482a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:14.588157 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102758a1-e877-46cb-9791-28c2c0b6482a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:14.588419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102758a1-e877-46cb-9791-28c2c0b6482a None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:14.589085 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102758a1-e877-46cb-9791-28c2c0b6482a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:14.589376 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102758a1-e877-46cb-9791-28c2c0b6482a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:14.590820 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102758a1-e877-46cb-9791-28c2c0b6482a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:14.601214 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 395/796] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:31:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:14.606957 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102758a1-e877-46cb-9791-28c2c0b6482a None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:14.636658 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc11b317-dfc9-420e-9be5-f06297fe84b4 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:14.643062 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:14.708325 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c632d2-1280-47fe-9b8f-f83e78368ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:14.708325 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c632d2-1280-47fe-9b8f-f83e78368ff8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:14.708325 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c632d2-1280-47fe-9b8f-f83e78368ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:14.708325 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c632d2-1280-47fe-9b8f-f83e78368ff8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:14.719779 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c632d2-1280-47fe-9b8f-f83e78368ff8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:14.719988 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102758a1-e877-46cb-9791-28c2c0b6482a None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:14.720283 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c632d2-1280-47fe-9b8f-f83e78368ff8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:14.743454 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-41c632d2-1280-47fe-9b8f-f83e78368ff8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:31:14.743454 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:14.743454 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:14.743454 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:14.743454 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:14.743454 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:14.743454 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:14.743454 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:14.743454 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:14.743454 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:14.743454 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:14.743454 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:14.743454 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:31:14.743454 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:31:14.743454 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:31:14.744557 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:31:14.744557 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:14.744557 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:14.744557 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:14.744557 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:14.744557 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:14.744557 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:14.744557 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:14.744557 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:14.744557 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:14.744557 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:14.744557 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:14.744557 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:14.744557 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:14.744557 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:14.744557 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:14.744557 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:14.745452 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:31:14.745452 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:31:14.745452 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:31:14.745452 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:31:14.745452 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:31:14.745452 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:31:14.745452 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:31:14.745452 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:14.752068 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 402/797] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:31:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:31:14.753754 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c632d2-1280-47fe-9b8f-f83e78368ff8 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:14.759632 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10cc1e-0545-4a8f-98e3-032a93352b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:14.760962 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10cc1e-0545-4a8f-98e3-032a93352b41 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:14.761556 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10cc1e-0545-4a8f-98e3-032a93352b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:14.761991 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10cc1e-0545-4a8f-98e3-032a93352b41 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:14.762748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10cc1e-0545-4a8f-98e3-032a93352b41 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:14.764339 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10cc1e-0545-4a8f-98e3-032a93352b41 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:14.774301 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-3c10cc1e-0545-4a8f-98e3-032a93352b41 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 05:31:14.774301 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:14.774301 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:31:14.774301 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:31:14.774301 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:31:14.774301 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:31:14.774301 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:31:14.774301 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:14.774301 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 05:31:14.774301 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:14.774301 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:31:14.774301 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:14.774301 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:14.774301 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:14.774301 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:14.774301 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:14.774301 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:14.775369 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:14.775369 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:14.775369 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:14.775369 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:14.775369 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:14.775369 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:14.775369 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:31:14.775369 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:31:14.775369 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:31:14.775369 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:31:14.775369 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:14.775369 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:14.775369 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:14.775369 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:14.775369 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:14.775369 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:14.776433 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:14.776433 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:14.776433 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:14.776433 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:14.776433 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:14.776433 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:14.776433 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:14.776433 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:14.776433 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:14.776433 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:14.776433 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:31:14.776433 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:14.776433 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 26 05:31:14.776433 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:14.778988 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 396/798] 10.222.0.66 () {56 vars in 1129 bytes} [Mon Sep 26 05:31:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:14.780058 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10cc1e-0545-4a8f-98e3-032a93352b41 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:14.840677 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:14.880218 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:14.890686 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10cc1e-0545-4a8f-98e3-032a93352b41 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:14.933681 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367f094-21e8-4bae-8525-b9a2135c9c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:14.934594 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367f094-21e8-4bae-8525-b9a2135c9c0b None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:14.935213 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367f094-21e8-4bae-8525-b9a2135c9c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:14.935627 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367f094-21e8-4bae-8525-b9a2135c9c0b None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:14.936504 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b367f094-21e8-4bae-8525-b9a2135c9c0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:14.937335 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b367f094-21e8-4bae-8525-b9a2135c9c0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:14.939277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b367f094-21e8-4bae-8525-b9a2135c9c0b None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:14.955175 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c632d2-1280-47fe-9b8f-f83e78368ff8 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:14.967438 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 397/799] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:31:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:14.969515 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367f094-21e8-4bae-8525-b9a2135c9c0b None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:14.999190 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898baa3-c685-4c3f-9c19-51e89e2487c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:15.000195 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898baa3-c685-4c3f-9c19-51e89e2487c9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:15.000614 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898baa3-c685-4c3f-9c19-51e89e2487c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:15.001022 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898baa3-c685-4c3f-9c19-51e89e2487c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:15.014108 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898baa3-c685-4c3f-9c19-51e89e2487c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:15.016182 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898baa3-c685-4c3f-9c19-51e89e2487c9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:15.033009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-f898baa3-c685-4c3f-9c19-51e89e2487c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:15.033009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:15.033009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:15.033009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:15.033009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:15.033009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:15.033009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:15.033009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:15.033009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:15.033009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:15.033009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:15.033009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:15.033009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:31:15.033009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:31:15.033009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:31:15.033009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:31:15.034215 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:15.034215 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:15.034215 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:15.034215 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:15.034215 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:15.034215 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:15.034215 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:15.034215 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:15.034215 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:15.034215 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:15.034215 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:15.034215 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:15.034215 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:15.034215 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:15.034215 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:15.034215 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:15.034215 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:31:15.035315 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:31:15.035315 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:15.035315 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:15.037402 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 403/800] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:15.043771 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898baa3-c685-4c3f-9c19-51e89e2487c9 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:15.164374 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:15.174712 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898baa3-c685-4c3f-9c19-51e89e2487c9 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:15.219296 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324ca47-41cf-43f6-a214-5ac4f90612ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:15.220035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324ca47-41cf-43f6-a214-5ac4f90612ea None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:15.220318 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324ca47-41cf-43f6-a214-5ac4f90612ea None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:15.220592 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324ca47-41cf-43f6-a214-5ac4f90612ea None admin] PATH_INFO: `/v3/projects/953bb95b0ba84d4f99a73afb426bb8c8/users/5bdaf32400b94aa291ad43a3131e1d0a/roles/024a61996071437aa07a3faf2bb5ae69` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:15.239510 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324ca47-41cf-43f6-a214-5ac4f90612ea None admin] RBAC: Authorizing `identity:create_grant(project_id=953bb95b0ba84d4f99a73afb426bb8c8, user_id=5bdaf32400b94aa291ad43a3131e1d0a, role_id=024a61996071437aa07a3faf2bb5ae69)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:15.241916 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324ca47-41cf-43f6-a214-5ac4f90612ea None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:15.259724 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 404/801] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 26 05:31:15 2022] PUT /identity/v3/projects/953bb95b0ba84d4f99a73afb426bb8c8/users/5bdaf32400b94aa291ad43a3131e1d0a/roles/024a61996071437aa07a3faf2bb5ae69 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:15.272856 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324ca47-41cf-43f6-a214-5ac4f90612ea None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:15.309536 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367f094-21e8-4bae-8525-b9a2135c9c0b None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:15.363854 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a141e92-9097-4345-8713-0debb56c1d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:15.364526 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a141e92-9097-4345-8713-0debb56c1d7f None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:15.364806 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a141e92-9097-4345-8713-0debb56c1d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:15.365081 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a141e92-9097-4345-8713-0debb56c1d7f None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:15.365830 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a141e92-9097-4345-8713-0debb56c1d7f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:15.366136 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a141e92-9097-4345-8713-0debb56c1d7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:15.367672 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a141e92-9097-4345-8713-0debb56c1d7f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:15.379585 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 398/802] 10.222.0.66 () {56 vars in 1124 bytes} [Mon Sep 26 05:31:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:15.381259 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99b954-e1b0-4e3a-b36c-3860adf8d35a None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:15.381619 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99b954-e1b0-4e3a-b36c-3860adf8d35a None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:15.381880 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99b954-e1b0-4e3a-b36c-3860adf8d35a None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:15.387858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 399/803] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:15.389528 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99b954-e1b0-4e3a-b36c-3860adf8d35a None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:15.424091 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:15.486319 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324ca47-41cf-43f6-a214-5ac4f90612ea None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:15.536740 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971eea3-7836-413d-a5ed-da4a1a82edb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:15.537378 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971eea3-7836-413d-a5ed-da4a1a82edb6 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:15.537660 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971eea3-7836-413d-a5ed-da4a1a82edb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:15.537933 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971eea3-7836-413d-a5ed-da4a1a82edb6 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:15.539261 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971eea3-7836-413d-a5ed-da4a1a82edb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:15.539583 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971eea3-7836-413d-a5ed-da4a1a82edb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:15.541037 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971eea3-7836-413d-a5ed-da4a1a82edb6 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:15.563794 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 405/804] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:15.563794 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35751c09-b2db-47af-95d5-3c5897fa27e3 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:15.563794 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35751c09-b2db-47af-95d5-3c5897fa27e3 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:15.563794 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35751c09-b2db-47af-95d5-3c5897fa27e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:15.573265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99b954-e1b0-4e3a-b36c-3860adf8d35a None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:15.594637 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-35751c09-b2db-47af-95d5-3c5897fa27e3 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:15.596858 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-35751c09-b2db-47af-95d5-3c5897fa27e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:15.600878 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:15.627926 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5174d-8ce3-40c7-bc2a-1fc3b344073b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:15.629466 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5174d-8ce3-40c7-bc2a-1fc3b344073b None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:15.630185 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5174d-8ce3-40c7-bc2a-1fc3b344073b None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:15.630869 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5174d-8ce3-40c7-bc2a-1fc3b344073b None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:15.632406 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5174d-8ce3-40c7-bc2a-1fc3b344073b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:15.633228 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5174d-8ce3-40c7-bc2a-1fc3b344073b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:15.636126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5174d-8ce3-40c7-bc2a-1fc3b344073b None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:15.645954 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 400/805] 10.222.0.66 () {56 vars in 1124 bytes} [Mon Sep 26 05:31:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:15.647972 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5174d-8ce3-40c7-bc2a-1fc3b344073b None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:15.736129 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 406/806] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:31:15.737933 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35751c09-b2db-47af-95d5-3c5897fa27e3 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:15.749380 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:15.772387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5174d-8ce3-40c7-bc2a-1fc3b344073b None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:15.819319 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d2a6d-ed76-4017-b90d-4ec196534c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:15.820470 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d2a6d-ed76-4017-b90d-4ec196534c64 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:15.821179 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d2a6d-ed76-4017-b90d-4ec196534c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:15.822349 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d2a6d-ed76-4017-b90d-4ec196534c64 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:15.833740 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d2a6d-ed76-4017-b90d-4ec196534c64 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:15.835630 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d2a6d-ed76-4017-b90d-4ec196534c64 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:15.849423 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-c35d2a6d-ed76-4017-b90d-4ec196534c64 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 05:31:15.849423 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:15.849423 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:15.849423 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:15.849423 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:15.849423 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:15.849423 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:15.849423 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:15.849423 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:15.849423 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:15.849423 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:15.849423 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:15.849423 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:31:15.849423 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:31:15.849423 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:31:15.849423 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:31:15.850432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:15.850432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:15.850432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:31:15.850432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:31:15.850432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:31:15.850432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:31:15.850432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:15.850432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:15.850432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:15.850432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:15.850432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:15.850432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:15.850432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:15.850432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:15.850432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:15.850432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:15.850432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:15.850432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:15.851495 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:15.851495 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:15.851495 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:31:15.851495 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:31:15.851495 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:31:15.851495 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:31:15.851495 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:31:15.851495 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:31:15.851495 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 05:31:15.851495 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:15.854345 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 401/807] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:31:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:15.860530 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d2a6d-ed76-4017-b90d-4ec196534c64 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:15.980404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d2a6d-ed76-4017-b90d-4ec196534c64 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:16.021128 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd380f9-d871-46da-a23b-1c99a9929b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:16.022162 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd380f9-d871-46da-a23b-1c99a9929b1c None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:16.022727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd380f9-d871-46da-a23b-1c99a9929b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:16.023190 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd380f9-d871-46da-a23b-1c99a9929b1c None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:16.024179 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd380f9-d871-46da-a23b-1c99a9929b1c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:16.024748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd380f9-d871-46da-a23b-1c99a9929b1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:16.026393 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd380f9-d871-46da-a23b-1c99a9929b1c None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:16.037275 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:16.050292 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 402/808] 10.222.0.66 () {56 vars in 1135 bytes} [Mon Sep 26 05:31:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:16.056838 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd380f9-d871-46da-a23b-1c99a9929b1c None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:16.066125 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35751c09-b2db-47af-95d5-3c5897fa27e3 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:16.164724 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f3251-61a0-4366-9d73-2d5be67220f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:16.165372 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f3251-61a0-4366-9d73-2d5be67220f8 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:16.165649 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f3251-61a0-4366-9d73-2d5be67220f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:16.165918 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f3251-61a0-4366-9d73-2d5be67220f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:16.166612 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f3251-61a0-4366-9d73-2d5be67220f8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:16.168674 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f3251-61a0-4366-9d73-2d5be67220f8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:16.179199 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:16.179703 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd380f9-d871-46da-a23b-1c99a9929b1c None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:16.204044 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 407/809] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:31:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:31:16.236952 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21038d59-ac92-4b5c-815b-20ddabfa9b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:16.238104 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21038d59-ac92-4b5c-815b-20ddabfa9b36 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:16.238593 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21038d59-ac92-4b5c-815b-20ddabfa9b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:16.239047 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21038d59-ac92-4b5c-815b-20ddabfa9b36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:16.251868 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21038d59-ac92-4b5c-815b-20ddabfa9b36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:16.253773 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21038d59-ac92-4b5c-815b-20ddabfa9b36 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:16.271710 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-21038d59-ac92-4b5c-815b-20ddabfa9b36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:16.271710 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:16.271710 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:16.271710 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:16.271710 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:16.271710 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:16.271710 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:16.271710 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:16.271710 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:16.271710 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:16.271710 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:16.271710 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:16.271710 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:31:16.271710 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:31:16.271710 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:31:16.271710 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:31:16.272822 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:16.272822 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:16.272822 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:16.272822 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:16.272822 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:16.272822 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:16.272822 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:16.272822 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:16.272822 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:16.272822 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:16.272822 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:16.272822 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:16.272822 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:16.272822 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:16.272822 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:16.272822 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:16.272822 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:31:16.273815 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:31:16.273815 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:16.273815 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:16.276128 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 403/810] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:31:16.283877 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f3251-61a0-4366-9d73-2d5be67220f8 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:16.355255 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21038d59-ac92-4b5c-815b-20ddabfa9b36 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:16.448419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:16.462299 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f3251-61a0-4366-9d73-2d5be67220f8 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:16.527125 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785a8f7-0993-4557-971e-5f7e1a4a43fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:16.528107 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785a8f7-0993-4557-971e-5f7e1a4a43fc None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:16.528360 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21038d59-ac92-4b5c-815b-20ddabfa9b36 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:16.528640 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785a8f7-0993-4557-971e-5f7e1a4a43fc None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:16.529051 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785a8f7-0993-4557-971e-5f7e1a4a43fc None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:16.530204 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785a8f7-0993-4557-971e-5f7e1a4a43fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:16.530688 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785a8f7-0993-4557-971e-5f7e1a4a43fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:16.533256 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785a8f7-0993-4557-971e-5f7e1a4a43fc None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:16.560041 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 408/811] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:16.562405 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b26ff1-0804-4e19-b9cc-a8d7e39a8789 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:16.562890 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b26ff1-0804-4e19-b9cc-a8d7e39a8789 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:16.563359 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b26ff1-0804-4e19-b9cc-a8d7e39a8789 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:16.566164 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 409/812] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:16.570638 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0adca-3659-46cb-9ce0-efc3fbf7e80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:16.571410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0adca-3659-46cb-9ce0-efc3fbf7e80a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:16.571530 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b26ff1-0804-4e19-b9cc-a8d7e39a8789 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:16.571886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0adca-3659-46cb-9ce0-efc3fbf7e80a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:16.572245 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0adca-3659-46cb-9ce0-efc3fbf7e80a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:16.585005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae0adca-3659-46cb-9ce0-efc3fbf7e80a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:31:16.590870 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-5ae0adca-3659-46cb-9ce0-efc3fbf7e80a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:31:16.590870 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:16.590870 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:16.590870 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:16.590870 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:16.590870 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:16.590870 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:16.590870 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:16.590870 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:16.590870 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:16.590870 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:16.590870 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:16.590870 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:31:16.590870 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:31:16.590870 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:31:16.590870 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:31:16.591897 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:31:16.591897 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:31:16.591897 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:31:16.591897 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:31:16.591897 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:16.591897 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:16.591897 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:16.591897 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:16.591897 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:16.591897 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:16.591897 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:16.591897 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:16.591897 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:16.591897 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:16.591897 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:16.591897 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:16.593500 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:16.593500 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:16.593500 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:16.593500 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:16.593500 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:31:16.593500 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:31:16.593500 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:31:16.593500 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:31:16.593500 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:31:16.593500 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:31:16.593500 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:31:16.593500 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:16.593500 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 404/813] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:31:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:16.595476 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8dddb6-3f8c-433a-8eb1-e896618a7217 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:16.595476 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8dddb6-3f8c-433a-8eb1-e896618a7217 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:16.595476 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8dddb6-3f8c-433a-8eb1-e896618a7217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:16.614759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-0e8dddb6-3f8c-433a-8eb1-e896618a7217 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:16.616629 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0e8dddb6-3f8c-433a-8eb1-e896618a7217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:16.692588 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 405/814] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:31:16.693633 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8dddb6-3f8c-433a-8eb1-e896618a7217 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:16.699683 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:16.800325 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:16.852586 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b26ff1-0804-4e19-b9cc-a8d7e39a8789 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:16.907701 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8dddb6-3f8c-433a-8eb1-e896618a7217 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:16.964111 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84680b-8c65-413c-80ae-5fb6ced899cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:16.964827 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84680b-8c65-413c-80ae-5fb6ced899cf None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:16.965103 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84680b-8c65-413c-80ae-5fb6ced899cf None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:16.965368 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb84680b-8c65-413c-80ae-5fb6ced899cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:16.976534 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf3c87-a540-4d81-b64c-5e0e9ee50ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:16.977581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf3c87-a540-4d81-b64c-5e0e9ee50ffd None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:16.978286 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf3c87-a540-4d81-b64c-5e0e9ee50ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:16.978772 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf3c87-a540-4d81-b64c-5e0e9ee50ffd None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:16.980018 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf3c87-a540-4d81-b64c-5e0e9ee50ffd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:16.980551 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf3c87-a540-4d81-b64c-5e0e9ee50ffd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:16.983198 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf3c87-a540-4d81-b64c-5e0e9ee50ffd None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:16.985078 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84680b-8c65-413c-80ae-5fb6ced899cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:16.986559 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb84680b-8c65-413c-80ae-5fb6ced899cf None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:17.001040 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 406/815] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:31:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:17.002034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-eb84680b-8c65-413c-80ae-5fb6ced899cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:31:17.002034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:17.002034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:17.002034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:17.002034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:17.002034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:17.002034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:17.002034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:17.002034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:17.002034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:17.002034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:17.002034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:17.002034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:31:17.002034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:31:17.002034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:31:17.003035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:31:17.003035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:17.003035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:17.003035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:17.003035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:17.003035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:17.003035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:17.003035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:17.003035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:17.003035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:17.003035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:17.003035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:17.003035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:17.003035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:17.003035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:17.003035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:17.003035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:17.004716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:31:17.004716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:31:17.004716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:31:17.004716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:31:17.004716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:31:17.004716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:31:17.004716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:31:17.004716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:17.005285 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf3c87-a540-4d81-b64c-5e0e9ee50ffd None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:17.005382 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 410/816] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:31:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 433 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:31:17.013419 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84680b-8c65-413c-80ae-5fb6ced899cf None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:17.150796 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb84680b-8c65-413c-80ae-5fb6ced899cf None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:17.176563 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:17.204376 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:17.209489 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf3c87-a540-4d81-b64c-5e0e9ee50ffd None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:17.232108 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec46bdc-8d3c-4992-8e5d-c52a51cc805a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:17.232729 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec46bdc-8d3c-4992-8e5d-c52a51cc805a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:17.233008 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec46bdc-8d3c-4992-8e5d-c52a51cc805a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:17.233336 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec46bdc-8d3c-4992-8e5d-c52a51cc805a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:17.246223 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec46bdc-8d3c-4992-8e5d-c52a51cc805a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:17.247797 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec46bdc-8d3c-4992-8e5d-c52a51cc805a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:17.266190 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-0ec46bdc-8d3c-4992-8e5d-c52a51cc805a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:17.266190 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:17.266190 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:17.266190 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:17.266190 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:17.266190 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:17.266190 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:17.266190 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:17.266190 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:17.266190 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:17.266190 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:17.266190 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:17.266190 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:31:17.266190 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:31:17.266190 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:31:17.266190 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:31:17.268416 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:17.268416 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:17.268416 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:17.268416 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:17.268416 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:17.268416 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:17.268416 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:17.268416 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:17.268416 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:17.268416 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:17.268416 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:17.268416 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:17.268416 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:17.268416 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:17.268416 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:17.268416 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:17.268416 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:31:17.270248 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:31:17.270248 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:17.270248 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:17.272396 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 411/817] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:17.273537 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec46bdc-8d3c-4992-8e5d-c52a51cc805a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:17.281060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488d03b-ac06-4485-942f-8a7c7f990533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:17.282714 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488d03b-ac06-4485-942f-8a7c7f990533 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:17.283487 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488d03b-ac06-4485-942f-8a7c7f990533 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:17.284394 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488d03b-ac06-4485-942f-8a7c7f990533 None admin] PATH_INFO: `/v3/services/network` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:17.286960 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488d03b-ac06-4485-942f-8a7c7f990533 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:17.292265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488d03b-ac06-4485-942f-8a7c7f990533 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:17.318713 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-d488d03b-ac06-4485-942f-8a7c7f990533 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 05:31:17.318713 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:17.318713 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:31:17.318713 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:31:17.318713 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:31:17.318713 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:31:17.318713 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:31:17.318713 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:17.318713 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 05:31:17.318713 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:17.318713 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:31:17.318713 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:17.318713 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:17.318713 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:17.318713 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:17.318713 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:17.318713 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:17.320862 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:17.320862 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:17.320862 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:17.320862 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:17.320862 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:17.320862 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:17.320862 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:31:17.320862 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:31:17.320862 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:31:17.320862 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:31:17.320862 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:17.320862 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:17.320862 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:17.320862 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:17.320862 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:17.320862 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:17.322568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:17.322568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:17.322568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:17.322568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:17.322568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:17.322568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:17.322568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:17.322568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:17.322568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:17.322568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:17.322568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:31:17.322568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:17.322568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 26 05:31:17.322568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:17.326810 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 407/818] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:31:17 2022] GET /identity/v3/services/network => generated 88 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:17.331258 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488d03b-ac06-4485-942f-8a7c7f990533 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:17.471975 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec46bdc-8d3c-4992-8e5d-c52a51cc805a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:17.546329 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488d03b-ac06-4485-942f-8a7c7f990533 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:17.550256 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b5732-86d0-462c-a1b3-d243c65bb7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:17.552666 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b5732-86d0-462c-a1b3-d243c65bb7f8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:17.553129 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b5732-86d0-462c-a1b3-d243c65bb7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:17.553597 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b5732-86d0-462c-a1b3-d243c65bb7f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:17.554808 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b5732-86d0-462c-a1b3-d243c65bb7f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:17.555248 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b5732-86d0-462c-a1b3-d243c65bb7f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:17.557564 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b5732-86d0-462c-a1b3-d243c65bb7f8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:17.588492 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 412/819] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:31:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:17.590129 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b5732-86d0-462c-a1b3-d243c65bb7f8 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:17.631520 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf49a27-5e60-42b5-96dd-1ee25b067239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:17.632449 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf49a27-5e60-42b5-96dd-1ee25b067239 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:17.632591 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf49a27-5e60-42b5-96dd-1ee25b067239 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:17.632938 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf49a27-5e60-42b5-96dd-1ee25b067239 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:17.633774 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf49a27-5e60-42b5-96dd-1ee25b067239 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:17.634081 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf49a27-5e60-42b5-96dd-1ee25b067239 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:17.635503 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf49a27-5e60-42b5-96dd-1ee25b067239 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:17.652771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 408/820] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:17.653703 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf49a27-5e60-42b5-96dd-1ee25b067239 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:17.663105 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:17.697883 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:17.770023 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b5732-86d0-462c-a1b3-d243c65bb7f8 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:17.816992 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e369c7-1319-4337-bcdf-7039b20d8e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:17.817909 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e369c7-1319-4337-bcdf-7039b20d8e02 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:17.818328 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e369c7-1319-4337-bcdf-7039b20d8e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:17.818761 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e369c7-1319-4337-bcdf-7039b20d8e02 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:17.819614 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e369c7-1319-4337-bcdf-7039b20d8e02 None admin] RBAC: Adding query filter params (name=network) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:17.820081 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e369c7-1319-4337-bcdf-7039b20d8e02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:17.821654 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e369c7-1319-4337-bcdf-7039b20d8e02 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:17.828962 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 413/821] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Sep 26 05:31:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:17.830624 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e369c7-1319-4337-bcdf-7039b20d8e02 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:17.878337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf49a27-5e60-42b5-96dd-1ee25b067239 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:17.943158 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96851f-f4e0-4457-9f35-a4959ea7ae0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:17.944323 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96851f-f4e0-4457-9f35-a4959ea7ae0a None admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:17.944874 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96851f-f4e0-4457-9f35-a4959ea7ae0a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:17.945340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96851f-f4e0-4457-9f35-a4959ea7ae0a None admin] PATH_INFO: `/v3/projects/953bb95b0ba84d4f99a73afb426bb8c8/users/830cd52ac42548b2ade17b5215aefd28/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:17.948647 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96851f-f4e0-4457-9f35-a4959ea7ae0a None admin] RBAC: Authorizing `identity:create_grant(project_id=953bb95b0ba84d4f99a73afb426bb8c8, user_id=830cd52ac42548b2ade17b5215aefd28, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:17.951256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96851f-f4e0-4457-9f35-a4959ea7ae0a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:17.977809 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 409/822] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 26 05:31:17 2022] PUT /identity/v3/projects/953bb95b0ba84d4f99a73afb426bb8c8/users/830cd52ac42548b2ade17b5215aefd28/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:31:17.979420 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96851f-f4e0-4457-9f35-a4959ea7ae0a None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:18.090845 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:18.135409 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e369c7-1319-4337-bcdf-7039b20d8e02 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:18.152393 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:18.187864 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96851f-f4e0-4457-9f35-a4959ea7ae0a None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:18.216017 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc7e9e-aef7-4e8d-972b-204666a3b284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:18.217079 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc7e9e-aef7-4e8d-972b-204666a3b284 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:18.217541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc7e9e-aef7-4e8d-972b-204666a3b284 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:18.217981 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc7e9e-aef7-4e8d-972b-204666a3b284 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:18.233634 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc7e9e-aef7-4e8d-972b-204666a3b284 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:18.236771 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc7e9e-aef7-4e8d-972b-204666a3b284 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:18.263718 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-5cdc7e9e-aef7-4e8d-972b-204666a3b284 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:31:18.263718 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:18.263718 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:18.263718 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:18.263718 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:18.263718 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:18.263718 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:18.263718 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:18.263718 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:18.263718 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:18.263718 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:18.263718 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:18.263718 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:31:18.263718 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:31:18.263718 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:31:18.263718 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:31:18.264799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:18.264799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:18.264799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:31:18.264799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:31:18.264799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:31:18.264799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:31:18.264799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:18.264799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:18.264799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:18.264799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:18.264799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:18.264799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:18.264799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:18.264799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:18.264799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:18.264799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:18.264799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:18.264799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:18.265768 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:18.265768 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:18.265768 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:31:18.265768 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:31:18.265768 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:31:18.265768 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:31:18.265768 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:31:18.265768 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:31:18.265768 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:31:18.265768 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:18.266739 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 414/823] 10.222.0.66 () {56 vars in 1093 bytes} [Mon Sep 26 05:31:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 437 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:18.279493 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc7e9e-aef7-4e8d-972b-204666a3b284 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:18.302612 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb167e7-2763-4ad6-8355-deb1f2b9995e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:18.303708 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb167e7-2763-4ad6-8355-deb1f2b9995e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:18.304353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb167e7-2763-4ad6-8355-deb1f2b9995e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:18.304855 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb167e7-2763-4ad6-8355-deb1f2b9995e None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:18.305739 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb167e7-2763-4ad6-8355-deb1f2b9995e None admin] RBAC: Adding query filter params (type=network) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:18.306276 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb167e7-2763-4ad6-8355-deb1f2b9995e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:18.307981 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb167e7-2763-4ad6-8355-deb1f2b9995e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:18.324046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 410/824] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Sep 26 05:31:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:18.326326 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ec931-5ac3-4db5-a86a-7e38139ddf43 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:18.326873 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ec931-5ac3-4db5-a86a-7e38139ddf43 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:18.327806 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32ec931-5ac3-4db5-a86a-7e38139ddf43 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:18.331074 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 411/825] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:31:18.332335 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ec931-5ac3-4db5-a86a-7e38139ddf43 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:18.442936 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc7e9e-aef7-4e8d-972b-204666a3b284 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:18.481423 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f535c1e-f1a2-4f16-a4a9-55049806ff2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:18.482610 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f535c1e-f1a2-4f16-a4a9-55049806ff2e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:18.483103 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f535c1e-f1a2-4f16-a4a9-55049806ff2e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:18.483588 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f535c1e-f1a2-4f16-a4a9-55049806ff2e None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:18.484967 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f535c1e-f1a2-4f16-a4a9-55049806ff2e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:18.485495 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f535c1e-f1a2-4f16-a4a9-55049806ff2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:18.487173 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f535c1e-f1a2-4f16-a4a9-55049806ff2e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:18.508195 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 415/826] 10.222.0.66 () {56 vars in 1133 bytes} [Mon Sep 26 05:31:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:18.510205 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f98b2-85e3-4c62-ae27-61c6df5e1738 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:18.510712 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f98b2-85e3-4c62-ae27-61c6df5e1738 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:18.511194 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f98b2-85e3-4c62-ae27-61c6df5e1738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:18.511908 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32ec931-5ac3-4db5-a86a-7e38139ddf43 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:18.531245 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-2b8f98b2-85e3-4c62-ae27-61c6df5e1738 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:18.533115 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2b8f98b2-85e3-4c62-ae27-61c6df5e1738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:18.536749 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:18.581939 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163afb4-ee23-40c0-926d-a6f6cedb489c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:18.583247 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163afb4-ee23-40c0-926d-a6f6cedb489c None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:18.584131 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163afb4-ee23-40c0-926d-a6f6cedb489c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:18.584849 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163afb4-ee23-40c0-926d-a6f6cedb489c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:18.586535 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163afb4-ee23-40c0-926d-a6f6cedb489c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:18.589637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163afb4-ee23-40c0-926d-a6f6cedb489c None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:18.619931 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 416/827] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:31:18.621499 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f98b2-85e3-4c62-ae27-61c6df5e1738 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:18.651755 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 412/828] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:31:18 2022] POST /identity/v3/endpoints => generated 337 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:31:18.816122 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f98b2-85e3-4c62-ae27-61c6df5e1738 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:18.823097 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cece3f-30e1-41d7-ab75-150f28e29818 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:18.823402 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cece3f-30e1-41d7-ab75-150f28e29818 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:18.823872 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cece3f-30e1-41d7-ab75-150f28e29818 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:18.825704 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 413/829] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:31:18.834172 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8adc8-8291-47aa-9941-e1de15eed2dd None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:18.834641 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8adc8-8291-47aa-9941-e1de15eed2dd None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:18.835052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8adc8-8291-47aa-9941-e1de15eed2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:18.857262 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:18.879439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-09f8adc8-8291-47aa-9941-e1de15eed2dd None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:18.880757 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-09f8adc8-8291-47aa-9941-e1de15eed2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:18.888503 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a896f-f872-4ddd-afda-012ba3e721b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:18.889302 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a896f-f872-4ddd-afda-012ba3e721b8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:18.889581 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a896f-f872-4ddd-afda-012ba3e721b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:18.889852 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664a896f-f872-4ddd-afda-012ba3e721b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:18.897121 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:19.005854 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a896f-f872-4ddd-afda-012ba3e721b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:19.007338 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664a896f-f872-4ddd-afda-012ba3e721b8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:19.020648 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 414/830] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:31:19.054905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8adc8-8291-47aa-9941-e1de15eed2dd None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:19.128127 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 417/831] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:31:18 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:31:19.133903 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a896f-f872-4ddd-afda-012ba3e721b8 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:19.172083 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:19.245488 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8adc8-8291-47aa-9941-e1de15eed2dd None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:19.257916 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664a896f-f872-4ddd-afda-012ba3e721b8 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:19.299454 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110dcdc6-4534-4693-a008-aca7f3f1454b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:19.300141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110dcdc6-4534-4693-a008-aca7f3f1454b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:19.300415 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110dcdc6-4534-4693-a008-aca7f3f1454b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:19.300685 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110dcdc6-4534-4693-a008-aca7f3f1454b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:19.310701 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:19.313881 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110dcdc6-4534-4693-a008-aca7f3f1454b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:19.317239 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110dcdc6-4534-4693-a008-aca7f3f1454b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:19.319660 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacee5e9-90ae-4b77-9d48-4823859edd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:19.320909 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacee5e9-90ae-4b77-9d48-4823859edd3b None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:19.321491 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacee5e9-90ae-4b77-9d48-4823859edd3b None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:19.322089 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacee5e9-90ae-4b77-9d48-4823859edd3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:19.334257 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-110dcdc6-4534-4693-a008-aca7f3f1454b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:19.334257 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:19.334257 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:19.334257 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:19.334257 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:19.334257 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:19.334257 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:19.334257 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:19.334257 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:19.334257 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:19.334257 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:19.334257 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:19.334257 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:31:19.334257 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:31:19.334257 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:31:19.334257 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:31:19.335389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:19.335389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:19.335389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:19.335389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:19.335389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:19.335389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:19.335389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:19.335389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:19.335389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:19.335389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:19.335389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:19.335389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:19.335389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:19.335389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:19.335389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:19.335389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:19.335389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:31:19.337478 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:31:19.337478 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:19.337478 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:19.337478 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 418/832] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:19.341608 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110dcdc6-4534-4693-a008-aca7f3f1454b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:19.346393 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacee5e9-90ae-4b77-9d48-4823859edd3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:31:19.356439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-aacee5e9-90ae-4b77-9d48-4823859edd3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:31:19.356439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:19.356439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:19.356439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:19.356439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:19.356439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:19.356439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:19.356439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:19.356439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:19.356439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:19.356439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:19.356439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:19.356439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:31:19.356439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:31:19.356439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:31:19.356439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:31:19.358656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:31:19.358656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:31:19.358656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:31:19.358656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:31:19.358656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:19.358656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:19.358656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:19.358656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:19.358656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:19.358656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:19.358656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:19.358656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:19.358656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:19.358656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:19.358656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:19.358656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:19.360859 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:19.360859 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:19.360859 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:19.360859 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:19.360859 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:31:19.360859 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:31:19.360859 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:31:19.360859 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:31:19.360859 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:31:19.360859 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:31:19.360859 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:31:19.360859 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:19.360859 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 415/833] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 26 05:31:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:19.364073 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacee5e9-90ae-4b77-9d48-4823859edd3b None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:19.457056 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:19.480420 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110dcdc6-4534-4693-a008-aca7f3f1454b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:19.509493 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacee5e9-90ae-4b77-9d48-4823859edd3b None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:19.526924 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2453f-90d7-48c7-981c-e5bdb6db998c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:19.528403 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2453f-90d7-48c7-981c-e5bdb6db998c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:19.528877 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2453f-90d7-48c7-981c-e5bdb6db998c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:19.529328 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2453f-90d7-48c7-981c-e5bdb6db998c None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:19.530485 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2453f-90d7-48c7-981c-e5bdb6db998c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:19.531015 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2453f-90d7-48c7-981c-e5bdb6db998c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:19.533666 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2453f-90d7-48c7-981c-e5bdb6db998c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:19.552064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 419/834] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:19.552064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2453f-90d7-48c7-981c-e5bdb6db998c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:19.557946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157b6ee-c33a-4961-b5b0-40e1e163b6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:19.558603 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157b6ee-c33a-4961-b5b0-40e1e163b6b6 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:19.559326 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157b6ee-c33a-4961-b5b0-40e1e163b6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:19.559326 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157b6ee-c33a-4961-b5b0-40e1e163b6b6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:19.559892 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157b6ee-c33a-4961-b5b0-40e1e163b6b6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:19.561408 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157b6ee-c33a-4961-b5b0-40e1e163b6b6 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:19.574601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-3157b6ee-c33a-4961-b5b0-40e1e163b6b6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 05:31:19.574601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:19.574601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:31:19.574601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:31:19.574601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:31:19.574601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:31:19.574601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:31:19.574601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:19.574601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 05:31:19.574601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:19.574601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:31:19.574601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:19.574601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:19.574601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:19.574601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:19.574601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:19.574601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:19.575688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:19.575688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:19.575688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:19.575688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:19.575688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:19.575688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:19.575688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:31:19.575688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:31:19.575688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:31:19.575688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:31:19.575688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:19.575688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:19.575688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:19.575688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:19.575688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:19.575688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:19.576570 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:19.576570 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:19.576570 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:19.576570 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:19.576570 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:19.576570 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:19.576570 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:19.576570 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:19.576570 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:19.576570 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:19.576570 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:31:19.576570 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:19.576570 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 05:31:19.576570 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:19.576570 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 416/835] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 26 05:31:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:19.577752 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157b6ee-c33a-4961-b5b0-40e1e163b6b6 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:19.672333 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2453f-90d7-48c7-981c-e5bdb6db998c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:19.681834 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:19.725375 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db97b2-9a84-4df0-baa3-d829e9a73f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:19.726573 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db97b2-9a84-4df0-baa3-d829e9a73f7b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:19.727081 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db97b2-9a84-4df0-baa3-d829e9a73f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:19.727624 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db97b2-9a84-4df0-baa3-d829e9a73f7b None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:19.728948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db97b2-9a84-4df0-baa3-d829e9a73f7b None admin] RBAC: Adding query filter params (name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:19.729482 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db97b2-9a84-4df0-baa3-d829e9a73f7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:19.732094 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db97b2-9a84-4df0-baa3-d829e9a73f7b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:19.743246 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157b6ee-c33a-4961-b5b0-40e1e163b6b6 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:19.745610 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 420/836] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 26 05:31:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:19.748695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db97b2-9a84-4df0-baa3-d829e9a73f7b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:19.768037 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:19.791465 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14393c-5712-4416-87e3-7be2023ff243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:19.792158 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14393c-5712-4416-87e3-7be2023ff243 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:19.792434 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14393c-5712-4416-87e3-7be2023ff243 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:19.792713 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14393c-5712-4416-87e3-7be2023ff243 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:19.800481 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14393c-5712-4416-87e3-7be2023ff243 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:19.801971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14393c-5712-4416-87e3-7be2023ff243 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:19.814765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-1f14393c-5712-4416-87e3-7be2023ff243 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:31:19.814765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:19.814765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:19.814765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:19.814765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:19.814765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:19.814765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:19.814765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:19.814765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:19.814765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:19.814765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:19.814765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:19.814765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:31:19.814765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:31:19.814765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:31:19.816618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:31:19.816618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:19.816618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:19.816618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:19.816618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:19.816618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:19.816618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:19.816618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:19.816618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:19.816618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:19.816618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:19.816618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:19.816618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:19.816618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:19.816618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:19.816618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:19.816618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:19.818771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:31:19.818771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:31:19.818771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:31:19.818771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:31:19.818771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:31:19.818771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:31:19.818771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:31:19.818771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:19.820993 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 417/837] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:31:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:19.821971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14393c-5712-4416-87e3-7be2023ff243 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:19.938197 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db97b2-9a84-4df0-baa3-d829e9a73f7b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:19.994586 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14393c-5712-4416-87e3-7be2023ff243 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:20.000761 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d7b89-094c-4f28-9959-ac7ed671f685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:20.001737 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d7b89-094c-4f28-9959-ac7ed671f685 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:20.002216 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d7b89-094c-4f28-9959-ac7ed671f685 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:20.002681 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d7b89-094c-4f28-9959-ac7ed671f685 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:20.003630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d7b89-094c-4f28-9959-ac7ed671f685 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:20.003978 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d7b89-094c-4f28-9959-ac7ed671f685 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:20.006703 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780d7b89-094c-4f28-9959-ac7ed671f685 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:20.016144 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 421/838] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 26 05:31:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:20.019480 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:20.024839 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d7b89-094c-4f28-9959-ac7ed671f685 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:20.046728 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893fff0-7c64-41af-8735-e932bcb96bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:20.047386 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893fff0-7c64-41af-8735-e932bcb96bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:20.048175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893fff0-7c64-41af-8735-e932bcb96bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:20.048448 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893fff0-7c64-41af-8735-e932bcb96bf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:20.067571 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893fff0-7c64-41af-8735-e932bcb96bf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:20.070198 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893fff0-7c64-41af-8735-e932bcb96bf5 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:20.096189 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-3893fff0-7c64-41af-8735-e932bcb96bf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:20.096189 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:20.096189 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:20.096189 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:20.096189 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:20.096189 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:20.096189 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:20.096189 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:20.096189 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:20.096189 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:20.096189 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:20.096189 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:20.096189 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:31:20.096189 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:31:20.096189 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:31:20.096189 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:31:20.098040 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:20.098040 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:20.098040 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:20.098040 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:20.098040 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:20.098040 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:20.098040 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:20.098040 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:20.098040 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:20.098040 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:20.098040 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:20.098040 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:20.098040 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:20.098040 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:20.098040 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:20.098040 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:20.098040 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:31:20.108194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:31:20.108194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:20.108194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:20.108194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 418/839] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:20.108194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893fff0-7c64-41af-8735-e932bcb96bf5 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:20.158915 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:20.203559 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d7b89-094c-4f28-9959-ac7ed671f685 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:20.260000 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a93068-ce4d-4fa3-b80b-db5f563840a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:20.260678 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a93068-ce4d-4fa3-b80b-db5f563840a5 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:20.260997 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a93068-ce4d-4fa3-b80b-db5f563840a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:20.261231 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a93068-ce4d-4fa3-b80b-db5f563840a5 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:20.261985 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a93068-ce4d-4fa3-b80b-db5f563840a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:20.262496 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a93068-ce4d-4fa3-b80b-db5f563840a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:20.265533 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a93068-ce4d-4fa3-b80b-db5f563840a5 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:20.280005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893fff0-7c64-41af-8735-e932bcb96bf5 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:20.297011 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 422/840] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:31:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:20.298283 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a93068-ce4d-4fa3-b80b-db5f563840a5 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:20.351722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d50cf8-4d50-4cd0-b01a-26b26b94f526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:20.352793 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d50cf8-4d50-4cd0-b01a-26b26b94f526 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:20.353281 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d50cf8-4d50-4cd0-b01a-26b26b94f526 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:20.353753 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d50cf8-4d50-4cd0-b01a-26b26b94f526 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:20.354909 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d50cf8-4d50-4cd0-b01a-26b26b94f526 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:20.355451 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d50cf8-4d50-4cd0-b01a-26b26b94f526 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:20.358238 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d50cf8-4d50-4cd0-b01a-26b26b94f526 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:20.380284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 419/841] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 26 05:31:20 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:20.380284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d50cf8-4d50-4cd0-b01a-26b26b94f526 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:20.453748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:20.564279 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a93068-ce4d-4fa3-b80b-db5f563840a5 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:20.613358 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d50cf8-4d50-4cd0-b01a-26b26b94f526 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:20.641419 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:20.647936 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f3b07-1a46-481a-b906-e51f9bf701f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:20.648570 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f3b07-1a46-481a-b906-e51f9bf701f9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:20.648844 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f3b07-1a46-481a-b906-e51f9bf701f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:20.649112 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f3b07-1a46-481a-b906-e51f9bf701f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:20.649761 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f3b07-1a46-481a-b906-e51f9bf701f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:20.650060 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f3b07-1a46-481a-b906-e51f9bf701f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:20.651489 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f3b07-1a46-481a-b906-e51f9bf701f9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:20.666964 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0ab8c6-5484-4097-aa3d-ef9d8b7494ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:20.667292 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 423/842] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:20.673171 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ab8c6-5484-4097-aa3d-ef9d8b7494ce None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:20.673171 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ab8c6-5484-4097-aa3d-ef9d8b7494ce None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:20.673171 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0ab8c6-5484-4097-aa3d-ef9d8b7494ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:20.673171 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ab8c6-5484-4097-aa3d-ef9d8b7494ce None admin] RBAC: Adding query filter params (role.id=cf58d66369044fb09fa65a4366dc7446, scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8, user.id=c559a36836be411b9afd076f4c9a0655) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:20.673171 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ab8c6-5484-4097-aa3d-ef9d8b7494ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:20.673884 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7f1b3-c7bf-4731-a53c-7715ea6c2062 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:20.673884 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7f1b3-c7bf-4731-a53c-7715ea6c2062 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:20.673884 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7f1b3-c7bf-4731-a53c-7715ea6c2062 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:20.674239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0ab8c6-5484-4097-aa3d-ef9d8b7494ce None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:20.674619 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 424/843] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:20.680279 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7f1b3-c7bf-4731-a53c-7715ea6c2062 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:20.687482 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 420/844] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:31:20 2022] GET /identity/v3/role_assignments?user.id=c559a36836be411b9afd076f4c9a0655&scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8&role.id=cf58d66369044fb09fa65a4366dc7446 => generated 608 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:20.689902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558657c-47b1-4ac0-9996-448cc097f09c None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:20.690334 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558657c-47b1-4ac0-9996-448cc097f09c None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:20.690793 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558657c-47b1-4ac0-9996-448cc097f09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:20.728228 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-6558657c-47b1-4ac0-9996-448cc097f09c None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:20.729864 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-6558657c-47b1-4ac0-9996-448cc097f09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:20.840533 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 421/845] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:31:20.892549 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7f1b3-c7bf-4731-a53c-7715ea6c2062 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:20.940379 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b322f6-a8da-439f-9d8a-56868095df2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:20.941076 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b322f6-a8da-439f-9d8a-56868095df2a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:20.941355 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b322f6-a8da-439f-9d8a-56868095df2a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:20.941626 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b322f6-a8da-439f-9d8a-56868095df2a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:20.951709 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b322f6-a8da-439f-9d8a-56868095df2a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:20.953703 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b322f6-a8da-439f-9d8a-56868095df2a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:20.968100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-14b322f6-a8da-439f-9d8a-56868095df2a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 05:31:20.968100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:20.968100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:20.968100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:20.968100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:20.968100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:20.968100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:20.968100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:20.968100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:20.968100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:20.968100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:20.968100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:20.968100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:31:20.968100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:31:20.968100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:31:20.968100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:31:20.969153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:20.969153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:20.969153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:31:20.969153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:31:20.969153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:31:20.969153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:31:20.969153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:20.969153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:20.969153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:20.969153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:20.969153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:20.969153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:20.969153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:20.969153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:20.969153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:20.969153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:20.969153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:20.969153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:20.970126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:20.970126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:20.970126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:31:20.970126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:31:20.970126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:31:20.970126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:31:20.970126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:31:20.970126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:31:20.970126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 05:31:20.970126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:20.970126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 425/846] 10.222.0.66 () {56 vars in 1117 bytes} [Mon Sep 26 05:31:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:20.979458 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558657c-47b1-4ac0-9996-448cc097f09c None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:21.034896 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:21.121819 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b322f6-a8da-439f-9d8a-56868095df2a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:21.192358 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558657c-47b1-4ac0-9996-448cc097f09c None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:21.193771 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:21.278641 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44fce5-53d5-49e7-99e9-384b151f31ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:21.279709 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44fce5-53d5-49e7-99e9-384b151f31ab None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:21.280877 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44fce5-53d5-49e7-99e9-384b151f31ab None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:21.281377 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a44fce5-53d5-49e7-99e9-384b151f31ab None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:21.283133 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44fce5-53d5-49e7-99e9-384b151f31ab None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:21.283673 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44fce5-53d5-49e7-99e9-384b151f31ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:21.287484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a44fce5-53d5-49e7-99e9-384b151f31ab None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:21.292006 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b322f6-a8da-439f-9d8a-56868095df2a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:21.331900 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 422/847] 10.222.0.66 () {56 vars in 1149 bytes} [Mon Sep 26 05:31:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:21.340322 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44fce5-53d5-49e7-99e9-384b151f31ab None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:21.376934 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33dad6f-5cff-418b-a588-bf3aad810834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:21.378127 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dad6f-5cff-418b-a588-bf3aad810834 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:21.378731 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dad6f-5cff-418b-a588-bf3aad810834 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:21.379393 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dad6f-5cff-418b-a588-bf3aad810834 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:21.400020 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33dad6f-5cff-418b-a588-bf3aad810834 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:31:21.411112 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-c33dad6f-5cff-418b-a588-bf3aad810834 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:31:21.411112 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:21.411112 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:21.411112 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:21.411112 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:21.411112 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:21.411112 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:21.411112 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:21.411112 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:21.411112 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:21.411112 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:21.411112 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:21.411112 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:31:21.411112 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:31:21.411112 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:31:21.411112 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:31:21.412937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:31:21.412937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:31:21.412937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:31:21.412937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:31:21.412937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:21.412937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:21.412937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:21.412937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:21.412937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:21.412937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:21.412937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:21.412937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:21.412937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:21.412937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:21.412937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:21.412937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:21.414684 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:21.414684 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:21.414684 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:21.414684 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:21.414684 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:31:21.414684 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:31:21.414684 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:31:21.414684 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:31:21.414684 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:31:21.414684 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:31:21.414684 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:31:21.414684 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:21.421442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 426/848] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:31:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:21.422526 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33dad6f-5cff-418b-a588-bf3aad810834 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:21.523859 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:21.553889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a44fce5-53d5-49e7-99e9-384b151f31ab None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:21.615899 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d132d-bd76-4440-8882-cba16955f28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:21.616933 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d132d-bd76-4440-8882-cba16955f28c None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:21.617370 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d132d-bd76-4440-8882-cba16955f28c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:21.617817 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d132d-bd76-4440-8882-cba16955f28c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:21.628586 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33dad6f-5cff-418b-a588-bf3aad810834 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:21.655583 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:21.698048 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac06ff4-9452-4dff-8a9c-84597d9ad47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:21.699531 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac06ff4-9452-4dff-8a9c-84597d9ad47c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:21.700286 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac06ff4-9452-4dff-8a9c-84597d9ad47c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:21.701129 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac06ff4-9452-4dff-8a9c-84597d9ad47c None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:21.703058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac06ff4-9452-4dff-8a9c-84597d9ad47c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:21.703897 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac06ff4-9452-4dff-8a9c-84597d9ad47c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:21.706955 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac06ff4-9452-4dff-8a9c-84597d9ad47c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:21.735695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 427/849] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:31:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:21.740102 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac06ff4-9452-4dff-8a9c-84597d9ad47c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:21.747341 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d132d-bd76-4440-8882-cba16955f28c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:21.750146 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d132d-bd76-4440-8882-cba16955f28c None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:21.911629 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:21.941753 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 423/850] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:31:21 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:31:21.950365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d132d-bd76-4440-8882-cba16955f28c None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:21.961080 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac06ff4-9452-4dff-8a9c-84597d9ad47c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:22.026086 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e1014-873d-4d33-b8e6-47c9be569865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:22.027835 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e1014-873d-4d33-b8e6-47c9be569865 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:22.028503 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e1014-873d-4d33-b8e6-47c9be569865 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:22.029169 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e1014-873d-4d33-b8e6-47c9be569865 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:22.051256 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e1014-873d-4d33-b8e6-47c9be569865 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:22.054011 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e1014-873d-4d33-b8e6-47c9be569865 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:22.079769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-f82e1014-873d-4d33-b8e6-47c9be569865 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:22.079769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:22.079769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:22.079769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:22.079769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:22.079769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:22.079769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:22.079769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:22.079769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:22.079769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:22.079769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:22.079769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:22.079769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:31:22.079769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:31:22.079769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:31:22.079769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:31:22.080821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:22.080821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:22.080821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:22.080821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:22.080821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:22.080821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:22.080821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:22.080821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:22.080821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:22.080821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:22.080821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:22.080821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:22.080821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:22.080821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:22.080821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:22.080821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:22.080821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:31:22.082289 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:31:22.082289 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:22.082289 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:22.082289 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 428/851] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:22.090656 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e1014-873d-4d33-b8e6-47c9be569865 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:22.123483 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d132d-bd76-4440-8882-cba16955f28c None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:22.141736 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:22.172449 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2cf2a-850c-4dde-b2c2-eb3e3b352180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:22.172987 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2cf2a-850c-4dde-b2c2-eb3e3b352180 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:22.173256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2cf2a-850c-4dde-b2c2-eb3e3b352180 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:22.173520 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2cf2a-850c-4dde-b2c2-eb3e3b352180 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:22.186285 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2cf2a-850c-4dde-b2c2-eb3e3b352180 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:22.188088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2cf2a-850c-4dde-b2c2-eb3e3b352180 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:22.210586 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-3ee2cf2a-850c-4dde-b2c2-eb3e3b352180 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:22.210586 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:22.210586 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:22.210586 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:22.210586 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:22.210586 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:22.210586 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:22.210586 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:22.210586 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:22.210586 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:22.210586 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:22.210586 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:22.210586 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:31:22.210586 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:31:22.210586 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:31:22.210586 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:31:22.212651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:22.212651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:22.212651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:22.212651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:22.212651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:22.212651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:22.212651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:22.212651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:22.212651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:22.212651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:22.212651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:22.212651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:22.212651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:22.212651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:22.212651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:22.212651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:22.212651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:31:22.214399 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:31:22.214399 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:22.214399 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:22.214399 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 424/852] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:22.223290 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2cf2a-850c-4dde-b2c2-eb3e3b352180 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:22.268051 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:22.289846 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e1014-873d-4d33-b8e6-47c9be569865 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:22.332037 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186ec30-3e7b-4135-bb69-98e449cd766c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:22.333166 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186ec30-3e7b-4135-bb69-98e449cd766c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:22.333705 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186ec30-3e7b-4135-bb69-98e449cd766c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:22.334306 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186ec30-3e7b-4135-bb69-98e449cd766c None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:22.335562 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186ec30-3e7b-4135-bb69-98e449cd766c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:22.336140 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186ec30-3e7b-4135-bb69-98e449cd766c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:22.337757 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186ec30-3e7b-4135-bb69-98e449cd766c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:22.358401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 429/853] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:31:22.359891 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186ec30-3e7b-4135-bb69-98e449cd766c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:22.389757 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2cf2a-850c-4dde-b2c2-eb3e3b352180 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:22.451525 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650d8af-46f6-4e12-b79b-32a417199f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:22.452856 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650d8af-46f6-4e12-b79b-32a417199f70 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:22.453332 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650d8af-46f6-4e12-b79b-32a417199f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:22.453792 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650d8af-46f6-4e12-b79b-32a417199f70 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:22.455030 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650d8af-46f6-4e12-b79b-32a417199f70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:22.455559 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650d8af-46f6-4e12-b79b-32a417199f70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:22.458177 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650d8af-46f6-4e12-b79b-32a417199f70 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:22.464701 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:22.483983 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186ec30-3e7b-4135-bb69-98e449cd766c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:22.490295 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 425/854] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:22.492489 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650d8af-46f6-4e12-b79b-32a417199f70 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:22.526310 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1454da7-f486-4fdb-86b3-1fcd96562273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:22.527842 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1454da7-f486-4fdb-86b3-1fcd96562273 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:22.528831 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1454da7-f486-4fdb-86b3-1fcd96562273 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:22.529320 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1454da7-f486-4fdb-86b3-1fcd96562273 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:22.538914 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1454da7-f486-4fdb-86b3-1fcd96562273 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:22.541224 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1454da7-f486-4fdb-86b3-1fcd96562273 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:22.557816 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-b1454da7-f486-4fdb-86b3-1fcd96562273 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 26 05:31:22.557816 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:22.557816 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:22.557816 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:22.557816 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:22.557816 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:22.557816 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:22.557816 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:22.557816 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:22.557816 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:22.557816 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:22.557816 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:22.557816 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:31:22.557816 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:31:22.557816 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:31:22.557816 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:31:22.558948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:22.558948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:22.558948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:31:22.558948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:31:22.558948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:31:22.558948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:31:22.558948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:22.558948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:22.558948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:22.558948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:22.558948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:22.558948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:22.558948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:22.558948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:22.558948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:22.558948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:22.558948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:22.558948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:22.559942 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:22.559942 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:22.559942 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:31:22.559942 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:31:22.559942 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:31:22.559942 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:31:22.559942 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:31:22.559942 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:31:22.559942 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 26 05:31:22.559942 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:22.567093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 430/855] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:31:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:22.569289 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1454da7-f486-4fdb-86b3-1fcd96562273 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:22.671696 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:22.682224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650d8af-46f6-4e12-b79b-32a417199f70 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:22.701164 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1454da7-f486-4fdb-86b3-1fcd96562273 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:22.756000 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e97df6c-933e-4fbe-8a20-7480c018125f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:22.757414 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97df6c-933e-4fbe-8a20-7480c018125f None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:22.757767 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97df6c-933e-4fbe-8a20-7480c018125f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:22.758297 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e97df6c-933e-4fbe-8a20-7480c018125f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:22.768197 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58708edf-b142-4fbe-bb84-317abce75eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:22.769614 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58708edf-b142-4fbe-bb84-317abce75eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:22.770183 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58708edf-b142-4fbe-bb84-317abce75eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:22.770456 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e97df6c-933e-4fbe-8a20-7480c018125f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:22.771028 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58708edf-b142-4fbe-bb84-317abce75eb8 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:22.772136 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58708edf-b142-4fbe-bb84-317abce75eb8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:22.772802 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58708edf-b142-4fbe-bb84-317abce75eb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:22.773309 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e97df6c-933e-4fbe-8a20-7480c018125f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:22.774936 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58708edf-b142-4fbe-bb84-317abce75eb8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:22.794905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-4e97df6c-933e-4fbe-8a20-7480c018125f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:31:22.794905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:22.794905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:22.794905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:22.794905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:22.794905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:22.794905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:22.794905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:22.794905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:22.794905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:22.794905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:22.794905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:22.794905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:31:22.794905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:31:22.794905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:31:22.795958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:31:22.795958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:22.795958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:22.795958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:22.795958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:22.795958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:22.795958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:22.795958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:22.795958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:22.795958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:22.795958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:22.795958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:22.795958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:22.795958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:22.795958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:22.795958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:22.795958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:22.796838 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:31:22.796838 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:31:22.796838 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:31:22.796838 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:31:22.796838 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:31:22.796838 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:31:22.796838 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:31:22.796838 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:22.802017 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 431/857] 10.222.0.66 () {56 vars in 1135 bytes} [Mon Sep 26 05:31:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:22.807582 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 426/857] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:31:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:31:22.807582 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e97df6c-933e-4fbe-8a20-7480c018125f None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:22.809341 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58708edf-b142-4fbe-bb84-317abce75eb8 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:22.815536 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:22.952741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58708edf-b142-4fbe-bb84-317abce75eb8 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:22.984931 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e97df6c-933e-4fbe-8a20-7480c018125f None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:23.032299 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2acda-fbfd-432c-999c-32bffee71c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:23.033296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2acda-fbfd-432c-999c-32bffee71c5c None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:23.033700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2acda-fbfd-432c-999c-32bffee71c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:23.034150 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2acda-fbfd-432c-999c-32bffee71c5c None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:23.034927 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2acda-fbfd-432c-999c-32bffee71c5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:23.035293 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2acda-fbfd-432c-999c-32bffee71c5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:23.037255 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2acda-fbfd-432c-999c-32bffee71c5c None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:23.040622 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143f194-b954-41f3-a4d3-37407c0f8ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:23.041386 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143f194-b954-41f3-a4d3-37407c0f8ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:23.041667 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143f194-b954-41f3-a4d3-37407c0f8ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:23.041946 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143f194-b954-41f3-a4d3-37407c0f8ff6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:23.057313 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 427/858] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:31:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:23.058835 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6beda-553d-4d2e-8390-3dbb7844a18e None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:23.059113 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6beda-553d-4d2e-8390-3dbb7844a18e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:23.059357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6beda-553d-4d2e-8390-3dbb7844a18e None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:23.060944 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 428/859] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:23.066973 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a12017-0973-4728-be03-05d8f82aa0ae None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:23.066973 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a12017-0973-4728-be03-05d8f82aa0ae None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:23.067339 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a12017-0973-4728-be03-05d8f82aa0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:23.089450 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-55a12017-0973-4728-be03-05d8f82aa0ae None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:23.090663 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-55a12017-0973-4728-be03-05d8f82aa0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:23.105961 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:23.134274 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143f194-b954-41f3-a4d3-37407c0f8ff6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:23.135783 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143f194-b954-41f3-a4d3-37407c0f8ff6 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:23.140127 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:23.184912 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 429/860] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:31:23.186516 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a12017-0973-4728-be03-05d8f82aa0ae None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:23.297468 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 432/861] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:31:22 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:31:23.306400 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143f194-b954-41f3-a4d3-37407c0f8ff6 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:23.355913 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a12017-0973-4728-be03-05d8f82aa0ae None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:23.397471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d63b7-993c-407f-af3d-580482cbf4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:23.398832 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d63b7-993c-407f-af3d-580482cbf4e3 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:23.399139 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d63b7-993c-407f-af3d-580482cbf4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:23.399375 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d63b7-993c-407f-af3d-580482cbf4e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:23.400287 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d63b7-993c-407f-af3d-580482cbf4e3 None admin] RBAC: Adding query filter params (role.id=024a61996071437aa07a3faf2bb5ae69, scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8, user.id=5bdaf32400b94aa291ad43a3131e1d0a) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:23.400594 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d63b7-993c-407f-af3d-580482cbf4e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:23.402084 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d63b7-993c-407f-af3d-580482cbf4e3 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:23.416274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 430/862] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:31:23 2022] GET /identity/v3/role_assignments?user.id=5bdaf32400b94aa291ad43a3131e1d0a&scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8&role.id=024a61996071437aa07a3faf2bb5ae69 => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:23.418776 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691bc91-e899-4052-b31b-f7a419acbffe None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:23.419269 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691bc91-e899-4052-b31b-f7a419acbffe None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:23.419773 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691bc91-e899-4052-b31b-f7a419acbffe None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:23.423106 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 431/863] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:23.432064 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe1f76-8d82-496b-b74a-d4bb62d481cc None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:23.432381 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe1f76-8d82-496b-b74a-d4bb62d481cc None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:23.432697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe1f76-8d82-496b-b74a-d4bb62d481cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:23.443446 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143f194-b954-41f3-a4d3-37407c0f8ff6 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:23.448146 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:23.455349 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-03fe1f76-8d82-496b-b74a-d4bb62d481cc None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:23.457075 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-03fe1f76-8d82-496b-b74a-d4bb62d481cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:23.461672 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:23.492753 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c9c10-f384-4c96-bc06-2c6dfba5ddd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:23.493972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c9c10-f384-4c96-bc06-2c6dfba5ddd1 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:23.494529 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c9c10-f384-4c96-bc06-2c6dfba5ddd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:23.494804 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c9c10-f384-4c96-bc06-2c6dfba5ddd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:23.512690 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c9c10-f384-4c96-bc06-2c6dfba5ddd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:23.515249 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c9c10-f384-4c96-bc06-2c6dfba5ddd1 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:23.542091 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-142c9c10-f384-4c96-bc06-2c6dfba5ddd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:23.542091 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:23.542091 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:23.542091 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:23.542091 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:23.542091 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:23.542091 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:23.542091 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:23.542091 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:23.542091 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:23.542091 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:23.542091 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:23.542091 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:31:23.542091 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:31:23.542091 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:31:23.542091 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:31:23.543411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:23.543411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:23.543411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:23.543411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:23.543411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:23.543411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:23.543411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:23.543411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:23.543411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:23.543411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:23.543411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:23.543411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:23.543411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:23.543411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:23.543411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:23.543411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:23.543411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:31:23.544348 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:31:23.544348 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:23.544348 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:23.550927 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 433/864] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:23.552337 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c9c10-f384-4c96-bc06-2c6dfba5ddd1 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:23.563962 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 432/865] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:23 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:31:23.565637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe1f76-8d82-496b-b74a-d4bb62d481cc None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:23.736455 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe1f76-8d82-496b-b74a-d4bb62d481cc None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:23.738498 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c9c10-f384-4c96-bc06-2c6dfba5ddd1 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:23.780076 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6a6af-58ae-494b-889d-b07ba497b687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:23.780733 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6a6af-58ae-494b-889d-b07ba497b687 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:23.781011 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6a6af-58ae-494b-889d-b07ba497b687 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:23.781285 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6a6af-58ae-494b-889d-b07ba497b687 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:23.781946 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e6a6af-58ae-494b-889d-b07ba497b687 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:23.783414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e6a6af-58ae-494b-889d-b07ba497b687 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:23.792272 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc96e7-0aca-42cc-b9d4-71a783b99190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:23.793387 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-43e6a6af-58ae-494b-889d-b07ba497b687 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 05:31:23.793387 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:23.793387 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:31:23.793387 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:31:23.793387 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:31:23.793387 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:31:23.793387 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:31:23.793387 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:23.793387 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 05:31:23.793387 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:23.793387 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:31:23.793387 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:23.793387 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:23.793387 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:23.793387 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:23.793387 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:23.795056 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:23.795056 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:23.795056 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:23.795056 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:23.795056 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:23.795056 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:23.795056 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:23.795056 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:31:23.795056 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:31:23.795056 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:31:23.795056 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:31:23.795056 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:23.795056 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:23.795056 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:23.795056 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:23.795056 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:23.795056 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:23.796659 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:23.796659 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:23.796659 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:23.796659 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:23.796659 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:23.796659 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:23.796659 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:23.796659 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:23.796659 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:23.796659 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:23.796659 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:31:23.796659 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:23.796659 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 05:31:23.796659 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:23.796659 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 434/866] 10.222.0.66 () {56 vars in 1132 bytes} [Mon Sep 26 05:31:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:23.798639 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc96e7-0aca-42cc-b9d4-71a783b99190 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:23.799085 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc96e7-0aca-42cc-b9d4-71a783b99190 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:23.799612 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc96e7-0aca-42cc-b9d4-71a783b99190 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:23.800646 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc96e7-0aca-42cc-b9d4-71a783b99190 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:23.800831 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6a6af-58ae-494b-889d-b07ba497b687 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:23.801622 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc96e7-0aca-42cc-b9d4-71a783b99190 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:23.804839 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dc96e7-0aca-42cc-b9d4-71a783b99190 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:23.825949 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:23.829169 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:23.839876 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 433/867] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:23.847631 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc96e7-0aca-42cc-b9d4-71a783b99190 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:23.945498 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6a6af-58ae-494b-889d-b07ba497b687 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:23.982412 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc96e7-0aca-42cc-b9d4-71a783b99190 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:23.995560 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fdc199-e296-4a83-a429-700c5cece4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:23.996558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdc199-e296-4a83-a429-700c5cece4b0 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:23.996989 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdc199-e296-4a83-a429-700c5cece4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:23.997401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdc199-e296-4a83-a429-700c5cece4b0 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:23.998173 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fdc199-e296-4a83-a429-700c5cece4b0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:23.998701 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fdc199-e296-4a83-a429-700c5cece4b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:24.001050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fdc199-e296-4a83-a429-700c5cece4b0 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:24.009588 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 435/868] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Sep 26 05:31:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:31:24.010677 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fdc199-e296-4a83-a429-700c5cece4b0 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:24.030452 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13097bb9-12f7-417a-8f8d-c182fef5452c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:24.031224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13097bb9-12f7-417a-8f8d-c182fef5452c None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:24.031647 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13097bb9-12f7-417a-8f8d-c182fef5452c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:24.031930 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13097bb9-12f7-417a-8f8d-c182fef5452c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:24.041170 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13097bb9-12f7-417a-8f8d-c182fef5452c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:24.042702 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13097bb9-12f7-417a-8f8d-c182fef5452c None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:24.056651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-13097bb9-12f7-417a-8f8d-c182fef5452c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:31:24.056651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:24.056651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:24.056651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:24.056651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:24.056651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:24.056651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:24.056651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:24.056651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:24.056651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:24.056651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:24.056651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:24.056651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:31:24.056651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:31:24.056651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:31:24.058296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:31:24.058296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:24.058296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:24.058296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:24.058296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:24.058296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:24.058296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:24.058296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:24.058296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:24.058296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:24.058296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:24.058296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:24.058296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:24.058296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:24.058296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:24.058296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:24.058296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:24.059997 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:31:24.059997 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:31:24.059997 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:31:24.059997 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:31:24.059997 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:31:24.059997 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:31:24.059997 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:31:24.059997 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:24.059997 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 434/869] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:31:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:24.059997 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13097bb9-12f7-417a-8f8d-c182fef5452c None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:24.136050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:24.157581 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fdc199-e296-4a83-a429-700c5cece4b0 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:24.162181 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:24.222102 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a93110-c6bb-4580-81fd-6f4a7b0ad3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:24.222723 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a93110-c6bb-4580-81fd-6f4a7b0ad3c9 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:24.223005 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a93110-c6bb-4580-81fd-6f4a7b0ad3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:24.223274 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a93110-c6bb-4580-81fd-6f4a7b0ad3c9 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:24.224076 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a93110-c6bb-4580-81fd-6f4a7b0ad3c9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:24.225740 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a93110-c6bb-4580-81fd-6f4a7b0ad3c9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:24.236308 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13097bb9-12f7-417a-8f8d-c182fef5452c None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:24.247890 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 436/870] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Sep 26 05:31:24 2022] POST /identity/v3/services => generated 251 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:31:24.247890 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a93110-c6bb-4580-81fd-6f4a7b0ad3c9 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:24.300800 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cc097-8fb7-41b2-852b-689204813dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:24.302333 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cc097-8fb7-41b2-852b-689204813dfe None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:24.302622 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cc097-8fb7-41b2-852b-689204813dfe None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:24.302866 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cc097-8fb7-41b2-852b-689204813dfe None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:24.303550 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1cc097-8fb7-41b2-852b-689204813dfe None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:24.303940 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1cc097-8fb7-41b2-852b-689204813dfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:24.305372 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1cc097-8fb7-41b2-852b-689204813dfe None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:24.322119 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 435/871] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Sep 26 05:31:24 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:24.445915 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a93110-c6bb-4580-81fd-6f4a7b0ad3c9 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:24.513926 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77189f10-b697-455c-b557-5fb62bb61ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:24.514786 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77189f10-b697-455c-b557-5fb62bb61ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:24.515264 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77189f10-b697-455c-b557-5fb62bb61ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:24.515721 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77189f10-b697-455c-b557-5fb62bb61ad6 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:24.517155 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77189f10-b697-455c-b557-5fb62bb61ad6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:24.517705 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77189f10-b697-455c-b557-5fb62bb61ad6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:24.520360 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77189f10-b697-455c-b557-5fb62bb61ad6 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:24.539629 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 437/872] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:31:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:24.546755 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cc097-8fb7-41b2-852b-689204813dfe None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:24.661345 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cc097-8fb7-41b2-852b-689204813dfe None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:24.683321 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:24.699786 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb00a0-23fb-43f5-9837-74f016abc6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:24.700419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb00a0-23fb-43f5-9837-74f016abc6dc None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:24.700699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb00a0-23fb-43f5-9837-74f016abc6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:24.700976 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb00a0-23fb-43f5-9837-74f016abc6dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:24.701723 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb00a0-23fb-43f5-9837-74f016abc6dc None admin] RBAC: Adding query filter params (role.id=cf58d66369044fb09fa65a4366dc7446, scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8, user.id=830cd52ac42548b2ade17b5215aefd28) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:24.702390 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb00a0-23fb-43f5-9837-74f016abc6dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:24.703881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb00a0-23fb-43f5-9837-74f016abc6dc None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:24.711150 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 436/873] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:31:24 2022] GET /identity/v3/role_assignments?user.id=830cd52ac42548b2ade17b5215aefd28&scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8&role.id=cf58d66369044fb09fa65a4366dc7446 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:31:25.973698 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d644a-122d-4db4-bb91-a4c56803b4af None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:25.974624 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d644a-122d-4db4-bb91-a4c56803b4af None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:25.974624 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d644a-122d-4db4-bb91-a4c56803b4af None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:25.975896 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 438/874] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:31:25.981927 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8160fb-a44c-4720-8f75-d1e3d26047eb None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:25.982877 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8160fb-a44c-4720-8f75-d1e3d26047eb None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:25.982877 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8160fb-a44c-4720-8f75-d1e3d26047eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:26.002304 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-ab8160fb-a44c-4720-8f75-d1e3d26047eb None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:26.003538 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ab8160fb-a44c-4720-8f75-d1e3d26047eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:26.084412 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 437/875] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:25 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 05:31:26.351051 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d644a-122d-4db4-bb91-a4c56803b4af None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:26.355167 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:26.459119 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d644a-122d-4db4-bb91-a4c56803b4af None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:26.494397 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a330034-268c-4874-9bf8-d662e6aedbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:26.495294 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a330034-268c-4874-9bf8-d662e6aedbd6 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:26.495709 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a330034-268c-4874-9bf8-d662e6aedbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:26.496159 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a330034-268c-4874-9bf8-d662e6aedbd6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:26.508719 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a330034-268c-4874-9bf8-d662e6aedbd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:31:26.514016 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-8a330034-268c-4874-9bf8-d662e6aedbd6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 05:31:26.514016 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:26.514016 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:26.514016 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:26.514016 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:26.514016 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:26.514016 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:26.514016 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:26.514016 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:26.514016 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:26.514016 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:26.514016 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:26.514016 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:31:26.514016 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:31:26.514016 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:31:26.514016 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:31:26.515232 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:31:26.515232 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:31:26.515232 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:31:26.515232 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:31:26.515232 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:26.515232 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:26.515232 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:26.515232 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:26.515232 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:26.515232 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:26.515232 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:26.515232 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:26.515232 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:26.515232 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:26.515232 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:26.515232 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:26.516290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:26.516290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:26.516290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:26.516290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:26.516290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:31:26.516290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:31:26.516290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:31:26.516290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:31:26.516290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:31:26.516290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:31:26.516290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 05:31:26.516290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:26.518952 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 439/876] 10.222.0.66 () {56 vars in 1120 bytes} [Mon Sep 26 05:31:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:26.527804 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8160fb-a44c-4720-8f75-d1e3d26047eb None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:26.634460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8160fb-a44c-4720-8f75-d1e3d26047eb None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:26.650326 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:26.670619 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0e492-d9a8-492e-8fbf-d881e2e4de06 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:26.670895 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0e492-d9a8-492e-8fbf-d881e2e4de06 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:26.671166 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0e492-d9a8-492e-8fbf-d881e2e4de06 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:26.673360 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 440/877] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:31:26.675061 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a3732-8e76-41bf-bf1c-4954da619083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:26.675683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a3732-8e76-41bf-bf1c-4954da619083 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:26.676000 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a3732-8e76-41bf-bf1c-4954da619083 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:26.676267 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a3732-8e76-41bf-bf1c-4954da619083 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:26.676934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a3732-8e76-41bf-bf1c-4954da619083 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:26.677229 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a3732-8e76-41bf-bf1c-4954da619083 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:26.678914 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae51c5e-3eea-417a-8aec-79b5c61f424e None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:26.679095 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a3732-8e76-41bf-bf1c-4954da619083 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:26.679245 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae51c5e-3eea-417a-8aec-79b5c61f424e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:26.679456 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae51c5e-3eea-417a-8aec-79b5c61f424e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:26.690535 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 438/878] 10.222.0.66 () {56 vars in 1115 bytes} [Mon Sep 26 05:31:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:26.696441 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a3732-8e76-41bf-bf1c-4954da619083 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:26.700012 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-3ae51c5e-3eea-417a-8aec-79b5c61f424e None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:26.703627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3ae51c5e-3eea-417a-8aec-79b5c61f424e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:26.781706 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:26.793417 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 441/879] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:26 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 05:31:26.824576 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a3732-8e76-41bf-bf1c-4954da619083 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:26.865064 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd8a31-8708-423b-af36-e536ead24c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:26.865718 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd8a31-8708-423b-af36-e536ead24c9a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:26.865991 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd8a31-8708-423b-af36-e536ead24c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:26.866296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd8a31-8708-423b-af36-e536ead24c9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:26.882041 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd8a31-8708-423b-af36-e536ead24c9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:26.884963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd8a31-8708-423b-af36-e536ead24c9a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:26.909285 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-dffd8a31-8708-423b-af36-e536ead24c9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:26.909285 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:26.909285 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:26.909285 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:26.909285 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:26.909285 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:26.909285 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:26.909285 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:26.909285 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:26.909285 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:26.909285 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:26.909285 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:26.909285 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:31:26.909285 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:31:26.909285 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:31:26.909285 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:31:26.910318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:26.910318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:26.910318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:26.910318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:26.910318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:26.910318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:26.910318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:26.910318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:26.910318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:26.910318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:26.910318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:26.910318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:26.910318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:26.910318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:26.910318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:26.910318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:26.910318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:31:26.911983 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:31:26.911983 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:26.911983 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:26.911983 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 439/880] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:31:26.916681 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae51c5e-3eea-417a-8aec-79b5c61f424e None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:27.008331 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e7edb-9a1b-4ac3-b70d-6716a00918c2 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:27.008962 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e7edb-9a1b-4ac3-b70d-6716a00918c2 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:27.009100 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e7edb-9a1b-4ac3-b70d-6716a00918c2 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:27.011279 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 440/881] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:31:27.018167 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fc79d-3c8d-4049-9ba9-d7a10a7f7186 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:27.018601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fc79d-3c8d-4049-9ba9-d7a10a7f7186 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:27.018974 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7fc79d-3c8d-4049-9ba9-d7a10a7f7186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:27.035831 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae51c5e-3eea-417a-8aec-79b5c61f424e None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:27.041858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-9a7fc79d-3c8d-4049-9ba9-d7a10a7f7186 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:27.043313 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-9a7fc79d-3c8d-4049-9ba9-d7a10a7f7186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:27.072759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:27.074087 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16efba93-6659-4028-86e3-c2395d9f2952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:27.074679 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efba93-6659-4028-86e3-c2395d9f2952 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:27.074950 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efba93-6659-4028-86e3-c2395d9f2952 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:27.075213 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16efba93-6659-4028-86e3-c2395d9f2952 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:27.075883 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16efba93-6659-4028-86e3-c2395d9f2952 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:27.076182 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16efba93-6659-4028-86e3-c2395d9f2952 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:27.077926 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16efba93-6659-4028-86e3-c2395d9f2952 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:27.090284 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 442/882] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:27.096776 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16efba93-6659-4028-86e3-c2395d9f2952 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:27.124330 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 441/883] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:27 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:31:27.125544 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7fc79d-3c8d-4049-9ba9-d7a10a7f7186 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:27.177488 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:27.252212 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16efba93-6659-4028-86e3-c2395d9f2952 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:27.266143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7fc79d-3c8d-4049-9ba9-d7a10a7f7186 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:27.296677 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f60b8-32bf-4a34-8f83-4ea7ac096382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:27.298062 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f60b8-32bf-4a34-8f83-4ea7ac096382 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:27.298589 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f60b8-32bf-4a34-8f83-4ea7ac096382 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:27.299104 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f60b8-32bf-4a34-8f83-4ea7ac096382 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:27.305289 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f51c6a-e02b-4dec-baba-dd6ab2dd1132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:27.306368 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f51c6a-e02b-4dec-baba-dd6ab2dd1132 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:27.306773 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f51c6a-e02b-4dec-baba-dd6ab2dd1132 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:27.307195 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f51c6a-e02b-4dec-baba-dd6ab2dd1132 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:27.308263 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f51c6a-e02b-4dec-baba-dd6ab2dd1132 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:27.309449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f60b8-32bf-4a34-8f83-4ea7ac096382 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:27.310720 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f51c6a-e02b-4dec-baba-dd6ab2dd1132 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:27.311407 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f60b8-32bf-4a34-8f83-4ea7ac096382 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:27.324639 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-091f60b8-32bf-4a34-8f83-4ea7ac096382 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 05:31:27.324639 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:27.324639 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:27.324639 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:27.324639 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:27.324639 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:27.324639 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:27.324639 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:27.324639 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:27.324639 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:27.324639 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:27.324639 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:27.324639 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:31:27.324639 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:31:27.324639 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:31:27.324639 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:31:27.325696 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:27.325696 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:27.325696 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:31:27.325696 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:31:27.325696 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:31:27.325696 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:31:27.325696 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:27.325696 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:27.325696 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:27.325696 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:27.325696 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:27.325696 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:27.325696 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:27.325696 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:27.325696 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:27.325696 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:27.325696 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:27.325696 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:27.326686 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:27.326686 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:27.326686 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:31:27.326686 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:31:27.326686 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:31:27.326686 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:31:27.326686 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:31:27.326686 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:31:27.326686 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 05:31:27.326686 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:27.329205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-93f51c6a-e02b-4dec-baba-dd6ab2dd1132 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 05:31:27.329205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:27.329205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:31:27.329205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:31:27.329205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:31:27.329205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:31:27.329205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:31:27.329205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:27.329205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 05:31:27.329205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:27.329205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:31:27.329205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:27.329205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:27.329205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:27.329205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:27.329205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:27.329205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:27.330208 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:27.330208 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:27.330208 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:27.330208 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:27.330208 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:27.330208 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:27.330208 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:31:27.330208 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:31:27.330208 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:31:27.330208 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:31:27.330208 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:27.330208 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:27.330208 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:27.330208 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:27.330208 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:27.330208 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:27.331050 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:27.331050 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:27.331050 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:27.331050 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:27.331050 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:27.331050 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:27.331050 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:27.331050 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:27.331050 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:27.331050 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:27.331050 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:31:27.331050 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:27.331050 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 05:31:27.331050 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:27.331835 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 442/884] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 26 05:31:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:27.336070 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 443/885] 10.222.0.66 () {56 vars in 1117 bytes} [Mon Sep 26 05:31:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:27.343843 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f51c6a-e02b-4dec-baba-dd6ab2dd1132 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:27.344124 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f60b8-32bf-4a34-8f83-4ea7ac096382 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:27.414710 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:27.487905 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f60b8-32bf-4a34-8f83-4ea7ac096382 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:27.501487 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f51c6a-e02b-4dec-baba-dd6ab2dd1132 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:27.507101 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:27.535599 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531dfc3a-ac75-460c-95ac-5580be062ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:27.536693 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531dfc3a-ac75-460c-95ac-5580be062ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:27.536994 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531dfc3a-ac75-460c-95ac-5580be062ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:27.537272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531dfc3a-ac75-460c-95ac-5580be062ec2 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:27.538365 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531dfc3a-ac75-460c-95ac-5580be062ec2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:27.538701 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531dfc3a-ac75-460c-95ac-5580be062ec2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:27.541267 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531dfc3a-ac75-460c-95ac-5580be062ec2 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:27.544749 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff179e6-be93-4f0c-b29f-b1a76ff4a70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:27.545841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff179e6-be93-4f0c-b29f-b1a76ff4a70b None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:27.546207 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff179e6-be93-4f0c-b29f-b1a76ff4a70b None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:27.546533 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff179e6-be93-4f0c-b29f-b1a76ff4a70b None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:27.547230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff179e6-be93-4f0c-b29f-b1a76ff4a70b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:27.547585 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff179e6-be93-4f0c-b29f-b1a76ff4a70b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:27.549069 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff179e6-be93-4f0c-b29f-b1a76ff4a70b None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:27.554332 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 443/886] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 26 05:31:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:31:27.555270 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff179e6-be93-4f0c-b29f-b1a76ff4a70b None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:27.573207 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 444/887] 10.222.0.66 () {56 vars in 1149 bytes} [Mon Sep 26 05:31:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:27.574454 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531dfc3a-ac75-460c-95ac-5580be062ec2 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:27.652914 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:27.671358 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff179e6-be93-4f0c-b29f-b1a76ff4a70b None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:27.727273 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46218720-35c3-40de-a9c8-479058a96d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:27.728033 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46218720-35c3-40de-a9c8-479058a96d8f None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:27.728327 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46218720-35c3-40de-a9c8-479058a96d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:27.728571 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46218720-35c3-40de-a9c8-479058a96d8f None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:27.729222 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46218720-35c3-40de-a9c8-479058a96d8f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:27.730605 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46218720-35c3-40de-a9c8-479058a96d8f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:27.746683 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531dfc3a-ac75-460c-95ac-5580be062ec2 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:27.751421 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 444/888] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Sep 26 05:31:27 2022] POST /identity/v3/services => generated 269 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:31:27.759230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46218720-35c3-40de-a9c8-479058a96d8f None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:27.799104 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ceecb-d5f5-4d63-b501-1ebd495d90ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:27.800025 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ceecb-d5f5-4d63-b501-1ebd495d90ad None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:27.800185 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ceecb-d5f5-4d63-b501-1ebd495d90ad None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:27.800468 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ceecb-d5f5-4d63-b501-1ebd495d90ad None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:27.801433 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ceecb-d5f5-4d63-b501-1ebd495d90ad None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:27.801731 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ceecb-d5f5-4d63-b501-1ebd495d90ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:27.803498 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ceecb-d5f5-4d63-b501-1ebd495d90ad None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:27.810650 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 445/889] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 26 05:31:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:27.821520 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ceecb-d5f5-4d63-b501-1ebd495d90ad None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:27.876200 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:27.974594 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46218720-35c3-40de-a9c8-479058a96d8f None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:27.974937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ceecb-d5f5-4d63-b501-1ebd495d90ad None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:28.020464 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b865d-0e38-42ff-b25d-47cd7a971171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:28.021023 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b865d-0e38-42ff-b25d-47cd7a971171 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:28.021304 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b865d-0e38-42ff-b25d-47cd7a971171 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:28.021575 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b865d-0e38-42ff-b25d-47cd7a971171 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:28.022314 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b865d-0e38-42ff-b25d-47cd7a971171 None admin] RBAC: Adding query filter params (interface=public, service_id=431cc11d42b547859e7c4d1698f85530, region_id=RegionOne) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:28.022696 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b865d-0e38-42ff-b25d-47cd7a971171 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:28.024288 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b865d-0e38-42ff-b25d-47cd7a971171 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:28.032988 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 446/890] 10.222.0.66 () {56 vars in 1251 bytes} [Mon Sep 26 05:31:27 2022] GET /identity/v3/endpoints?service_id=431cc11d42b547859e7c4d1698f85530&interface=public®ion_id=RegionOne => generated 194 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:31:28.034314 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e0f66-f896-479d-a2b3-d8fa5bae8e8a None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:28.034681 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e0f66-f896-479d-a2b3-d8fa5bae8e8a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:28.034949 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e0f66-f896-479d-a2b3-d8fa5bae8e8a None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:28.035184 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ca4d4-0f2e-4779-a26c-583311874251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:28.035955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ca4d4-0f2e-4779-a26c-583311874251 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:28.036227 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ca4d4-0f2e-4779-a26c-583311874251 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:28.036471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8ca4d4-0f2e-4779-a26c-583311874251 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:28.036693 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 447/891] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:28.040273 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e0f66-f896-479d-a2b3-d8fa5bae8e8a None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:28.068051 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:28.155795 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ca4d4-0f2e-4779-a26c-583311874251 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:28.157311 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8ca4d4-0f2e-4779-a26c-583311874251 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:28.172143 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:28.181714 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e0f66-f896-479d-a2b3-d8fa5bae8e8a None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:28.226656 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bedd5b-7431-4a62-8019-8fedefffe6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:28.227296 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bedd5b-7431-4a62-8019-8fedefffe6bf None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:28.227707 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bedd5b-7431-4a62-8019-8fedefffe6bf None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:28.228049 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bedd5b-7431-4a62-8019-8fedefffe6bf None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:28.228725 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bedd5b-7431-4a62-8019-8fedefffe6bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:28.230250 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bedd5b-7431-4a62-8019-8fedefffe6bf None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:28.245208 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 448/892] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Sep 26 05:31:28 2022] GET /identity/v3/services => generated 1268 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:31:28.245208 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d918e-b7b4-4ea1-860c-3d5185f8a946 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:28.245208 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d918e-b7b4-4ea1-860c-3d5185f8a946 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:28.245208 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d918e-b7b4-4ea1-860c-3d5185f8a946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:28.261206 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-302d918e-b7b4-4ea1-860c-3d5185f8a946 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:28.262662 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-302d918e-b7b4-4ea1-860c-3d5185f8a946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:28.340347 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 445/893] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:31:27 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:31:28.344305 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ca4d4-0f2e-4779-a26c-583311874251 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:28.361394 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 449/894] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:28 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:31:28.444202 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:28.529325 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8ca4d4-0f2e-4779-a26c-583311874251 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:28.582971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe23e1-e92d-4c27-8a6f-f1b8a64fc523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:28.583944 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe23e1-e92d-4c27-8a6f-f1b8a64fc523 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:28.584345 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe23e1-e92d-4c27-8a6f-f1b8a64fc523 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:28.584731 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe23e1-e92d-4c27-8a6f-f1b8a64fc523 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:28.599609 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe23e1-e92d-4c27-8a6f-f1b8a64fc523 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:28.601187 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe23e1-e92d-4c27-8a6f-f1b8a64fc523 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:28.620000 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-48fe23e1-e92d-4c27-8a6f-f1b8a64fc523 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:28.620000 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:28.620000 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:28.620000 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:28.620000 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:28.620000 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:28.620000 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:28.620000 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:28.620000 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:28.620000 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:28.620000 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:28.620000 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:28.620000 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:31:28.620000 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:31:28.620000 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:31:28.620000 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:31:28.621112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:28.621112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:28.621112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:28.621112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:28.621112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:28.621112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:28.621112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:28.621112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:28.621112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:28.621112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:28.621112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:28.621112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:28.621112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:28.621112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:28.621112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:28.621112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:28.621112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:31:28.622092 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:31:28.622092 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:28.622092 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:28.622704 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 446/895] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:31:28.631409 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d918e-b7b4-4ea1-860c-3d5185f8a946 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:28.779397 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:28.790596 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe23e1-e92d-4c27-8a6f-f1b8a64fc523 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:28.796674 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d918e-b7b4-4ea1-860c-3d5185f8a946 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:28.860749 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ff256-8744-402a-880d-33610408b7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:28.861577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ff256-8744-402a-880d-33610408b7a4 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:28.861975 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ff256-8744-402a-880d-33610408b7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:28.862450 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ff256-8744-402a-880d-33610408b7a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:28.863445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ff256-8744-402a-880d-33610408b7a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:28.863927 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ff256-8744-402a-880d-33610408b7a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:28.866088 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ff256-8744-402a-880d-33610408b7a4 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:28.889006 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 450/896] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:31:28.890478 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ff256-8744-402a-880d-33610408b7a4 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:28.930508 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:28.937943 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe23e1-e92d-4c27-8a6f-f1b8a64fc523 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:28.988230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6cafd-fc31-4b44-93ca-88c6a315319b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:28.988903 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6cafd-fc31-4b44-93ca-88c6a315319b None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:28.989185 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6cafd-fc31-4b44-93ca-88c6a315319b None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:28.989450 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6cafd-fc31-4b44-93ca-88c6a315319b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:28.990054 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6cafd-fc31-4b44-93ca-88c6a315319b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:28.991502 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6cafd-fc31-4b44-93ca-88c6a315319b None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:29.001008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-09b6cafd-fc31-4b44-93ca-88c6a315319b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 05:31:29.001008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:29.001008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:31:29.001008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:31:29.001008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:31:29.001008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:31:29.001008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:31:29.001008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:29.001008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 05:31:29.001008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:29.001008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:31:29.001008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:29.001008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:29.001008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:29.001008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:29.001008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:29.001008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:29.002771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:29.002771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:29.002771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:29.002771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:29.002771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:29.002771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:29.002771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:31:29.002771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:31:29.002771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:31:29.002771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:31:29.002771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:29.002771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:29.002771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:29.002771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:29.002771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:29.002771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:29.004440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:29.004440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:29.004440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:29.004440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:29.004440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:29.004440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:29.004440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:29.004440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:29.004440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:29.004440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:29.004440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:31:29.004440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:29.004440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 05:31:29.004440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:29.004440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 447/897] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Sep 26 05:31:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:29.008420 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6cafd-fc31-4b44-93ca-88c6a315319b None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:29.072884 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ff256-8744-402a-880d-33610408b7a4 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:29.121845 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a9949-d836-4647-aa81-2902c6c58640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:29.122941 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a9949-d836-4647-aa81-2902c6c58640 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:29.123434 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a9949-d836-4647-aa81-2902c6c58640 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:29.123939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a9949-d836-4647-aa81-2902c6c58640 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:29.134057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a9949-d836-4647-aa81-2902c6c58640 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:29.136285 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a9949-d836-4647-aa81-2902c6c58640 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:29.151055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-354a9949-d836-4647-aa81-2902c6c58640 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:31:29.151055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:29.151055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:29.151055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:29.151055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:29.151055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:29.151055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:29.151055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:29.151055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:29.151055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:29.151055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:29.151055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:29.151055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:31:29.151055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:31:29.151055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:31:29.152093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:31:29.152093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:29.152093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:29.152093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:29.152093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:29.152093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:29.152093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:29.152093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:29.152093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:29.152093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:29.152093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:29.152093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:29.152093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:29.152093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:29.152093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:29.152093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:29.152093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:29.153006 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:31:29.153006 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:31:29.153006 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:31:29.153006 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:31:29.153006 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:31:29.153006 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:31:29.153006 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:31:29.153006 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:29.156016 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 451/898] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:31:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:29.162238 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6cafd-fc31-4b44-93ca-88c6a315319b None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:29.165100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a9949-d836-4647-aa81-2902c6c58640 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:29.202400 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:29.204997 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef14f3e-8e2b-457d-b0fa-6ef8b0be07a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:29.205885 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef14f3e-8e2b-457d-b0fa-6ef8b0be07a7 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:29.206234 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef14f3e-8e2b-457d-b0fa-6ef8b0be07a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:29.206529 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef14f3e-8e2b-457d-b0fa-6ef8b0be07a7 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:29.207204 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef14f3e-8e2b-457d-b0fa-6ef8b0be07a7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:29.207532 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef14f3e-8e2b-457d-b0fa-6ef8b0be07a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:29.209855 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef14f3e-8e2b-457d-b0fa-6ef8b0be07a7 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:29.219786 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 448/899] 10.222.0.66 () {56 vars in 1122 bytes} [Mon Sep 26 05:31:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:29.226400 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef14f3e-8e2b-457d-b0fa-6ef8b0be07a7 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:29.281833 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:29.355301 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a9949-d836-4647-aa81-2902c6c58640 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:29.414689 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a19fac-b2b6-4a4c-ab1e-7ef9c8a9fb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:29.415681 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a19fac-b2b6-4a4c-ab1e-7ef9c8a9fb6a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:29.416204 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a19fac-b2b6-4a4c-ab1e-7ef9c8a9fb6a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:29.416680 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a19fac-b2b6-4a4c-ab1e-7ef9c8a9fb6a None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:29.418651 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a19fac-b2b6-4a4c-ab1e-7ef9c8a9fb6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:29.419309 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a19fac-b2b6-4a4c-ab1e-7ef9c8a9fb6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:29.423084 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a19fac-b2b6-4a4c-ab1e-7ef9c8a9fb6a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:29.425124 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef14f3e-8e2b-457d-b0fa-6ef8b0be07a7 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:29.450930 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 452/900] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:31:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:29.457816 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a19fac-b2b6-4a4c-ab1e-7ef9c8a9fb6a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:29.490458 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536b689-2121-402a-9222-eeed30eeff4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:29.491442 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536b689-2121-402a-9222-eeed30eeff4e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:29.491710 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536b689-2121-402a-9222-eeed30eeff4e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:29.492062 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536b689-2121-402a-9222-eeed30eeff4e None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:29.492801 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536b689-2121-402a-9222-eeed30eeff4e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:29.493099 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536b689-2121-402a-9222-eeed30eeff4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:29.494577 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536b689-2121-402a-9222-eeed30eeff4e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:29.508238 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 449/901] 10.222.0.66 () {56 vars in 1122 bytes} [Mon Sep 26 05:31:29 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:29.586473 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:29.649551 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a19fac-b2b6-4a4c-ab1e-7ef9c8a9fb6a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:29.696193 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b82f32-9982-4021-a925-eabeee183114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:29.697431 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b82f32-9982-4021-a925-eabeee183114 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:29.697982 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b82f32-9982-4021-a925-eabeee183114 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:29.698469 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b82f32-9982-4021-a925-eabeee183114 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:29.699476 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b82f32-9982-4021-a925-eabeee183114 None admin] RBAC: Adding query filter params (role.id=630ba0cecaa24efeb65159717bf41ac7, scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8, user.id=5bdaf32400b94aa291ad43a3131e1d0a) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:29.700034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b82f32-9982-4021-a925-eabeee183114 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:29.702180 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b82f32-9982-4021-a925-eabeee183114 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:29.710725 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 453/902] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:31:29 2022] GET /identity/v3/role_assignments?user.id=5bdaf32400b94aa291ad43a3131e1d0a&scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8&role.id=630ba0cecaa24efeb65159717bf41ac7 => generated 259 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:30.163337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b03a7-f96a-44c1-8a45-ac9135203be3 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:30.163970 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b03a7-f96a-44c1-8a45-ac9135203be3 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:30.163970 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b03a7-f96a-44c1-8a45-ac9135203be3 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:30.165521 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 450/903] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:30.171272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091711e-cf50-4237-8090-c2a16d9362e0 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:30.171768 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091711e-cf50-4237-8090-c2a16d9362e0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:30.171848 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091711e-cf50-4237-8090-c2a16d9362e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:30.191335 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-f091711e-cf50-4237-8090-c2a16d9362e0 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:30.192564 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f091711e-cf50-4237-8090-c2a16d9362e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:30.282469 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 454/904] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:30 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:31:30.598164 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fe842-e72f-435d-9a61-bd63f1ee4964 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:30.598566 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fe842-e72f-435d-9a61-bd63f1ee4964 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:30.599049 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fe842-e72f-435d-9a61-bd63f1ee4964 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:30.602088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 451/905] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:30.607349 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db14d4-3078-416a-8be4-6b9818b907fa None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:30.607633 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db14d4-3078-416a-8be4-6b9818b907fa None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:30.607939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db14d4-3078-416a-8be4-6b9818b907fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:30.626585 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-68db14d4-3078-416a-8be4-6b9818b907fa None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:30.627821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-68db14d4-3078-416a-8be4-6b9818b907fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:30.689715 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:30.704275 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 455/906] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:30 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 05:31:30.811873 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571fe842-e72f-435d-9a61-bd63f1ee4964 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:30.976415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:30.979405 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db14d4-3078-416a-8be4-6b9818b907fa None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:30.997099 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571fe842-e72f-435d-9a61-bd63f1ee4964 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:31.040184 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f173ac-3800-4f75-a020-9feababa5457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:31.040865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f173ac-3800-4f75-a020-9feababa5457 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:31.041139 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f173ac-3800-4f75-a020-9feababa5457 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:31.041403 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f173ac-3800-4f75-a020-9feababa5457 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:31.041988 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f173ac-3800-4f75-a020-9feababa5457 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:31.043366 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f173ac-3800-4f75-a020-9feababa5457 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:31.053525 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-a9f173ac-3800-4f75-a020-9feababa5457 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 05:31:31.053525 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:31.053525 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:31:31.053525 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:31:31.053525 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:31:31.053525 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:31:31.053525 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:31:31.053525 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:31.053525 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 05:31:31.053525 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:31.053525 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:31:31.053525 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:31.053525 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:31.053525 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:31.053525 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:31.053525 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:31.054724 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:31.054724 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:31.054724 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:31.054724 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:31.054724 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:31.054724 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:31.054724 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:31.054724 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:31:31.054724 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:31:31.054724 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:31:31.054724 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:31:31.054724 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:31.054724 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:31.054724 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:31.054724 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:31.054724 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:31.054724 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:31.055625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:31.055625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:31.055625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:31.055625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:31.055625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:31.055625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:31.055625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:31.055625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:31.055625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:31.055625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:31.055625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:31:31.055625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:31.055625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 05:31:31.055625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:31.055625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 452/907] 10.222.0.66 () {56 vars in 1132 bytes} [Mon Sep 26 05:31:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:31.063870 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f173ac-3800-4f75-a020-9feababa5457 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:31.161314 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db14d4-3078-416a-8be4-6b9818b907fa None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:31.176192 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f173ac-3800-4f75-a020-9feababa5457 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:31.214086 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812923f-d5bb-41a2-a53a-eab8d10d09ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:31.215193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812923f-d5bb-41a2-a53a-eab8d10d09ec None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:31.215808 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812923f-d5bb-41a2-a53a-eab8d10d09ec None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:31.216278 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812923f-d5bb-41a2-a53a-eab8d10d09ec None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:31.217139 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c812923f-d5bb-41a2-a53a-eab8d10d09ec None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:31.217660 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c812923f-d5bb-41a2-a53a-eab8d10d09ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:31.219535 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c812923f-d5bb-41a2-a53a-eab8d10d09ec None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:31.224403 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993b4bd-b06e-498b-aa9d-289ea59bd0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:31.225521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993b4bd-b06e-498b-aa9d-289ea59bd0b9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:31.226232 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993b4bd-b06e-498b-aa9d-289ea59bd0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:31.226872 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8993b4bd-b06e-498b-aa9d-289ea59bd0b9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:31.227508 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 453/908] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Sep 26 05:31:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:31.235584 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8993b4bd-b06e-498b-aa9d-289ea59bd0b9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:31.236954 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812923f-d5bb-41a2-a53a-eab8d10d09ec None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:31.238292 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8993b4bd-b06e-498b-aa9d-289ea59bd0b9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:31.255923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-8993b4bd-b06e-498b-aa9d-289ea59bd0b9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 05:31:31.255923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:31.255923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:31:31.255923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:31:31.255923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:31:31.255923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:31:31.255923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:31:31.255923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:31.255923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 05:31:31.255923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:31.255923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:31:31.255923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:31.255923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:31.255923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:31.255923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:31.255923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:31.255923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:31.257338 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:31.257338 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:31.257338 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:31.257338 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:31.257338 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:31.257338 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:31.257338 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:31:31.257338 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:31:31.257338 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:31:31.257338 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:31:31.257338 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:31.257338 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:31.257338 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:31.257338 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:31.257338 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:31.257338 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:31.258512 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:31.258512 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:31.258512 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:31.258512 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:31.258512 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:31.258512 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:31.258512 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:31.258512 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:31.258512 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:31.258512 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:31.258512 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:31:31.258512 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:31.258512 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 26 05:31:31.258512 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:31.258512 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 456/909] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 26 05:31:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:31.264813 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993b4bd-b06e-498b-aa9d-289ea59bd0b9 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:31.267465 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:31.384354 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:31.385812 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812923f-d5bb-41a2-a53a-eab8d10d09ec None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:31.436516 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717d12e-fb8a-461e-becf-37a8c05cb9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:31.437884 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717d12e-fb8a-461e-becf-37a8c05cb9ae None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:31.438581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717d12e-fb8a-461e-becf-37a8c05cb9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:31.439258 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717d12e-fb8a-461e-becf-37a8c05cb9ae None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:31.440669 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717d12e-fb8a-461e-becf-37a8c05cb9ae None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:31.441345 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717d12e-fb8a-461e-becf-37a8c05cb9ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:31.445945 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717d12e-fb8a-461e-becf-37a8c05cb9ae None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:31.456517 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 454/910] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Sep 26 05:31:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:31:31.466745 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717d12e-fb8a-461e-becf-37a8c05cb9ae None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:31.477194 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8993b4bd-b06e-498b-aa9d-289ea59bd0b9 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:31.538819 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eaa80d-59dd-445b-a2ea-0753586ea846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:31.540116 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eaa80d-59dd-445b-a2ea-0753586ea846 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:31.540535 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eaa80d-59dd-445b-a2ea-0753586ea846 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:31.541035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eaa80d-59dd-445b-a2ea-0753586ea846 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:31.542220 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eaa80d-59dd-445b-a2ea-0753586ea846 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:31.542794 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eaa80d-59dd-445b-a2ea-0753586ea846 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:31.545413 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eaa80d-59dd-445b-a2ea-0753586ea846 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:31.555054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 457/911] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 26 05:31:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:31.562066 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eaa80d-59dd-445b-a2ea-0753586ea846 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:31.605180 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:31.626870 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717d12e-fb8a-461e-becf-37a8c05cb9ae None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:31.676421 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f23732-420c-4f9f-ac29-2e48a3bee130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:31.677547 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f23732-420c-4f9f-ac29-2e48a3bee130 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:31.678078 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f23732-420c-4f9f-ac29-2e48a3bee130 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:31.678583 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f23732-420c-4f9f-ac29-2e48a3bee130 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:31.679612 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f23732-420c-4f9f-ac29-2e48a3bee130 None admin] RBAC: Adding query filter params (interface=public, service_id=7b9e82e139f94948a5a638fcd695ed08, region_id=RegionOne) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:31.680142 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f23732-420c-4f9f-ac29-2e48a3bee130 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:31.681769 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f23732-420c-4f9f-ac29-2e48a3bee130 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:31.688464 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 455/912] 10.222.0.66 () {56 vars in 1251 bytes} [Mon Sep 26 05:31:31 2022] GET /identity/v3/endpoints?service_id=7b9e82e139f94948a5a638fcd695ed08&interface=public®ion_id=RegionOne => generated 194 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:31:31.702392 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f23732-420c-4f9f-ac29-2e48a3bee130 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:31.720028 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eaa80d-59dd-445b-a2ea-0753586ea846 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:31.748225 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:31.764915 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff8dcb-5868-41a2-ad1a-9bb7fe8efe7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:31.765882 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff8dcb-5868-41a2-ad1a-9bb7fe8efe7a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:31.766310 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff8dcb-5868-41a2-ad1a-9bb7fe8efe7a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:31.766734 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff8dcb-5868-41a2-ad1a-9bb7fe8efe7a None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:31.767631 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff8dcb-5868-41a2-ad1a-9bb7fe8efe7a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:31.768141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff8dcb-5868-41a2-ad1a-9bb7fe8efe7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:31.769960 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff8dcb-5868-41a2-ad1a-9bb7fe8efe7a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:31.777237 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 458/913] 10.222.0.66 () {56 vars in 1114 bytes} [Mon Sep 26 05:31:31 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:31.783368 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff8dcb-5868-41a2-ad1a-9bb7fe8efe7a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:31.845317 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f23732-420c-4f9f-ac29-2e48a3bee130 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:31.890735 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36802c9a-e940-4983-b8e5-13a411f022c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:31.891782 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36802c9a-e940-4983-b8e5-13a411f022c9 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:31.892067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36802c9a-e940-4983-b8e5-13a411f022c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:31.892643 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36802c9a-e940-4983-b8e5-13a411f022c9 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:31.893294 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36802c9a-e940-4983-b8e5-13a411f022c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:31.894855 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36802c9a-e940-4983-b8e5-13a411f022c9 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:31.902723 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 456/914] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Sep 26 05:31:31 2022] GET /identity/v3/services => generated 1268 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:31:31.916696 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff8dcb-5868-41a2-ad1a-9bb7fe8efe7a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:31.967043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d54b88-08bb-4d53-9175-a6ff515ba606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:31.967693 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d54b88-08bb-4d53-9175-a6ff515ba606 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:31.968003 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d54b88-08bb-4d53-9175-a6ff515ba606 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:31.968343 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d54b88-08bb-4d53-9175-a6ff515ba606 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:31.969051 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d54b88-08bb-4d53-9175-a6ff515ba606 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:31.970599 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d54b88-08bb-4d53-9175-a6ff515ba606 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:32.006461 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 459/915] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:31:31 2022] POST /identity/v3/endpoints => generated 346 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:31:32.169078 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb57668-e9d7-4f8a-8fc1-64db423d3475 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:32.169763 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb57668-e9d7-4f8a-8fc1-64db423d3475 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:32.170245 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb57668-e9d7-4f8a-8fc1-64db423d3475 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:32.172410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 457/916] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:32.178665 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f3634-4236-4939-a088-2bd655f38e7d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:32.179319 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f3634-4236-4939-a088-2bd655f38e7d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:32.179844 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f3634-4236-4939-a088-2bd655f38e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:32.204911 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-5f3f3634-4236-4939-a088-2bd655f38e7d None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:32.206211 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5f3f3634-4236-4939-a088-2bd655f38e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:32.218553 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec14a4-7a92-4d2e-a339-693a98e36701 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:32.218553 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec14a4-7a92-4d2e-a339-693a98e36701 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:32.218553 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec14a4-7a92-4d2e-a339-693a98e36701 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:32.221592 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 458/917] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:32.232455 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed430b7-c5c7-4764-b0fc-b02a721c11c0 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:32.232960 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed430b7-c5c7-4764-b0fc-b02a721c11c0 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:32.233647 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed430b7-c5c7-4764-b0fc-b02a721c11c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:32.250970 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:32.262327 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-4ed430b7-c5c7-4764-b0fc-b02a721c11c0 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:32.264208 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4ed430b7-c5c7-4764-b0fc-b02a721c11c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:32.267657 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:32.311977 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 460/918] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:32 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:31:32.367037 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 459/919] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:32 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:31:32.592831 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f3634-4236-4939-a088-2bd655f38e7d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:32.634711 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed430b7-c5c7-4764-b0fc-b02a721c11c0 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:32.729279 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f3634-4236-4939-a088-2bd655f38e7d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:32.766858 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f346ff-8c5f-492d-8600-ce8bd49d0b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:32.767507 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f346ff-8c5f-492d-8600-ce8bd49d0b73 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:32.767863 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f346ff-8c5f-492d-8600-ce8bd49d0b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:32.768133 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f346ff-8c5f-492d-8600-ce8bd49d0b73 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:32.780429 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f346ff-8c5f-492d-8600-ce8bd49d0b73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:31:32.785547 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-c4f346ff-8c5f-492d-8600-ce8bd49d0b73 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 05:31:32.785547 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:32.785547 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:32.785547 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:32.785547 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:32.785547 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:32.785547 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:32.785547 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:32.785547 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:32.785547 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:32.785547 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:32.785547 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:32.785547 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:31:32.785547 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:31:32.785547 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:31:32.785547 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:31:32.787440 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:31:32.787440 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:31:32.787440 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:31:32.787440 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:31:32.787440 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:32.787440 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:32.787440 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:32.787440 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:32.787440 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:32.787440 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:32.787440 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:32.787440 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:32.787440 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:32.787440 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:32.787440 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:32.787440 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:32.789209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:32.789209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:32.789209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:32.789209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:32.789209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:31:32.789209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:31:32.789209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:31:32.789209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:31:32.789209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:31:32.789209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:31:32.789209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 05:31:32.789209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:32.789209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 461/920] 10.222.0.66 () {56 vars in 1120 bytes} [Mon Sep 26 05:31:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:32.793620 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f346ff-8c5f-492d-8600-ce8bd49d0b73 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:32.818936 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed430b7-c5c7-4764-b0fc-b02a721c11c0 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:32.825622 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:32.892884 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e903f0d-8554-4929-9d82-e5b9b7f22333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:32.894507 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e903f0d-8554-4929-9d82-e5b9b7f22333 None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:32.895414 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e903f0d-8554-4929-9d82-e5b9b7f22333 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:32.896264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e903f0d-8554-4929-9d82-e5b9b7f22333 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:32.897883 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e903f0d-8554-4929-9d82-e5b9b7f22333 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:32.900964 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e903f0d-8554-4929-9d82-e5b9b7f22333 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:32.913970 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f346ff-8c5f-492d-8600-ce8bd49d0b73 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:32.921131 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:32.940379 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 460/921] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Sep 26 05:31:32 2022] POST /identity/v3/services => generated 241 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:31:32.974493 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1ba8d-f4ed-4db9-8d5d-e072e9f9ecd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:32.975445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1ba8d-f4ed-4db9-8d5d-e072e9f9ecd3 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:32.975992 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1ba8d-f4ed-4db9-8d5d-e072e9f9ecd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:32.976409 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1ba8d-f4ed-4db9-8d5d-e072e9f9ecd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:32.977324 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1ba8d-f4ed-4db9-8d5d-e072e9f9ecd3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:32.977810 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1ba8d-f4ed-4db9-8d5d-e072e9f9ecd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:32.979558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1ba8d-f4ed-4db9-8d5d-e072e9f9ecd3 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:32.990608 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 462/922] 10.222.0.66 () {56 vars in 1115 bytes} [Mon Sep 26 05:31:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:32.999463 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e903f0d-8554-4929-9d82-e5b9b7f22333 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:33.158706 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e903f0d-8554-4929-9d82-e5b9b7f22333 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:33.204526 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d38ad-a490-44b5-ba4a-3db24961d29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:33.205223 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d38ad-a490-44b5-ba4a-3db24961d29e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:33.205498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d38ad-a490-44b5-ba4a-3db24961d29e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:33.206933 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d38ad-a490-44b5-ba4a-3db24961d29e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:33.222495 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d38ad-a490-44b5-ba4a-3db24961d29e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:33.224262 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d38ad-a490-44b5-ba4a-3db24961d29e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:33.247777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-1c0d38ad-a490-44b5-ba4a-3db24961d29e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:33.247777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:33.247777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:33.247777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:33.247777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:33.247777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:33.247777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:33.247777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:33.247777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:33.247777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:33.247777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:33.247777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:33.247777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:31:33.247777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:31:33.247777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:31:33.247777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:31:33.248946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:33.248946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:33.248946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:33.248946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:33.248946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:33.248946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:33.248946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:33.248946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:33.248946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:33.248946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:33.248946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:33.248946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:33.248946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:33.248946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:33.248946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:33.248946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:33.248946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:31:33.250077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:31:33.250077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:33.250077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:33.250077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 461/923] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:33.257715 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1ba8d-f4ed-4db9-8d5d-e072e9f9ecd3 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:33.374628 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:33.397173 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1ba8d-f4ed-4db9-8d5d-e072e9f9ecd3 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:33.441553 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727e92f-fb46-4ebf-80da-4e136c00ae38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:33.442180 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727e92f-fb46-4ebf-80da-4e136c00ae38 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:33.442452 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727e92f-fb46-4ebf-80da-4e136c00ae38 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:33.442742 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727e92f-fb46-4ebf-80da-4e136c00ae38 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:33.443362 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727e92f-fb46-4ebf-80da-4e136c00ae38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:33.443724 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727e92f-fb46-4ebf-80da-4e136c00ae38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:33.445174 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727e92f-fb46-4ebf-80da-4e136c00ae38 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:33.459373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 463/924] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:33.465616 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d38ad-a490-44b5-ba4a-3db24961d29e None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:33.539318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:33.637922 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d38ad-a490-44b5-ba4a-3db24961d29e None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:33.730900 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd142aa6-51fe-4109-ac7b-4627aa6bf4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:33.732040 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd142aa6-51fe-4109-ac7b-4627aa6bf4ad None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:33.732532 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd142aa6-51fe-4109-ac7b-4627aa6bf4ad None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:33.732996 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd142aa6-51fe-4109-ac7b-4627aa6bf4ad None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:33.759355 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd142aa6-51fe-4109-ac7b-4627aa6bf4ad None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:33.759355 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd142aa6-51fe-4109-ac7b-4627aa6bf4ad None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:33.773695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-fd142aa6-51fe-4109-ac7b-4627aa6bf4ad None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 05:31:33.773695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:33.773695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:33.773695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:33.773695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:33.773695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:33.773695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:33.773695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:33.773695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:33.773695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:33.773695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:33.773695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:33.773695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:31:33.773695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:31:33.773695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:31:33.773695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:31:33.774758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:33.774758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:33.774758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:31:33.774758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:31:33.774758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:31:33.774758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:31:33.774758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:33.774758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:33.774758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:33.774758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:33.774758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:33.774758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:33.774758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:33.774758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:33.774758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:33.774758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:33.774758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:33.774758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:33.775778 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:33.775778 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:33.775778 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:31:33.775778 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:31:33.775778 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:31:33.775778 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:31:33.775778 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:31:33.775778 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:31:33.775778 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 05:31:33.775778 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:33.781046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 462/925] 10.222.0.66 () {56 vars in 1117 bytes} [Mon Sep 26 05:31:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:33.793325 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727e92f-fb46-4ebf-80da-4e136c00ae38 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:33.948345 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727e92f-fb46-4ebf-80da-4e136c00ae38 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:33.985661 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3bd5f-3022-4e85-82cf-08f070be3008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:33.986196 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3bd5f-3022-4e85-82cf-08f070be3008 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:33.986470 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3bd5f-3022-4e85-82cf-08f070be3008 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:33.986736 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3bd5f-3022-4e85-82cf-08f070be3008 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:33.987466 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3bd5f-3022-4e85-82cf-08f070be3008 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:33.987863 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3bd5f-3022-4e85-82cf-08f070be3008 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:33.989400 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3bd5f-3022-4e85-82cf-08f070be3008 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:34.014682 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 464/926] 10.222.0.66 () {56 vars in 1149 bytes} [Mon Sep 26 05:31:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:34.024577 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd142aa6-51fe-4109-ac7b-4627aa6bf4ad None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:34.138229 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd142aa6-51fe-4109-ac7b-4627aa6bf4ad None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:34.154032 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:34.178696 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2b221-5253-4f7f-b473-3824a6003974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:34.179296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2b221-5253-4f7f-b473-3824a6003974 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:34.179571 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2b221-5253-4f7f-b473-3824a6003974 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:34.179871 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2b221-5253-4f7f-b473-3824a6003974 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:34.191865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2b221-5253-4f7f-b473-3824a6003974 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:34.193362 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2b221-5253-4f7f-b473-3824a6003974 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:34.210498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-1ac2b221-5253-4f7f-b473-3824a6003974 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:34.210498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:34.210498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:34.210498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:34.210498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:34.210498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:34.210498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:34.210498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:34.210498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:34.210498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:34.210498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:34.210498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:34.210498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:31:34.210498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:31:34.210498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:31:34.210498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:31:34.212282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:34.212282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:34.212282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:34.212282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:34.212282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:34.212282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:34.212282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:34.212282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:34.212282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:34.212282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:34.212282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:34.212282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:34.212282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:34.212282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:34.212282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:34.212282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:34.212282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:31:34.213965 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:31:34.213965 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:34.213965 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:34.213965 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 463/927] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:34.224824 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3bd5f-3022-4e85-82cf-08f070be3008 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:34.231687 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:34.376274 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3bd5f-3022-4e85-82cf-08f070be3008 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:34.412677 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ff860-3c14-4c74-ae93-f94595ee3e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:34.413384 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ff860-3c14-4c74-ae93-f94595ee3e05 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:34.413658 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ff860-3c14-4c74-ae93-f94595ee3e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:34.413971 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ff860-3c14-4c74-ae93-f94595ee3e05 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:34.414619 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ff860-3c14-4c74-ae93-f94595ee3e05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:34.414916 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ff860-3c14-4c74-ae93-f94595ee3e05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:34.416394 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ff860-3c14-4c74-ae93-f94595ee3e05 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:34.429224 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 465/928] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:34.438730 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2b221-5253-4f7f-b473-3824a6003974 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:34.580952 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aeef91-2160-44c8-abb2-fb7c7263b7e6 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:34.581212 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aeef91-2160-44c8-abb2-fb7c7263b7e6 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:34.581566 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aeef91-2160-44c8-abb2-fb7c7263b7e6 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:34.583091 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 466/929] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:31:34.589015 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186410a5-81e3-4b20-9799-bda77ef9f357 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:34.589400 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186410a5-81e3-4b20-9799-bda77ef9f357 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:34.589593 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186410a5-81e3-4b20-9799-bda77ef9f357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:34.610031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-186410a5-81e3-4b20-9799-bda77ef9f357 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:34.611443 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-186410a5-81e3-4b20-9799-bda77ef9f357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:34.624780 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2b221-5253-4f7f-b473-3824a6003974 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:34.667255 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b93fd-bc24-4ad4-ad24-c31fe5b436df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:34.668333 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b93fd-bc24-4ad4-ad24-c31fe5b436df None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:34.668810 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b93fd-bc24-4ad4-ad24-c31fe5b436df None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:34.669290 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b93fd-bc24-4ad4-ad24-c31fe5b436df None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:34.677375 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b93fd-bc24-4ad4-ad24-c31fe5b436df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:34.678914 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b93fd-bc24-4ad4-ad24-c31fe5b436df None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:34.691165 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-f20b93fd-bc24-4ad4-ad24-c31fe5b436df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:31:34.691165 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:34.691165 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:34.691165 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:34.691165 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:34.691165 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:34.691165 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:34.691165 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:34.691165 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:34.691165 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:34.691165 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:34.691165 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:34.691165 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:31:34.691165 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:31:34.691165 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:31:34.692841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:31:34.692841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:34.692841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:34.692841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:34.692841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:34.692841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:34.692841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:34.692841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:34.692841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:34.692841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:34.692841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:34.692841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:34.692841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:34.692841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:34.692841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:34.692841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:34.692841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:34.695161 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:31:34.695161 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:31:34.695161 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:31:34.695161 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:31:34.695161 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:31:34.695161 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:31:34.695161 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:31:34.695161 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:34.697288 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 464/930] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:31:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:34.698540 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc691f-c837-47e9-913d-4074069b1a1c None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:34.698820 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc691f-c837-47e9-913d-4074069b1a1c None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:34.699103 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc691f-c837-47e9-913d-4074069b1a1c None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:34.707351 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 465/931] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:34.707351 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc691f-c837-47e9-913d-4074069b1a1c None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:34.712166 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:34.727777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 467/932] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:31:34.727777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cd474-32c8-4ecb-b98f-47e24324a7ca None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:34.727777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cd474-32c8-4ecb-b98f-47e24324a7ca None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:34.727777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569cd474-32c8-4ecb-b98f-47e24324a7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:34.745833 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:34.750535 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-569cd474-32c8-4ecb-b98f-47e24324a7ca None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:34.752770 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-569cd474-32c8-4ecb-b98f-47e24324a7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:34.833717 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc691f-c837-47e9-913d-4074069b1a1c None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:34.853109 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 468/933] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:31:34.874055 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370df9a-c2c9-4760-8a97-89dca5aed4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:34.874954 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370df9a-c2c9-4760-8a97-89dca5aed4ca None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:34.875389 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370df9a-c2c9-4760-8a97-89dca5aed4ca None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:34.875839 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a370df9a-c2c9-4760-8a97-89dca5aed4ca None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:34.876685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a370df9a-c2c9-4760-8a97-89dca5aed4ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:34.877128 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a370df9a-c2c9-4760-8a97-89dca5aed4ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:34.878701 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a370df9a-c2c9-4760-8a97-89dca5aed4ca None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:34.896061 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 466/934] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:31:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:34.898395 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569cd474-32c8-4ecb-b98f-47e24324a7ca None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:35.004605 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569cd474-32c8-4ecb-b98f-47e24324a7ca None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:35.030572 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:35.041936 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652890ad-e46f-448c-b6b1-3df9aa60eb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:35.042843 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652890ad-e46f-448c-b6b1-3df9aa60eb04 None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:35.043293 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652890ad-e46f-448c-b6b1-3df9aa60eb04 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:35.043709 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652890ad-e46f-448c-b6b1-3df9aa60eb04 None admin] PATH_INFO: `/v3/projects/953bb95b0ba84d4f99a73afb426bb8c8/users/5bdaf32400b94aa291ad43a3131e1d0a/roles/630ba0cecaa24efeb65159717bf41ac7` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:35.046104 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652890ad-e46f-448c-b6b1-3df9aa60eb04 None admin] RBAC: Authorizing `identity:create_grant(project_id=953bb95b0ba84d4f99a73afb426bb8c8, user_id=5bdaf32400b94aa291ad43a3131e1d0a, role_id=630ba0cecaa24efeb65159717bf41ac7)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:35.047720 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652890ad-e46f-448c-b6b1-3df9aa60eb04 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:35.065721 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 469/935] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 26 05:31:34 2022] PUT /identity/v3/projects/953bb95b0ba84d4f99a73afb426bb8c8/users/5bdaf32400b94aa291ad43a3131e1d0a/roles/630ba0cecaa24efeb65159717bf41ac7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:31:35.151085 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370df9a-c2c9-4760-8a97-89dca5aed4ca None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:35.244147 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652890ad-e46f-448c-b6b1-3df9aa60eb04 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:35.263628 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:35.285338 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a370df9a-c2c9-4760-8a97-89dca5aed4ca None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:35.337009 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e6934-b87c-4c76-85f3-af26cacea2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:35.337582 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e6934-b87c-4c76-85f3-af26cacea2f4 None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:35.338358 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e6934-b87c-4c76-85f3-af26cacea2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:35.338725 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e6934-b87c-4c76-85f3-af26cacea2f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:35.339596 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e6934-b87c-4c76-85f3-af26cacea2f4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:35.343809 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e6934-b87c-4c76-85f3-af26cacea2f4 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:35.346314 dv-cinder-836083-14-smb devstack@keystone.service[81682]: WARNING keystone.server.flask.common [None req-9e6e6934-b87c-4c76-85f3-af26cacea2f4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 26 05:31:35.367781 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.sql.core [None req-9e6e6934-b87c-4c76-85f3-af26cacea2f4 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 26 05:31:35.367781 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 26 05:31:35.367781 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [parameters: {'id': 'f83e248d6d0640289cc1529a6ed5e4da', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 26 05:31:35.367781 dv-cinder-836083-14-smb devstack@keystone.service[81682]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81682) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 26 05:31:35.377794 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-9e6e6934-b87c-4c76-85f3-af26cacea2f4 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f83e248d6d0640289cc1529a6ed5e4da.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f83e248d6d0640289cc1529a6ed5e4da. Sep 26 05:31:35.377794 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:35.377794 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 05:31:35.377794 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 05:31:35.377794 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 05:31:35.377794 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 05:31:35.377794 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 05:31:35.377794 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 05:31:35.377794 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 05:31:35.377794 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application conn.query(q) Sep 26 05:31:35.377794 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 05:31:35.377794 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 05:31:35.377794 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 05:31:35.378971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application result.read() Sep 26 05:31:35.378971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 05:31:35.378971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 05:31:35.378971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 05:31:35.378971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 05:31:35.378971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 05:31:35.378971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 05:31:35.378971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 05:31:35.378971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 05:31:35.378971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 26 05:31:35.378971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:35.378971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 26 05:31:35.378971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:35.378971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:35.378971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 26 05:31:35.378971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 26 05:31:35.378971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 26 05:31:35.378971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 26 05:31:35.385214 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 05:31:35.385214 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application next(self.gen) Sep 26 05:31:35.385214 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 26 05:31:35.385214 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application yield resource Sep 26 05:31:35.385214 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 05:31:35.385214 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application next(self.gen) Sep 26 05:31:35.385214 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 26 05:31:35.385214 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self.session.rollback() Sep 26 05:31:35.385214 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 26 05:31:35.385214 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self.force_reraise() Sep 26 05:31:35.385214 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 26 05:31:35.385214 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise self.value Sep 26 05:31:35.385214 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 26 05:31:35.385214 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 26 05:31:35.385214 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 26 05:31:35.385214 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application session.commit() Sep 26 05:31:35.385214 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 26 05:31:35.386316 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 26 05:31:35.386316 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 26 05:31:35.386316 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._prepare_impl() Sep 26 05:31:35.386316 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 26 05:31:35.386316 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self.session.flush() Sep 26 05:31:35.386316 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 26 05:31:35.386316 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._flush(objects) Sep 26 05:31:35.386316 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 26 05:31:35.386316 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 26 05:31:35.386316 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 26 05:31:35.386316 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application compat.raise_( Sep 26 05:31:35.386316 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 05:31:35.386316 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception Sep 26 05:31:35.386316 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 26 05:31:35.386316 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application flush_context.execute() Sep 26 05:31:35.386316 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 26 05:31:35.386316 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rec.execute(self) Sep 26 05:31:35.389112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 26 05:31:35.389112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 26 05:31:35.389112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 26 05:31:35.389112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 26 05:31:35.389112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 26 05:31:35.389112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 26 05:31:35.389112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 26 05:31:35.389112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 26 05:31:35.389112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 26 05:31:35.389112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 26 05:31:35.389112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 26 05:31:35.389112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 26 05:31:35.389112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 26 05:31:35.389112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 26 05:31:35.389112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 26 05:31:35.391077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 26 05:31:35.391077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 05:31:35.391077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception Sep 26 05:31:35.391077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 05:31:35.391077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 05:31:35.391077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 05:31:35.391077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 05:31:35.391077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 05:31:35.391077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 05:31:35.391077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 05:31:35.391077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application conn.query(q) Sep 26 05:31:35.391077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 05:31:35.391077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 05:31:35.391077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 05:31:35.391077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application result.read() Sep 26 05:31:35.391077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 05:31:35.391077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 05:31:35.393402 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 05:31:35.393402 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 05:31:35.393402 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 05:31:35.393402 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 05:31:35.393402 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 05:31:35.393402 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 05:31:35.393402 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 26 05:31:35.393402 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 26 05:31:35.393402 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [parameters: {'id': 'f83e248d6d0640289cc1529a6ed5e4da', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 26 05:31:35.393402 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 26 05:31:35.393402 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:35.393402 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:31:35.393402 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:35.393402 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:35.393402 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 26 05:31:35.398001 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 26 05:31:35.398001 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 26 05:31:35.398001 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 26 05:31:35.398001 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 26 05:31:35.398001 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:35.398001 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:31:35.398001 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:35.398001 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:35.398001 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:35.398001 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:35.398001 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:35.398001 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:35.398001 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:35.398001 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:35.398001 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:35.398001 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:35.398001 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:35.400353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:35.400353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 26 05:31:35.400353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 26 05:31:35.400353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:35.400353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:35.400353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 26 05:31:35.400353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 26 05:31:35.400353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f83e248d6d0640289cc1529a6ed5e4da. Sep 26 05:31:35.400353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:35.400353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 467/936] 10.222.0.66 () {60 vars in 1140 bytes} [Mon Sep 26 05:31:35 2022] POST /identity/v3/projects => generated 262 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:31:35.400353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e6934-b87c-4c76-85f3-af26cacea2f4 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:35.418111 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652890ad-e46f-448c-b6b1-3df9aa60eb04 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:35.462253 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521d6c4-1509-484b-baea-bc45357deaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:35.463378 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521d6c4-1509-484b-baea-bc45357deaa7 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:35.463936 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521d6c4-1509-484b-baea-bc45357deaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:35.464668 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521d6c4-1509-484b-baea-bc45357deaa7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:35.465604 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521d6c4-1509-484b-baea-bc45357deaa7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:35.467471 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521d6c4-1509-484b-baea-bc45357deaa7 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:35.479528 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-d521d6c4-1509-484b-baea-bc45357deaa7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 05:31:35.479528 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:35.479528 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:31:35.479528 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:31:35.479528 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:31:35.479528 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:31:35.479528 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:31:35.479528 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:35.479528 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 05:31:35.479528 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:35.479528 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:31:35.479528 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:35.479528 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:35.479528 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:35.479528 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:35.479528 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:35.480657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:35.480657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:35.480657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:35.480657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:35.480657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:35.480657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:35.480657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:35.480657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:31:35.480657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:31:35.480657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:31:35.480657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:31:35.480657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:35.480657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:35.480657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:35.480657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:35.480657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:35.480657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:35.481677 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:35.481677 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:35.481677 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:35.481677 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:35.481677 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:35.481677 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:35.481677 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:35.481677 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:35.481677 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:35.481677 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:35.481677 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:31:35.481677 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:35.481677 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 26 05:31:35.481677 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:35.485265 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 470/937] 10.222.0.66 () {56 vars in 1132 bytes} [Mon Sep 26 05:31:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:31:35.491663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521d6c4-1509-484b-baea-bc45357deaa7 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:35.535442 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e6934-b87c-4c76-85f3-af26cacea2f4 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:35.560148 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:35.591453 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ccb2a9-d7cd-410c-813b-2bcf8d99ec43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:35.592702 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ccb2a9-d7cd-410c-813b-2bcf8d99ec43 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:35.593170 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ccb2a9-d7cd-410c-813b-2bcf8d99ec43 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:35.593605 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ccb2a9-d7cd-410c-813b-2bcf8d99ec43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:35.605219 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ccb2a9-d7cd-410c-813b-2bcf8d99ec43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:35.608114 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ccb2a9-d7cd-410c-813b-2bcf8d99ec43 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:35.613310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:35.633511 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-e9ccb2a9-d7cd-410c-813b-2bcf8d99ec43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:31:35.633511 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:35.633511 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:35.633511 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:35.633511 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:35.633511 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:35.633511 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:35.633511 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:35.633511 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:35.633511 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:35.633511 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:35.633511 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:35.633511 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:31:35.633511 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:31:35.633511 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:31:35.634706 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:31:35.634706 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:35.634706 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:35.634706 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:35.634706 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:35.634706 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:35.634706 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:35.634706 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:35.634706 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:35.634706 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:35.634706 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:35.634706 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:35.634706 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:35.634706 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:35.634706 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:35.634706 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:35.634706 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:35.636034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:31:35.636034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:31:35.636034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:31:35.636034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:31:35.636034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:31:35.636034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:31:35.636034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:31:35.636034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:35.638362 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 468/938] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:31:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:31:35.644918 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ccb2a9-d7cd-410c-813b-2bcf8d99ec43 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:35.646289 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521d6c4-1509-484b-baea-bc45357deaa7 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:35.698581 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ebe8ea-204a-495b-ab1f-55b9567dfdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:35.699593 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebe8ea-204a-495b-ab1f-55b9567dfdcf None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:35.700055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebe8ea-204a-495b-ab1f-55b9567dfdcf None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:35.700481 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ebe8ea-204a-495b-ab1f-55b9567dfdcf None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:35.701510 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ebe8ea-204a-495b-ab1f-55b9567dfdcf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:35.702359 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ebe8ea-204a-495b-ab1f-55b9567dfdcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:35.704195 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ebe8ea-204a-495b-ab1f-55b9567dfdcf None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:35.714121 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 471/939] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Sep 26 05:31:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:31:35.715464 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e54c4-3555-460c-8001-a00c2da50788 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:35.715907 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e54c4-3555-460c-8001-a00c2da50788 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:35.716082 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596e54c4-3555-460c-8001-a00c2da50788 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:35.717689 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 472/940] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:35.720823 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e54c4-3555-460c-8001-a00c2da50788 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:35.771075 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ccb2a9-d7cd-410c-813b-2bcf8d99ec43 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:35.812763 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1660c533-9eb2-4d75-932c-652b99015a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:35.813469 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660c533-9eb2-4d75-932c-652b99015a86 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:35.813761 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660c533-9eb2-4d75-932c-652b99015a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:35.814030 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1660c533-9eb2-4d75-932c-652b99015a86 None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:35.814803 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660c533-9eb2-4d75-932c-652b99015a86 None admin] RBAC: Adding query filter params (name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:35.815202 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660c533-9eb2-4d75-932c-652b99015a86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:35.817363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1660c533-9eb2-4d75-932c-652b99015a86 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:35.849984 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 469/941] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Sep 26 05:31:35 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:35.849984 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b80e9-4459-417f-9e4b-90004830fa4d None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:35.849984 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b80e9-4459-417f-9e4b-90004830fa4d None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:35.849984 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b80e9-4459-417f-9e4b-90004830fa4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:35.862264 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596e54c4-3555-460c-8001-a00c2da50788 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:35.871011 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-1b7b80e9-4459-417f-9e4b-90004830fa4d None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:35.873923 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1b7b80e9-4459-417f-9e4b-90004830fa4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:35.880278 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:35.908584 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c61838-6be4-4776-9346-9bcbba90ab93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:35.909913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c61838-6be4-4776-9346-9bcbba90ab93 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:35.910320 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c61838-6be4-4776-9346-9bcbba90ab93 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:35.910688 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c61838-6be4-4776-9346-9bcbba90ab93 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:35.911460 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c61838-6be4-4776-9346-9bcbba90ab93 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:35.911897 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c61838-6be4-4776-9346-9bcbba90ab93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:35.913536 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c61838-6be4-4776-9346-9bcbba90ab93 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:35.926764 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 473/942] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Sep 26 05:31:35 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:35.928272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c61838-6be4-4776-9346-9bcbba90ab93 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:35.968902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:35.991764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 470/943] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:31:36.091347 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c61838-6be4-4776-9346-9bcbba90ab93 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:36.130826 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876f3f2-4b55-4f4a-8ac8-d7da485889b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:36.131487 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876f3f2-4b55-4f4a-8ac8-d7da485889b5 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:36.131836 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876f3f2-4b55-4f4a-8ac8-d7da485889b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:36.132105 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0876f3f2-4b55-4f4a-8ac8-d7da485889b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:36.132782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876f3f2-4b55-4f4a-8ac8-d7da485889b5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:36.134175 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0876f3f2-4b55-4f4a-8ac8-d7da485889b5 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:36.158340 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 474/944] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:31:35 2022] POST /identity/v3/endpoints => generated 347 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:31:36.346031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b80e9-4459-417f-9e4b-90004830fa4d None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:36.492824 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b80e9-4459-417f-9e4b-90004830fa4d None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:36.536946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852ddc2-4cfd-4d08-aa9d-63a2815213ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:36.538456 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852ddc2-4cfd-4d08-aa9d-63a2815213ea None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:36.538951 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852ddc2-4cfd-4d08-aa9d-63a2815213ea None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:36.539414 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852ddc2-4cfd-4d08-aa9d-63a2815213ea None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:36.540225 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852ddc2-4cfd-4d08-aa9d-63a2815213ea None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:36.541836 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852ddc2-4cfd-4d08-aa9d-63a2815213ea None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:36.551749 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-4852ddc2-4cfd-4d08-aa9d-63a2815213ea None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 05:31:36.551749 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:36.551749 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:31:36.551749 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:31:36.551749 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:31:36.551749 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:31:36.551749 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:31:36.551749 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:36.551749 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 05:31:36.551749 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:36.551749 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:31:36.551749 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:36.551749 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:36.551749 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:36.551749 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:36.551749 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:36.551749 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:36.552816 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:36.552816 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:36.552816 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:36.552816 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:36.552816 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:36.552816 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:36.552816 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:31:36.552816 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:31:36.552816 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:31:36.552816 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:31:36.552816 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:36.552816 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:36.552816 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:36.552816 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:36.552816 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:36.552816 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:36.553720 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:36.553720 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:36.553720 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:36.553720 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:36.553720 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:36.553720 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:36.553720 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:36.553720 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:36.553720 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:36.553720 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:36.553720 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:31:36.553720 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:36.553720 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 05:31:36.553720 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:36.556581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 471/945] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Sep 26 05:31:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:31:36.565533 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876f3f2-4b55-4f4a-8ac8-d7da485889b5 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:36.623145 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:36.716822 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0876f3f2-4b55-4f4a-8ac8-d7da485889b5 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:36.764124 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ecfb9-76b7-45c3-8462-9c6074a4e170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:36.764778 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ecfb9-76b7-45c3-8462-9c6074a4e170 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:36.765052 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ecfb9-76b7-45c3-8462-9c6074a4e170 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:36.765322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ecfb9-76b7-45c3-8462-9c6074a4e170 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:36.765978 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ecfb9-76b7-45c3-8462-9c6074a4e170 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:36.766279 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ecfb9-76b7-45c3-8462-9c6074a4e170 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:36.767716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ecfb9-76b7-45c3-8462-9c6074a4e170 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:36.776526 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 475/946] 10.222.0.66 () {56 vars in 1122 bytes} [Mon Sep 26 05:31:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:36.785623 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852ddc2-4cfd-4d08-aa9d-63a2815213ea None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:36.880119 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:36.971790 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852ddc2-4cfd-4d08-aa9d-63a2815213ea None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:37.015170 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76c5e2-54dc-4453-87a0-506721ec2755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:37.015985 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76c5e2-54dc-4453-87a0-506721ec2755 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:37.016264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76c5e2-54dc-4453-87a0-506721ec2755 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:37.016534 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76c5e2-54dc-4453-87a0-506721ec2755 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:37.017196 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76c5e2-54dc-4453-87a0-506721ec2755 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:37.017499 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76c5e2-54dc-4453-87a0-506721ec2755 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:37.018943 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb76c5e2-54dc-4453-87a0-506721ec2755 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:37.025658 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 472/947] 10.222.0.66 () {56 vars in 1122 bytes} [Mon Sep 26 05:31:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:37.031964 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ecfb9-76b7-45c3-8462-9c6074a4e170 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:37.143115 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:37.153266 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ecfb9-76b7-45c3-8462-9c6074a4e170 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:37.212159 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75630b30-fbc1-4a06-993d-6c3efc18bed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:37.212787 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75630b30-fbc1-4a06-993d-6c3efc18bed8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:37.213062 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75630b30-fbc1-4a06-993d-6c3efc18bed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:37.213391 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75630b30-fbc1-4a06-993d-6c3efc18bed8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:37.214676 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75630b30-fbc1-4a06-993d-6c3efc18bed8 None admin] RBAC: Adding query filter params (interface=public, service_id=fb5c32cafd6c4016937a81f113dc0fe9, region_id=RegionOne) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:37.215066 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75630b30-fbc1-4a06-993d-6c3efc18bed8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:37.217455 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75630b30-fbc1-4a06-993d-6c3efc18bed8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:37.227657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 476/948] 10.222.0.66 () {56 vars in 1251 bytes} [Mon Sep 26 05:31:37 2022] GET /identity/v3/endpoints?service_id=fb5c32cafd6c4016937a81f113dc0fe9&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:37.233261 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76c5e2-54dc-4453-87a0-506721ec2755 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:37.372845 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76c5e2-54dc-4453-87a0-506721ec2755 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:37.402151 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:37.432885 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8f868-f41b-48ce-8161-c3b5506f1c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:37.435763 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8f868-f41b-48ce-8161-c3b5506f1c21 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:37.435763 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8f868-f41b-48ce-8161-c3b5506f1c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:37.435763 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8f868-f41b-48ce-8161-c3b5506f1c21 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:37.435763 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc8f868-f41b-48ce-8161-c3b5506f1c21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:37.436278 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc8f868-f41b-48ce-8161-c3b5506f1c21 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:37.443011 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 473/949] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Sep 26 05:31:37 2022] GET /identity/v3/services => generated 1497 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:31:37.572662 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d665d7-e07c-40a8-a719-9fdbf59ba135 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:37.574160 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d665d7-e07c-40a8-a719-9fdbf59ba135 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:37.574966 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d665d7-e07c-40a8-a719-9fdbf59ba135 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:37.578513 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 477/950] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:37.588697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2403c-e018-4b36-8649-d1cfb4e5aad6 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:37.590399 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2403c-e018-4b36-8649-d1cfb4e5aad6 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:37.591160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2403c-e018-4b36-8649-d1cfb4e5aad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:37.622007 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-59e2403c-e018-4b36-8649-d1cfb4e5aad6 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:37.623254 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-59e2403c-e018-4b36-8649-d1cfb4e5aad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:37.702976 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 474/951] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:31:38.160100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d665d7-e07c-40a8-a719-9fdbf59ba135 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:38.343706 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d665d7-e07c-40a8-a719-9fdbf59ba135 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:38.407041 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5910897d-2eb3-46ed-a82f-26b7963e4093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:38.407751 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910897d-2eb3-46ed-a82f-26b7963e4093 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:38.408033 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910897d-2eb3-46ed-a82f-26b7963e4093 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:38.408303 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5910897d-2eb3-46ed-a82f-26b7963e4093 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:38.422618 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5910897d-2eb3-46ed-a82f-26b7963e4093 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:31:38.428356 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-5910897d-2eb3-46ed-a82f-26b7963e4093 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 05:31:38.428356 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:38.428356 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:38.428356 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:38.428356 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:38.428356 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:38.428356 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:38.428356 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:38.428356 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:38.428356 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:38.428356 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:38.428356 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:38.428356 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:31:38.428356 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:31:38.428356 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:31:38.428356 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:31:38.429492 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:31:38.429492 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:31:38.429492 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:31:38.429492 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:31:38.429492 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:38.429492 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:38.429492 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:38.429492 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:38.429492 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:38.429492 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:38.429492 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:38.429492 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:38.429492 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:38.429492 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:38.429492 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:38.429492 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:38.430380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:38.430380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:38.430380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:38.430380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:38.430380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:31:38.430380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:31:38.430380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:31:38.430380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:31:38.430380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:31:38.430380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:31:38.430380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 05:31:38.430380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:38.431302 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 478/952] 10.222.0.66 () {56 vars in 1120 bytes} [Mon Sep 26 05:31:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:38.440709 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2403c-e018-4b36-8649-d1cfb4e5aad6 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:38.568972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0881b07-9f15-423e-9953-dc0bef2c99cc None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:38.569289 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0881b07-9f15-423e-9953-dc0bef2c99cc None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:38.569564 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0881b07-9f15-423e-9953-dc0bef2c99cc None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:38.571186 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 479/953] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:31:38.576981 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eddcf9-85fc-45d8-b4fc-4eaa2b28a559 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:38.577640 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eddcf9-85fc-45d8-b4fc-4eaa2b28a559 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:38.577640 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eddcf9-85fc-45d8-b4fc-4eaa2b28a559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:38.599865 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-16eddcf9-85fc-45d8-b4fc-4eaa2b28a559 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:38.601118 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-16eddcf9-85fc-45d8-b4fc-4eaa2b28a559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:38.617038 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:38.629835 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2403c-e018-4b36-8649-d1cfb4e5aad6 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:38.647266 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:38.677807 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514710fc-6cc0-41f7-a3a7-3c8e99bbbb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:38.678930 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514710fc-6cc0-41f7-a3a7-3c8e99bbbb68 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:38.679206 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514710fc-6cc0-41f7-a3a7-3c8e99bbbb68 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:38.679471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514710fc-6cc0-41f7-a3a7-3c8e99bbbb68 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:38.680179 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514710fc-6cc0-41f7-a3a7-3c8e99bbbb68 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:38.680472 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514710fc-6cc0-41f7-a3a7-3c8e99bbbb68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:38.681838 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514710fc-6cc0-41f7-a3a7-3c8e99bbbb68 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:38.691031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 475/955] 10.222.0.66 () {56 vars in 1115 bytes} [Mon Sep 26 05:31:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:38.691310 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 480/955] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 05:31:38.698732 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91d970-94c7-49b0-a20d-0ec9f388202f None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:38.698732 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91d970-94c7-49b0-a20d-0ec9f388202f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:38.698732 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91d970-94c7-49b0-a20d-0ec9f388202f None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:38.698732 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 476/956] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:38.702356 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f04b08-0263-4347-a86c-46cb3e354ebb None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:38.703113 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f04b08-0263-4347-a86c-46cb3e354ebb None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:38.703839 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f04b08-0263-4347-a86c-46cb3e354ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:38.712639 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91d970-94c7-49b0-a20d-0ec9f388202f None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:38.736173 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-23f04b08-0263-4347-a86c-46cb3e354ebb None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:38.737891 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-23f04b08-0263-4347-a86c-46cb3e354ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:38.830866 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 481/957] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:31:38.893083 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91d970-94c7-49b0-a20d-0ec9f388202f None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:38.955031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6676b-e440-4cf8-bf82-8e1eb685394b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:38.956640 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6676b-e440-4cf8-bf82-8e1eb685394b None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:38.957418 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6676b-e440-4cf8-bf82-8e1eb685394b None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:38.958148 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6676b-e440-4cf8-bf82-8e1eb685394b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:38.980067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd6676b-e440-4cf8-bf82-8e1eb685394b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:38.983308 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd6676b-e440-4cf8-bf82-8e1eb685394b None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:39.005705 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f04b08-0263-4347-a86c-46cb3e354ebb None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:39.012102 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-7cd6676b-e440-4cf8-bf82-8e1eb685394b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:39.012102 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:39.012102 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:39.012102 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:39.012102 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:39.012102 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:39.012102 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:39.012102 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:39.012102 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:39.012102 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:39.012102 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:39.012102 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:39.012102 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:31:39.012102 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:31:39.012102 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:31:39.012102 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:31:39.014031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:39.014031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:39.014031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:39.014031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:39.014031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:39.014031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:39.014031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:39.014031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:39.014031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:39.014031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:39.014031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:39.014031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:39.014031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:39.014031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:39.014031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:39.014031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:39.014031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:31:39.015826 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:31:39.015826 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:39.015826 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:39.018976 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 477/958] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:39.029123 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6676b-e440-4cf8-bf82-8e1eb685394b None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:39.076192 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:39.105413 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:39.129591 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f04b08-0263-4347-a86c-46cb3e354ebb None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:39.179539 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33858dc6-7a44-41bc-b902-e9bf8010f035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:39.179539 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33858dc6-7a44-41bc-b902-e9bf8010f035 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:39.179539 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33858dc6-7a44-41bc-b902-e9bf8010f035 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:39.179539 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33858dc6-7a44-41bc-b902-e9bf8010f035 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:39.180371 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33858dc6-7a44-41bc-b902-e9bf8010f035 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:39.181678 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33858dc6-7a44-41bc-b902-e9bf8010f035 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:39.191412 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-33858dc6-7a44-41bc-b902-e9bf8010f035 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 05:31:39.191412 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:39.191412 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:31:39.191412 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:31:39.191412 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:31:39.191412 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:31:39.191412 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:31:39.191412 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:39.191412 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 05:31:39.191412 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:39.191412 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:31:39.191412 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:39.191412 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:39.191412 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:39.191412 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:39.191412 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:39.191412 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:39.193550 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:39.193550 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:39.193550 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:39.193550 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:39.193550 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:39.193550 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:39.193550 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:31:39.193550 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:31:39.193550 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:31:39.193550 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:31:39.193550 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:39.193550 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:39.193550 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:39.193550 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:39.193550 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:39.193550 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:39.195243 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:39.195243 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:39.195243 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:39.195243 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:39.195243 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:39.195243 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:39.195243 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:39.195243 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:39.195243 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:39.195243 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:39.195243 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:31:39.195243 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:39.195243 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 05:31:39.195243 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:39.195243 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 482/959] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:31:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:31:39.198717 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33858dc6-7a44-41bc-b902-e9bf8010f035 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:39.228678 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6676b-e440-4cf8-bf82-8e1eb685394b None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:39.264792 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497062cb-3dee-4110-a339-934a1d542f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:39.265411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497062cb-3dee-4110-a339-934a1d542f06 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:39.265682 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497062cb-3dee-4110-a339-934a1d542f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:39.265939 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497062cb-3dee-4110-a339-934a1d542f06 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:39.266591 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497062cb-3dee-4110-a339-934a1d542f06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:39.266888 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497062cb-3dee-4110-a339-934a1d542f06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:39.268313 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497062cb-3dee-4110-a339-934a1d542f06 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:39.281393 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 478/960] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:39.282245 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497062cb-3dee-4110-a339-934a1d542f06 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:39.377605 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33858dc6-7a44-41bc-b902-e9bf8010f035 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:39.394385 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:39.418995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497062cb-3dee-4110-a339-934a1d542f06 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:39.426131 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70676455-46e0-4231-a77d-7d9ed6040291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:39.427142 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70676455-46e0-4231-a77d-7d9ed6040291 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:39.427640 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70676455-46e0-4231-a77d-7d9ed6040291 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:39.428200 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70676455-46e0-4231-a77d-7d9ed6040291 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:39.429634 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70676455-46e0-4231-a77d-7d9ed6040291 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:39.430168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70676455-46e0-4231-a77d-7d9ed6040291 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:39.432812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70676455-46e0-4231-a77d-7d9ed6040291 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:39.442318 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 483/961] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Sep 26 05:31:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:39.442318 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70676455-46e0-4231-a77d-7d9ed6040291 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:39.463945 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec24fb-a34e-4187-816c-431b0bc107a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:39.464234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:39.464731 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec24fb-a34e-4187-816c-431b0bc107a5 None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:39.465079 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec24fb-a34e-4187-816c-431b0bc107a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:39.465415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec24fb-a34e-4187-816c-431b0bc107a5 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:39.466120 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec24fb-a34e-4187-816c-431b0bc107a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:39.467663 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec24fb-a34e-4187-816c-431b0bc107a5 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:39.486522 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.sql.core [None req-4fec24fb-a34e-4187-816c-431b0bc107a5 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 26 05:31:39.486522 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 26 05:31:39.486522 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [parameters: {'user_id': '581342c9db7542fc9624b9b8ff9d64e8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 26 05:31:39.486522 dv-cinder-836083-14-smb devstack@keystone.service[81682]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81682) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 26 05:31:39.499315 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-4fec24fb-a34e-4187-816c-431b0bc107a5 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 26 05:31:39.499315 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:39.499315 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 05:31:39.499315 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 05:31:39.499315 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 05:31:39.499315 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 05:31:39.499315 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 05:31:39.499315 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 05:31:39.499315 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 05:31:39.499315 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application conn.query(q) Sep 26 05:31:39.499315 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 05:31:39.499315 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 05:31:39.499315 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 05:31:39.499315 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application result.read() Sep 26 05:31:39.499315 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 05:31:39.500392 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 05:31:39.500392 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 05:31:39.500392 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 05:31:39.500392 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 05:31:39.500392 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 05:31:39.500392 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 05:31:39.500392 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 05:31:39.500392 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 26 05:31:39.500392 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:39.500392 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 26 05:31:39.500392 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:39.500392 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:39.500392 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 26 05:31:39.500392 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 26 05:31:39.500392 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 26 05:31:39.500392 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 26 05:31:39.500392 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 05:31:39.500392 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application next(self.gen) Sep 26 05:31:39.501463 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 26 05:31:39.501463 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application yield resource Sep 26 05:31:39.501463 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 26 05:31:39.501463 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application next(self.gen) Sep 26 05:31:39.501463 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 26 05:31:39.501463 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self.session.rollback() Sep 26 05:31:39.501463 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 26 05:31:39.501463 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self.force_reraise() Sep 26 05:31:39.501463 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 26 05:31:39.501463 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise self.value Sep 26 05:31:39.501463 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 26 05:31:39.501463 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 26 05:31:39.501463 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 26 05:31:39.501463 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application session.commit() Sep 26 05:31:39.501463 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 26 05:31:39.501463 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 26 05:31:39.501463 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 26 05:31:39.502404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._prepare_impl() Sep 26 05:31:39.502404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 26 05:31:39.502404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self.session.flush() Sep 26 05:31:39.502404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 26 05:31:39.502404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._flush(objects) Sep 26 05:31:39.502404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 26 05:31:39.502404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 26 05:31:39.502404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 26 05:31:39.502404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application compat.raise_( Sep 26 05:31:39.502404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 05:31:39.502404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception Sep 26 05:31:39.502404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 26 05:31:39.502404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application flush_context.execute() Sep 26 05:31:39.502404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 26 05:31:39.502404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rec.execute(self) Sep 26 05:31:39.502404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 26 05:31:39.502404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 26 05:31:39.503357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 26 05:31:39.503357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 26 05:31:39.503357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 26 05:31:39.503357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 26 05:31:39.503357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 26 05:31:39.503357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 26 05:31:39.503357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 26 05:31:39.503357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 26 05:31:39.503357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 26 05:31:39.503357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 26 05:31:39.503357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 26 05:31:39.503357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 26 05:31:39.503357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 26 05:31:39.503357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 26 05:31:39.503357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 26 05:31:39.503357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception Sep 26 05:31:39.504302 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 26 05:31:39.504302 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 26 05:31:39.504302 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 26 05:31:39.504302 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 26 05:31:39.504302 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 26 05:31:39.504302 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application result = self._query(query) Sep 26 05:31:39.504302 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 26 05:31:39.504302 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application conn.query(q) Sep 26 05:31:39.504302 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 26 05:31:39.504302 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 26 05:31:39.504302 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 26 05:31:39.504302 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application result.read() Sep 26 05:31:39.504302 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 26 05:31:39.504302 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 26 05:31:39.504302 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 26 05:31:39.504302 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 26 05:31:39.505170 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 26 05:31:39.505170 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 26 05:31:39.505170 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 26 05:31:39.505170 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 26 05:31:39.505170 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 26 05:31:39.505170 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 26 05:31:39.505170 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [parameters: {'user_id': '581342c9db7542fc9624b9b8ff9d64e8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 26 05:31:39.505170 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 26 05:31:39.505170 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:39.505170 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:31:39.505170 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:39.505170 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:39.505170 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:39.505170 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:39.505170 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:39.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:39.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:39.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:39.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:39.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:39.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:39.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:39.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 26 05:31:39.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 26 05:31:39.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:39.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:39.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:31:39.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:31:39.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:31:39.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:31:39.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 26 05:31:39.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 26 05:31:39.507223 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 26 05:31:39.507223 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 26 05:31:39.507223 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 26 05:31:39.507223 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 26 05:31:39.507223 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 26 05:31:39.507223 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:39.507223 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 479/962] 10.222.0.66 () {60 vars in 1131 bytes} [Mon Sep 26 05:31:39 2022] POST /identity/v3/users => generated 160 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:39.507223 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec24fb-a34e-4187-816c-431b0bc107a5 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:39.634866 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70676455-46e0-4231-a77d-7d9ed6040291 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:39.636392 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec24fb-a34e-4187-816c-431b0bc107a5 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:39.682172 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544791fd-77b5-4c4f-8aef-072555013eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:39.682804 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544791fd-77b5-4c4f-8aef-072555013eff None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:39.683077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544791fd-77b5-4c4f-8aef-072555013eff None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:39.683351 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544791fd-77b5-4c4f-8aef-072555013eff None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:39.684017 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544791fd-77b5-4c4f-8aef-072555013eff None admin] RBAC: Adding query filter params (type=compute) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:39.684323 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544791fd-77b5-4c4f-8aef-072555013eff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:39.685933 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544791fd-77b5-4c4f-8aef-072555013eff None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:39.692707 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535c5be-fbc3-40cb-91c0-76c956ab31d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:39.693353 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535c5be-fbc3-40cb-91c0-76c956ab31d1 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:39.693634 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535c5be-fbc3-40cb-91c0-76c956ab31d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:39.693903 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535c5be-fbc3-40cb-91c0-76c956ab31d1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:39.703145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 480/963] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Sep 26 05:31:39 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:39.704257 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544791fd-77b5-4c4f-8aef-072555013eff None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:39.713171 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535c5be-fbc3-40cb-91c0-76c956ab31d1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:39.715812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535c5be-fbc3-40cb-91c0-76c956ab31d1 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:39.725172 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:39.744535 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-f535c5be-fbc3-40cb-91c0-76c956ab31d1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 05:31:39.744535 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:39.744535 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:39.744535 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:39.744535 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:39.744535 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:39.744535 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:39.744535 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:39.744535 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:39.744535 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:39.744535 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:39.744535 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:39.744535 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:31:39.744535 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:31:39.744535 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:31:39.744535 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:31:39.745923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:39.745923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:39.745923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:31:39.745923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:31:39.745923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:31:39.745923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:31:39.745923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:39.745923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:39.745923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:39.745923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:39.745923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:39.745923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:39.745923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:39.745923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:39.745923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:39.745923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:39.745923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:39.745923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:39.747092 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:39.747092 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:39.747092 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:31:39.747092 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:31:39.747092 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:31:39.747092 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:31:39.747092 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:31:39.747092 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:31:39.747092 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 26 05:31:39.747092 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:39.751979 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 484/964] 10.222.0.66 () {56 vars in 1117 bytes} [Mon Sep 26 05:31:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:39.756198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535c5be-fbc3-40cb-91c0-76c956ab31d1 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:39.847310 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:39.899526 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544791fd-77b5-4c4f-8aef-072555013eff None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:39.911888 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535c5be-fbc3-40cb-91c0-76c956ab31d1 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:39.947714 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a386ec75-690d-4d2c-ab15-2f2ede56507d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:39.948513 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386ec75-690d-4d2c-ab15-2f2ede56507d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:39.948793 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386ec75-690d-4d2c-ab15-2f2ede56507d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:39.949066 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a386ec75-690d-4d2c-ab15-2f2ede56507d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:39.959413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386ec75-690d-4d2c-ab15-2f2ede56507d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:39.960992 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a386ec75-690d-4d2c-ab15-2f2ede56507d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:39.974411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-a386ec75-690d-4d2c-ab15-2f2ede56507d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 05:31:39.974411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:39.974411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:39.974411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:39.974411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:39.974411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:39.974411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:39.974411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:39.974411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:39.974411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:39.974411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:39.974411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:39.974411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:31:39.974411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:31:39.974411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:31:39.974411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:31:39.975697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:39.975697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:39.975697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:31:39.975697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:31:39.975697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:31:39.975697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:31:39.975697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:39.975697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:39.975697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:39.975697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:39.975697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:39.975697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:39.975697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:39.975697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:39.975697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:39.975697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:39.975697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:39.975697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:39.977555 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:39.977555 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:39.977555 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:31:39.977555 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:31:39.977555 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:31:39.977555 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:31:39.977555 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:31:39.977555 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:31:39.977555 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 26 05:31:39.977555 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:39.977555 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 481/965] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:31:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:39.978227 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a624d-e9ed-49f8-9367-a73c31c6b2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:39.978227 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a624d-e9ed-49f8-9367-a73c31c6b2da None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:39.978227 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a624d-e9ed-49f8-9367-a73c31c6b2da None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:39.978227 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a624d-e9ed-49f8-9367-a73c31c6b2da None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:39.979663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a624d-e9ed-49f8-9367-a73c31c6b2da None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:39.980258 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a624d-e9ed-49f8-9367-a73c31c6b2da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:39.982156 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad023c-d935-4f6a-a117-58da4a0f8274 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:39.982447 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad023c-d935-4f6a-a117-58da4a0f8274 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:39.982693 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad023c-d935-4f6a-a117-58da4a0f8274 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:39.983088 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7a624d-e9ed-49f8-9367-a73c31c6b2da None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:39.987809 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 482/966] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:39.987809 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad023c-d935-4f6a-a117-58da4a0f8274 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:40.013400 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 485/967] 10.222.0.66 () {56 vars in 1149 bytes} [Mon Sep 26 05:31:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:40.014754 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d950017-035a-4190-aaf1-fee0b07d9ae0 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:40.015031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d950017-035a-4190-aaf1-fee0b07d9ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:40.015296 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d950017-035a-4190-aaf1-fee0b07d9ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:40.037128 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-0d950017-035a-4190-aaf1-fee0b07d9ae0 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:40.038411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0d950017-035a-4190-aaf1-fee0b07d9ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:40.111141 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:40.136166 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 486/968] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:31:40.137277 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d950017-035a-4190-aaf1-fee0b07d9ae0 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:40.185822 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad023c-d935-4f6a-a117-58da4a0f8274 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:40.202069 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:40.257584 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2f32f-1399-4561-881d-c2aceacfe341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:40.258635 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2f32f-1399-4561-881d-c2aceacfe341 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:40.258973 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2f32f-1399-4561-881d-c2aceacfe341 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:40.259305 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb2f32f-1399-4561-881d-c2aceacfe341 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:40.260714 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb2f32f-1399-4561-881d-c2aceacfe341 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:40.261094 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb2f32f-1399-4561-881d-c2aceacfe341 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:40.262955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb2f32f-1399-4561-881d-c2aceacfe341 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:40.277846 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d950017-035a-4190-aaf1-fee0b07d9ae0 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:40.327028 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 483/969] 10.222.0.66 () {56 vars in 1101 bytes} [Mon Sep 26 05:31:39 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:40.343470 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972e2ca-1403-4ca5-98ce-9d1e768fd1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:40.344423 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972e2ca-1403-4ca5-98ce-9d1e768fd1c0 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:40.344824 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972e2ca-1403-4ca5-98ce-9d1e768fd1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:40.345253 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972e2ca-1403-4ca5-98ce-9d1e768fd1c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:40.414270 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2f32f-1399-4561-881d-c2aceacfe341 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:40.453953 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972e2ca-1403-4ca5-98ce-9d1e768fd1c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:40.457097 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972e2ca-1403-4ca5-98ce-9d1e768fd1c0 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:40.557450 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb2f32f-1399-4561-881d-c2aceacfe341 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:40.564883 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:40.592258 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:40.603231 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e43704-92fc-47ad-a7c5-2fd2168d29af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:40.604352 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e43704-92fc-47ad-a7c5-2fd2168d29af None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:40.604897 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e43704-92fc-47ad-a7c5-2fd2168d29af None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:40.605380 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e43704-92fc-47ad-a7c5-2fd2168d29af None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:40.606461 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e43704-92fc-47ad-a7c5-2fd2168d29af None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:40.607466 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e43704-92fc-47ad-a7c5-2fd2168d29af None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:40.618551 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-d5e43704-92fc-47ad-a7c5-2fd2168d29af None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 05:31:40.618551 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:40.618551 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:31:40.618551 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:31:40.618551 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:31:40.618551 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:31:40.618551 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:31:40.618551 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:40.618551 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 05:31:40.618551 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:40.618551 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:31:40.618551 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:40.618551 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:40.618551 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:40.618551 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:40.618551 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:40.618551 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:40.620077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:40.620077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:40.620077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:40.620077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:40.620077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:40.620077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:40.620077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:31:40.620077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:31:40.620077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:31:40.620077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:31:40.620077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:40.620077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:40.620077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:40.620077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:40.620077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:40.620077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:40.621003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:40.621003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:40.621003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:40.621003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:40.621003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:40.621003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:40.621003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:40.621003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:40.621003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:40.621003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:40.621003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:31:40.621003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:40.621003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 05:31:40.621003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:40.624940 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 484/970] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Sep 26 05:31:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:31:40.626073 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e43704-92fc-47ad-a7c5-2fd2168d29af None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:40.630703 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 487/971] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:31:40 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:31:40.636788 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972e2ca-1403-4ca5-98ce-9d1e768fd1c0 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:40.786004 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e43704-92fc-47ad-a7c5-2fd2168d29af None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:40.797882 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972e2ca-1403-4ca5-98ce-9d1e768fd1c0 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:40.839776 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d9ac9-afe1-4145-8e8a-e893876d4478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:40.840689 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d9ac9-afe1-4145-8e8a-e893876d4478 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:40.841229 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d9ac9-afe1-4145-8e8a-e893876d4478 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:40.841655 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d9ac9-afe1-4145-8e8a-e893876d4478 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:40.842058 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f22d1-0aef-4e56-a6a0-9e6f8ce161e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:40.843080 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f22d1-0aef-4e56-a6a0-9e6f8ce161e5 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:40.843556 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f22d1-0aef-4e56-a6a0-9e6f8ce161e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:40.844138 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f22d1-0aef-4e56-a6a0-9e6f8ce161e5 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:40.845251 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f22d1-0aef-4e56-a6a0-9e6f8ce161e5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:40.845758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f22d1-0aef-4e56-a6a0-9e6f8ce161e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:40.848257 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f22d1-0aef-4e56-a6a0-9e6f8ce161e5 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:40.855666 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d9ac9-afe1-4145-8e8a-e893876d4478 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:40.857007 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 485/972] 10.222.0.66 () {56 vars in 1122 bytes} [Mon Sep 26 05:31:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:31:40.857639 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d9ac9-afe1-4145-8e8a-e893876d4478 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:40.863486 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f22d1-0aef-4e56-a6a0-9e6f8ce161e5 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:40.899657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-f66d9ac9-afe1-4145-8e8a-e893876d4478 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:40.899657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:40.899657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:40.899657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:40.899657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:40.899657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:40.899657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:40.899657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:40.899657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:40.899657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:40.899657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:40.899657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:40.899657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:31:40.899657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:31:40.899657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:31:40.899657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:31:40.900767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:40.900767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:40.900767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:40.900767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:40.900767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:40.900767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:40.900767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:40.900767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:40.900767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:40.900767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:40.900767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:40.900767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:40.900767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:40.900767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:40.900767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:40.900767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:40.900767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:31:40.901707 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:31:40.901707 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:40.901707 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:40.901707 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 488/973] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:40.908525 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d9ac9-afe1-4145-8e8a-e893876d4478 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:40.923603 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:40.952478 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:41.021528 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f22d1-0aef-4e56-a6a0-9e6f8ce161e5 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:41.032457 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d9ac9-afe1-4145-8e8a-e893876d4478 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:41.074870 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc657b-db47-4381-8d78-2f7bd406b64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:41.075627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc657b-db47-4381-8d78-2f7bd406b64d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:41.075996 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc657b-db47-4381-8d78-2f7bd406b64d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:41.076273 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc657b-db47-4381-8d78-2f7bd406b64d None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:41.077310 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc657b-db47-4381-8d78-2f7bd406b64d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:41.077609 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc657b-db47-4381-8d78-2f7bd406b64d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:41.079282 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc657b-db47-4381-8d78-2f7bd406b64d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:41.082754 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a670b9f-74c0-4815-b314-e55d67d8a8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:41.083670 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a670b9f-74c0-4815-b314-e55d67d8a8c5 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:41.084131 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a670b9f-74c0-4815-b314-e55d67d8a8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:41.084532 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a670b9f-74c0-4815-b314-e55d67d8a8c5 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:41.085580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a670b9f-74c0-4815-b314-e55d67d8a8c5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:41.086035 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a670b9f-74c0-4815-b314-e55d67d8a8c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:41.088283 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a670b9f-74c0-4815-b314-e55d67d8a8c5 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:41.096166 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 489/974] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:31:41.099814 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 486/975] 10.222.0.66 () {56 vars in 1122 bytes} [Mon Sep 26 05:31:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:41.103023 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc657b-db47-4381-8d78-2f7bd406b64d None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:41.105244 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a670b9f-74c0-4815-b314-e55d67d8a8c5 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:41.181379 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:41.234440 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc657b-db47-4381-8d78-2f7bd406b64d None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:41.247031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a670b9f-74c0-4815-b314-e55d67d8a8c5 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:41.266404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:41.281052 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586f4ff-fa71-41a4-9032-f43a6b70316f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:41.282320 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586f4ff-fa71-41a4-9032-f43a6b70316f None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:41.282727 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586f4ff-fa71-41a4-9032-f43a6b70316f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:41.283402 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586f4ff-fa71-41a4-9032-f43a6b70316f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:41.284761 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586f4ff-fa71-41a4-9032-f43a6b70316f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:41.287299 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7586f4ff-fa71-41a4-9032-f43a6b70316f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:41.289342 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a0bfe-c412-4220-b22c-c9d92c4fe4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:41.290067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a0bfe-c412-4220-b22c-c9d92c4fe4b8 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:41.290415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a0bfe-c412-4220-b22c-c9d92c4fe4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:41.290754 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a0bfe-c412-4220-b22c-c9d92c4fe4b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:41.299300 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a0bfe-c412-4220-b22c-c9d92c4fe4b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:41.300896 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a0bfe-c412-4220-b22c-c9d92c4fe4b8 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:41.317086 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-886a0bfe-c412-4220-b22c-c9d92c4fe4b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:31:41.317086 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:41.317086 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:41.317086 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:41.317086 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:41.317086 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:41.317086 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:41.317086 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:41.317086 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:41.317086 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:41.317086 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:41.317086 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:41.317086 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:31:41.317086 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:31:41.317086 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:31:41.318783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:31:41.318783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:41.318783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:41.318783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:41.318783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:41.318783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:41.318783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:41.318783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:41.318783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:41.318783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:41.318783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:41.318783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:41.318783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:41.318783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:41.318783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:41.318783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:41.318783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:41.321380 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:31:41.321380 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:31:41.321380 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:31:41.321380 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:31:41.321380 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:31:41.321380 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:31:41.321380 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:31:41.321380 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:41.321380 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 487/976] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:31:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:41.324460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a0bfe-c412-4220-b22c-c9d92c4fe4b8 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:41.336362 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 490/977] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:31:41 2022] POST /identity/v3/endpoints => generated 349 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:31:41.461159 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a0bfe-c412-4220-b22c-c9d92c4fe4b8 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:41.537990 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f815564d-07fd-4a20-810b-81c55926913b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:41.538997 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815564d-07fd-4a20-810b-81c55926913b None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:41.539429 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815564d-07fd-4a20-810b-81c55926913b None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:41.539759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f815564d-07fd-4a20-810b-81c55926913b None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:41.541069 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815564d-07fd-4a20-810b-81c55926913b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:41.541497 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815564d-07fd-4a20-810b-81c55926913b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:41.544100 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f815564d-07fd-4a20-810b-81c55926913b None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:41.567576 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 488/978] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:31:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:31:41.576065 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586f4ff-fa71-41a4-9032-f43a6b70316f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:41.718171 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586f4ff-fa71-41a4-9032-f43a6b70316f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:41.762201 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:41.783393 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a395f709-9d5e-4cd4-a5a3-906fc351424a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:41.784187 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395f709-9d5e-4cd4-a5a3-906fc351424a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:41.784538 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395f709-9d5e-4cd4-a5a3-906fc351424a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:41.785017 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a395f709-9d5e-4cd4-a5a3-906fc351424a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:41.786416 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395f709-9d5e-4cd4-a5a3-906fc351424a None admin] RBAC: Adding query filter params (role.id=630ba0cecaa24efeb65159717bf41ac7, scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8, user.id=5bdaf32400b94aa291ad43a3131e1d0a) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:41.786868 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395f709-9d5e-4cd4-a5a3-906fc351424a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:41.789720 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a395f709-9d5e-4cd4-a5a3-906fc351424a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:41.807834 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 491/979] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:31:41 2022] GET /identity/v3/role_assignments?user.id=5bdaf32400b94aa291ad43a3131e1d0a&scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8&role.id=630ba0cecaa24efeb65159717bf41ac7 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:42.139896 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943c127-f297-41f3-95b6-4bf8e8d64e45 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:42.140446 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943c127-f297-41f3-95b6-4bf8e8d64e45 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:42.140446 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943c127-f297-41f3-95b6-4bf8e8d64e45 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:42.141723 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 489/980] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:31:42.148012 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a15da0-4065-49c2-9e75-a802ea017565 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:42.148346 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a15da0-4065-49c2-9e75-a802ea017565 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:42.148603 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a15da0-4065-49c2-9e75-a802ea017565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:42.168688 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-99a15da0-4065-49c2-9e75-a802ea017565 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:42.169898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-99a15da0-4065-49c2-9e75-a802ea017565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:42.281784 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 492/981] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:31:42.787115 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943c127-f297-41f3-95b6-4bf8e8d64e45 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:42.838480 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:42.914011 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943c127-f297-41f3-95b6-4bf8e8d64e45 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:42.952637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63663341-db80-459f-9df2-f78eb357dc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:42.953664 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63663341-db80-459f-9df2-f78eb357dc35 None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:42.954143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63663341-db80-459f-9df2-f78eb357dc35 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:42.954628 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63663341-db80-459f-9df2-f78eb357dc35 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:42.955667 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63663341-db80-459f-9df2-f78eb357dc35 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:42.957325 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63663341-db80-459f-9df2-f78eb357dc35 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:42.978100 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 490/982] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Sep 26 05:31:42 2022] POST /identity/v3/services => generated 242 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:31:43.919235 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2e85f-068a-42ef-a719-5cca81541b02 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:43.919884 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2e85f-068a-42ef-a719-5cca81541b02 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:43.920226 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2e85f-068a-42ef-a719-5cca81541b02 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:43.922807 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 493/983] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:43.932599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b42b7-99df-4412-8182-3d86395ef24b None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:43.933181 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b42b7-99df-4412-8182-3d86395ef24b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:43.933581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b42b7-99df-4412-8182-3d86395ef24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:43.966908 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-6f0b42b7-99df-4412-8182-3d86395ef24b None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:43.969616 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-6f0b42b7-99df-4412-8182-3d86395ef24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:44.112876 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 491/984] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:43 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:31:44.128666 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0035602-420d-4a36-a9dc-7393438dd653 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:44.128974 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0035602-420d-4a36-a9dc-7393438dd653 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:44.129279 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0035602-420d-4a36-a9dc-7393438dd653 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:44.130840 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 494/985] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:44.136577 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f755967-1724-4843-aaf7-2621aa93ad49 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:44.136882 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f755967-1724-4843-aaf7-2621aa93ad49 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:44.137124 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f755967-1724-4843-aaf7-2621aa93ad49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:44.156909 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-2f755967-1724-4843-aaf7-2621aa93ad49 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:44.158111 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2f755967-1724-4843-aaf7-2621aa93ad49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:44.174763 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:44.258842 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 492/986] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:44 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:31:44.423366 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0035602-420d-4a36-a9dc-7393438dd653 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:44.541094 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0035602-420d-4a36-a9dc-7393438dd653 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:44.561220 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:44.582462 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e638a5-dc22-4744-8943-614515e07f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:44.583123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e638a5-dc22-4744-8943-614515e07f54 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:44.583412 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e638a5-dc22-4744-8943-614515e07f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:44.583678 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e638a5-dc22-4744-8943-614515e07f54 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:44.584312 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e638a5-dc22-4744-8943-614515e07f54 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:44.585999 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e638a5-dc22-4744-8943-614515e07f54 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:44.596364 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-62e638a5-dc22-4744-8943-614515e07f54 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 05:31:44.596364 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:44.596364 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:31:44.596364 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:31:44.596364 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:31:44.596364 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:31:44.596364 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:31:44.596364 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:44.596364 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 05:31:44.596364 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:44.596364 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:31:44.596364 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:44.596364 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:44.596364 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:44.596364 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:44.596364 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:44.596364 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:44.600373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:44.600373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:44.600373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:44.600373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:44.600373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:44.600373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:44.600373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:31:44.600373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:31:44.600373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:31:44.600373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:31:44.600373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:44.600373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:44.600373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:44.600373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:44.600373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:44.600373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:44.601328 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:44.601328 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:44.601328 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:44.601328 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:44.601328 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:44.601328 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:44.601328 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:44.601328 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:44.601328 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:44.601328 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:44.601328 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:31:44.601328 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:44.601328 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 05:31:44.601328 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:44.601328 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 495/987] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Sep 26 05:31:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:44.604971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f755967-1724-4843-aaf7-2621aa93ad49 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:44.712399 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e638a5-dc22-4744-8943-614515e07f54 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:44.733783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f755967-1724-4843-aaf7-2621aa93ad49 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:44.796404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ecf3f-ebcc-445a-9ce0-37486d4c4b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:44.797813 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ecf3f-ebcc-445a-9ce0-37486d4c4b64 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:44.798299 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ecf3f-ebcc-445a-9ce0-37486d4c4b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:44.798781 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ecf3f-ebcc-445a-9ce0-37486d4c4b64 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:44.799949 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ecf3f-ebcc-445a-9ce0-37486d4c4b64 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:44.800478 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ecf3f-ebcc-445a-9ce0-37486d4c4b64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:44.803103 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ecf3f-ebcc-445a-9ce0-37486d4c4b64 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:44.811566 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 493/988] 10.222.0.66 () {56 vars in 1122 bytes} [Mon Sep 26 05:31:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:44.820588 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ecf3f-ebcc-445a-9ce0-37486d4c4b64 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:44.838485 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:44.873190 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e638a5-dc22-4744-8943-614515e07f54 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:44.927652 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8fe0b-cc2e-459e-86a1-fa1011cc1224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:44.929082 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8fe0b-cc2e-459e-86a1-fa1011cc1224 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:44.929082 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8fe0b-cc2e-459e-86a1-fa1011cc1224 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:44.929082 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8fe0b-cc2e-459e-86a1-fa1011cc1224 None admin] PATH_INFO: `/v3/services/image` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:44.929628 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8fe0b-cc2e-459e-86a1-fa1011cc1224 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:44.931027 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a8fe0b-cc2e-459e-86a1-fa1011cc1224 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:44.940663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-45a8fe0b-cc2e-459e-86a1-fa1011cc1224 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 05:31:44.940663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:44.940663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:31:44.940663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:31:44.940663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:31:44.940663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:31:44.940663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:31:44.940663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:44.940663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 05:31:44.940663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:44.940663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:31:44.940663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:44.940663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:44.940663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:44.940663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:44.940663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:44.940663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:44.942627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:44.942627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:44.942627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:44.942627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:44.942627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:44.942627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:44.942627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:31:44.942627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:31:44.942627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:31:44.942627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:31:44.942627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:44.942627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:44.942627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:44.942627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:44.942627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:44.942627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:44.944735 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:44.944735 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:44.944735 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:44.944735 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:44.944735 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:44.944735 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:44.944735 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:44.944735 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:44.944735 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:44.944735 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:44.944735 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:31:44.944735 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:44.944735 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 05:31:44.944735 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:44.944735 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 496/989] 10.222.0.66 () {56 vars in 1105 bytes} [Mon Sep 26 05:31:44 2022] GET /identity/v3/services/image => generated 86 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:44.948077 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8fe0b-cc2e-459e-86a1-fa1011cc1224 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:44.954573 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ecf3f-ebcc-445a-9ce0-37486d4c4b64 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:44.998178 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753bee65-e52d-44e2-b01c-d2a84f6455be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:44.999580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bee65-e52d-44e2-b01c-d2a84f6455be None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:45.000097 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bee65-e52d-44e2-b01c-d2a84f6455be None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:45.000565 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bee65-e52d-44e2-b01c-d2a84f6455be None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:45.001724 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753bee65-e52d-44e2-b01c-d2a84f6455be None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:45.002224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753bee65-e52d-44e2-b01c-d2a84f6455be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:45.004732 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753bee65-e52d-44e2-b01c-d2a84f6455be None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:45.006710 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:45.019836 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 494/990] 10.222.0.66 () {56 vars in 1122 bytes} [Mon Sep 26 05:31:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:31:45.025310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753bee65-e52d-44e2-b01c-d2a84f6455be None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:45.079614 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a8fe0b-cc2e-459e-86a1-fa1011cc1224 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:45.140804 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ce7be-a32a-499e-acc8-4b4dc9f545bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:45.141944 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ce7be-a32a-499e-acc8-4b4dc9f545bf None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:45.142402 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ce7be-a32a-499e-acc8-4b4dc9f545bf None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:45.142867 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ce7be-a32a-499e-acc8-4b4dc9f545bf None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:45.143913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ce7be-a32a-499e-acc8-4b4dc9f545bf None admin] RBAC: Adding query filter params (name=image) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:45.144376 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ce7be-a32a-499e-acc8-4b4dc9f545bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:45.145456 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:45.146777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ce7be-a32a-499e-acc8-4b4dc9f545bf None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:45.156528 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 497/991] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:45.163309 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ce7be-a32a-499e-acc8-4b4dc9f545bf None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:45.173718 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753bee65-e52d-44e2-b01c-d2a84f6455be None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:45.226049 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38401cef-d9a5-4574-9b41-c51bed22121c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:45.227075 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38401cef-d9a5-4574-9b41-c51bed22121c None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:45.227346 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38401cef-d9a5-4574-9b41-c51bed22121c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:45.227608 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38401cef-d9a5-4574-9b41-c51bed22121c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:45.229336 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38401cef-d9a5-4574-9b41-c51bed22121c None admin] RBAC: Adding query filter params (interface=admin, service_id=fb5c32cafd6c4016937a81f113dc0fe9, region_id=RegionOne) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:45.229742 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38401cef-d9a5-4574-9b41-c51bed22121c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:45.231374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38401cef-d9a5-4574-9b41-c51bed22121c None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:45.239529 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 495/992] 10.222.0.66 () {56 vars in 1249 bytes} [Mon Sep 26 05:31:45 2022] GET /identity/v3/endpoints?service_id=fb5c32cafd6c4016937a81f113dc0fe9&interface=admin®ion_id=RegionOne => generated 193 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:45.248881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38401cef-d9a5-4574-9b41-c51bed22121c None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:45.323990 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ce7be-a32a-499e-acc8-4b4dc9f545bf None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:45.343334 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:45.373330 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6a3b4-4cd9-48f4-9fb8-856375ba3c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:45.373954 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6a3b4-4cd9-48f4-9fb8-856375ba3c68 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:45.374230 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6a3b4-4cd9-48f4-9fb8-856375ba3c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:45.374497 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6a3b4-4cd9-48f4-9fb8-856375ba3c68 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:45.375127 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6a3b4-4cd9-48f4-9fb8-856375ba3c68 None admin] RBAC: Adding query filter params (type=image) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:45.375425 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6a3b4-4cd9-48f4-9fb8-856375ba3c68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:45.376862 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6a3b4-4cd9-48f4-9fb8-856375ba3c68 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:45.381668 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 498/993] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:45 2022] GET /identity/v3/services?type=image => generated 122 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:45.382960 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a834170-12db-4d0a-98aa-5f2c2193751d None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:45.383279 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a834170-12db-4d0a-98aa-5f2c2193751d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:45.383508 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a834170-12db-4d0a-98aa-5f2c2193751d None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:45.389033 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 499/994] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:45.389236 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38401cef-d9a5-4574-9b41-c51bed22121c None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:45.390692 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171bbec-d5c3-4291-b65f-b75738e85e52 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:45.390970 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171bbec-d5c3-4291-b65f-b75738e85e52 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:45.391263 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3171bbec-d5c3-4291-b65f-b75738e85e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:45.412450 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-3171bbec-d5c3-4291-b65f-b75738e85e52 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:45.414060 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3171bbec-d5c3-4291-b65f-b75738e85e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:45.434887 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b962ca4-3942-41f7-baba-fe5e4690cffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:45.435776 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b962ca4-3942-41f7-baba-fe5e4690cffd None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:45.435904 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b962ca4-3942-41f7-baba-fe5e4690cffd None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:45.436109 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b962ca4-3942-41f7-baba-fe5e4690cffd None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:45.436699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b962ca4-3942-41f7-baba-fe5e4690cffd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:45.438116 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b962ca4-3942-41f7-baba-fe5e4690cffd None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:45.455790 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 496/995] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Sep 26 05:31:45 2022] GET /identity/v3/services => generated 1727 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:31:45.516779 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 500/996] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:45 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 05:31:45.786369 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b962ca4-3942-41f7-baba-fe5e4690cffd None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:45.796176 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:45.915487 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b962ca4-3942-41f7-baba-fe5e4690cffd None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:45.967953 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f77ff-85c9-454d-ace2-79d7d06bd9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:45.968891 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f77ff-85c9-454d-ace2-79d7d06bd9d2 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:45.969052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f77ff-85c9-454d-ace2-79d7d06bd9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:45.969394 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f77ff-85c9-454d-ace2-79d7d06bd9d2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:45.969886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f77ff-85c9-454d-ace2-79d7d06bd9d2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:45.971694 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f77ff-85c9-454d-ace2-79d7d06bd9d2 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:45.984700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-105f77ff-85c9-454d-ace2-79d7d06bd9d2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 05:31:45.984700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:45.984700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:31:45.984700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:31:45.984700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:31:45.984700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:31:45.984700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:31:45.984700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:45.984700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 05:31:45.984700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:45.984700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:31:45.984700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:45.984700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:45.984700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:45.984700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:45.984700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:45.984700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:45.986518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:45.986518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:45.986518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:45.986518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:45.986518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:45.986518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:45.986518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:31:45.986518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:31:45.986518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:31:45.986518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:31:45.986518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:45.986518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:45.986518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:45.986518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:45.986518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:45.986518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:45.988231 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:45.988231 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:45.988231 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:45.988231 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:45.988231 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:45.988231 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:45.988231 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:45.988231 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:45.988231 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:45.988231 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:45.988231 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:31:45.988231 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:45.988231 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 05:31:45.988231 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:45.988231 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 497/997] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:31:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:31:45.997858 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171bbec-d5c3-4291-b65f-b75738e85e52 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:46.163043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3171bbec-d5c3-4291-b65f-b75738e85e52 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:46.166549 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:46.216800 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090fdca-9755-4857-ae5c-609b99368a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:46.217935 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090fdca-9755-4857-ae5c-609b99368a3d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:46.218499 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090fdca-9755-4857-ae5c-609b99368a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:46.219009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090fdca-9755-4857-ae5c-609b99368a3d None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:46.220107 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090fdca-9755-4857-ae5c-609b99368a3d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:46.220419 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090fdca-9755-4857-ae5c-609b99368a3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:46.222330 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090fdca-9755-4857-ae5c-609b99368a3d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:46.229518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 501/998] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Sep 26 05:31:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:46.237005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f77ff-85c9-454d-ace2-79d7d06bd9d2 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:46.354588 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:46.424487 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f77ff-85c9-454d-ace2-79d7d06bd9d2 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:46.476813 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa56a5d-dc50-4434-b0a9-97d3c7c6d785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:46.478152 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa56a5d-dc50-4434-b0a9-97d3c7c6d785 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:46.478657 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa56a5d-dc50-4434-b0a9-97d3c7c6d785 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:46.479325 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa56a5d-dc50-4434-b0a9-97d3c7c6d785 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:46.480561 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa56a5d-dc50-4434-b0a9-97d3c7c6d785 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:46.481236 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa56a5d-dc50-4434-b0a9-97d3c7c6d785 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:46.483342 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa56a5d-dc50-4434-b0a9-97d3c7c6d785 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:46.492077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 498/999] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Sep 26 05:31:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:46.500453 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090fdca-9755-4857-ae5c-609b99368a3d None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:46.646036 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090fdca-9755-4857-ae5c-609b99368a3d None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:46.710211 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc77b6-38e3-47db-8dfb-2d354dc8fd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:46.711394 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc77b6-38e3-47db-8dfb-2d354dc8fd1d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:46.711642 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc77b6-38e3-47db-8dfb-2d354dc8fd1d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:46.711966 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc77b6-38e3-47db-8dfb-2d354dc8fd1d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:46.712742 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc77b6-38e3-47db-8dfb-2d354dc8fd1d None admin] RBAC: Adding query filter params (interface=public, service_id=7ed6cefbe65b440db264698aabb56254, region_id=RegionOne) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:46.713077 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc77b6-38e3-47db-8dfb-2d354dc8fd1d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:46.714484 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc77b6-38e3-47db-8dfb-2d354dc8fd1d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:46.720951 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 502/1000] 10.222.0.66 () {56 vars in 1251 bytes} [Mon Sep 26 05:31:46 2022] GET /identity/v3/endpoints?service_id=7ed6cefbe65b440db264698aabb56254&interface=public®ion_id=RegionOne => generated 194 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:46.727133 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa56a5d-dc50-4434-b0a9-97d3c7c6d785 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:46.840731 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa56a5d-dc50-4434-b0a9-97d3c7c6d785 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:46.876999 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17f837-4225-4eff-a5d4-2116faf8673f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:46.877610 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17f837-4225-4eff-a5d4-2116faf8673f None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:46.877895 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17f837-4225-4eff-a5d4-2116faf8673f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:46.878133 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17f837-4225-4eff-a5d4-2116faf8673f None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:46.878770 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17f837-4225-4eff-a5d4-2116faf8673f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:46.880139 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17f837-4225-4eff-a5d4-2116faf8673f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:46.881445 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:46.891895 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 499/1001] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Sep 26 05:31:46 2022] GET /identity/v3/services => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:31:47.614667 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6612e-745c-4845-8714-7d069226b2f7 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:47.616059 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6612e-745c-4845-8714-7d069226b2f7 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:47.616559 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6612e-745c-4845-8714-7d069226b2f7 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:47.618643 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 503/1002] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:47.625919 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89eba5-4402-420a-919a-e7a4b605dd7f None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:47.626852 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89eba5-4402-420a-919a-e7a4b605dd7f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:47.627413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89eba5-4402-420a-919a-e7a4b605dd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:47.648208 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-bf89eba5-4402-420a-919a-e7a4b605dd7f None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:47.649784 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-bf89eba5-4402-420a-919a-e7a4b605dd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:47.741524 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 500/1003] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:47 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:31:47.776989 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf1a98-af5c-4a45-8ed8-f60d9ae9e785 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:47.777345 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf1a98-af5c-4a45-8ed8-f60d9ae9e785 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:47.777556 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf1a98-af5c-4a45-8ed8-f60d9ae9e785 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:47.779109 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 504/1004] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:47.785174 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f07ed4-4ab0-433a-a642-ff59c89e9c3e None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:47.785519 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f07ed4-4ab0-433a-a642-ff59c89e9c3e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:47.785709 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f07ed4-4ab0-433a-a642-ff59c89e9c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:47.805663 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-b3f07ed4-4ab0-433a-a642-ff59c89e9c3e None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:47.806883 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b3f07ed4-4ab0-433a-a642-ff59c89e9c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:47.892616 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 501/1005] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:47 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:31:48.018901 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf1a98-af5c-4a45-8ed8-f60d9ae9e785 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:48.052752 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:48.139585 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf1a98-af5c-4a45-8ed8-f60d9ae9e785 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:48.164836 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f07ed4-4ab0-433a-a642-ff59c89e9c3e None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:48.176223 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bea9f2-0582-4465-bd97-4329464aa1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:48.176850 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bea9f2-0582-4465-bd97-4329464aa1c6 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:48.177169 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bea9f2-0582-4465-bd97-4329464aa1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:48.177446 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bea9f2-0582-4465-bd97-4329464aa1c6 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:48.178090 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bea9f2-0582-4465-bd97-4329464aa1c6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:48.179543 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bea9f2-0582-4465-bd97-4329464aa1c6 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:48.199776 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 505/1006] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Sep 26 05:31:48 2022] POST /identity/v3/services => generated 242 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:31:48.240473 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:48.289747 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f07ed4-4ab0-433a-a642-ff59c89e9c3e None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:48.336526 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66cf4c-16b2-4bd8-8b8f-4df38c242616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:48.337198 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66cf4c-16b2-4bd8-8b8f-4df38c242616 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:48.337475 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66cf4c-16b2-4bd8-8b8f-4df38c242616 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:48.337744 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66cf4c-16b2-4bd8-8b8f-4df38c242616 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:48.338341 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66cf4c-16b2-4bd8-8b8f-4df38c242616 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:48.339776 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66cf4c-16b2-4bd8-8b8f-4df38c242616 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:48.349546 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-0d66cf4c-16b2-4bd8-8b8f-4df38c242616 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 05:31:48.349546 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:48.349546 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:31:48.349546 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:31:48.349546 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:31:48.349546 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:31:48.349546 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:31:48.349546 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:48.349546 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 05:31:48.349546 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:48.349546 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:31:48.349546 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:48.349546 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:48.349546 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:48.349546 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:48.349546 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:48.349546 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:48.350669 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:48.350669 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:48.350669 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:48.350669 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:48.350669 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:48.350669 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:48.350669 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:31:48.350669 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:31:48.350669 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:31:48.350669 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:31:48.350669 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:48.350669 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:48.350669 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:48.350669 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:48.350669 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:48.350669 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:48.352860 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:48.352860 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:48.352860 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:48.352860 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:48.352860 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:48.352860 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:48.352860 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:48.352860 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:48.352860 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:48.352860 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:48.352860 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:31:48.352860 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:48.352860 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 26 05:31:48.352860 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:48.352860 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 502/1007] 10.222.0.66 () {56 vars in 1126 bytes} [Mon Sep 26 05:31:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:31:48.357504 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bea9f2-0582-4465-bd97-4329464aa1c6 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:48.457148 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:48.467289 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bea9f2-0582-4465-bd97-4329464aa1c6 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:48.502538 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf0ed0-e488-4600-990f-3fd836faed4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:48.503154 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf0ed0-e488-4600-990f-3fd836faed4d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:48.503424 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf0ed0-e488-4600-990f-3fd836faed4d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:48.503685 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf0ed0-e488-4600-990f-3fd836faed4d None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:48.504337 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf0ed0-e488-4600-990f-3fd836faed4d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:48.504634 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf0ed0-e488-4600-990f-3fd836faed4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:48.506002 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf0ed0-e488-4600-990f-3fd836faed4d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:48.512663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 506/1008] 10.222.0.66 () {56 vars in 1122 bytes} [Mon Sep 26 05:31:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:48.517823 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66cf4c-16b2-4bd8-8b8f-4df38c242616 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:48.623834 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66cf4c-16b2-4bd8-8b8f-4df38c242616 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:48.641725 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:48.660535 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634d861-258a-4bad-b3cd-e4accd65dbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:48.661191 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634d861-258a-4bad-b3cd-e4accd65dbf5 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:48.661459 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634d861-258a-4bad-b3cd-e4accd65dbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:48.661796 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634d861-258a-4bad-b3cd-e4accd65dbf5 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:48.662464 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5634d861-258a-4bad-b3cd-e4accd65dbf5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:48.662847 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5634d861-258a-4bad-b3cd-e4accd65dbf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:48.664302 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5634d861-258a-4bad-b3cd-e4accd65dbf5 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:48.670380 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 503/1009] 10.222.0.66 () {56 vars in 1122 bytes} [Mon Sep 26 05:31:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:48.676365 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf0ed0-e488-4600-990f-3fd836faed4d None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:48.791957 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf0ed0-e488-4600-990f-3fd836faed4d None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:48.827999 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2528c-81f9-487a-81ab-f044197b8e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:48.828610 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2528c-81f9-487a-81ab-f044197b8e13 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:48.828877 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2528c-81f9-487a-81ab-f044197b8e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:48.829144 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2528c-81f9-487a-81ab-f044197b8e13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:48.829800 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd2528c-81f9-487a-81ab-f044197b8e13 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:48.831174 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd2528c-81f9-487a-81ab-f044197b8e13 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:48.848579 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 507/1010] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:31:48 2022] POST /identity/v3/endpoints => generated 325 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:31:49.145487 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156b32f-44de-4615-9ff6-7a24102564f3 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:49.145697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156b32f-44de-4615-9ff6-7a24102564f3 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:49.145975 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156b32f-44de-4615-9ff6-7a24102564f3 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:49.147351 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 504/1011] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:49.153325 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb5539-e674-4954-9a91-2a52f95fe829 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:49.153616 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb5539-e674-4954-9a91-2a52f95fe829 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:49.153874 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb5539-e674-4954-9a91-2a52f95fe829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:49.173264 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-5feb5539-e674-4954-9a91-2a52f95fe829 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:49.174470 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5feb5539-e674-4954-9a91-2a52f95fe829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:49.190695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:49.278178 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 508/1012] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:49 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:31:49.541406 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156b32f-44de-4615-9ff6-7a24102564f3 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:49.653622 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156b32f-44de-4615-9ff6-7a24102564f3 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:49.695209 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44aef2-1d87-47f0-9a61-f0e9b25d0593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:49.695905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44aef2-1d87-47f0-9a61-f0e9b25d0593 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:49.696364 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44aef2-1d87-47f0-9a61-f0e9b25d0593 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:49.696657 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c44aef2-1d87-47f0-9a61-f0e9b25d0593 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:49.697440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44aef2-1d87-47f0-9a61-f0e9b25d0593 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:49.698924 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c44aef2-1d87-47f0-9a61-f0e9b25d0593 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:49.713034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-7c44aef2-1d87-47f0-9a61-f0e9b25d0593 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 05:31:49.713034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:49.713034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:31:49.713034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:31:49.713034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:31:49.713034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:31:49.713034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:31:49.713034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:49.713034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 05:31:49.713034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:49.713034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:31:49.713034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:49.713034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:49.713034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:49.713034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:49.713034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:49.713034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:49.714283 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:49.714283 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:49.714283 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:49.714283 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:49.714283 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:49.714283 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:49.714283 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:31:49.714283 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:31:49.714283 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:31:49.714283 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:31:49.714283 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:49.714283 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:49.714283 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:49.714283 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:49.714283 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:49.714283 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:49.715289 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:49.715289 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:49.715289 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:49.715289 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:49.715289 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:49.715289 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:49.715289 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:49.715289 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:49.715289 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:49.715289 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:49.715289 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:31:49.715289 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:49.715289 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 26 05:31:49.715289 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:49.715289 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 505/1013] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:31:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:49.721030 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb5539-e674-4954-9a91-2a52f95fe829 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:49.836810 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb5539-e674-4954-9a91-2a52f95fe829 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:49.883537 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f089cad-f28c-4059-bd70-d754124f3984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:49.884186 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f089cad-f28c-4059-bd70-d754124f3984 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:49.884471 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f089cad-f28c-4059-bd70-d754124f3984 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:49.884729 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f089cad-f28c-4059-bd70-d754124f3984 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:49.885364 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f089cad-f28c-4059-bd70-d754124f3984 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:49.885662 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f089cad-f28c-4059-bd70-d754124f3984 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:49.887064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f089cad-f28c-4059-bd70-d754124f3984 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:49.892572 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 509/1014] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Sep 26 05:31:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:49.898801 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44aef2-1d87-47f0-9a61-f0e9b25d0593 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:49.960762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:50.029283 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c44aef2-1d87-47f0-9a61-f0e9b25d0593 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:50.067453 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267dce24-cefe-4c50-a926-e7c29c34a2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:50.068187 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dce24-cefe-4c50-a926-e7c29c34a2f3 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:50.068625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dce24-cefe-4c50-a926-e7c29c34a2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:50.069142 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267dce24-cefe-4c50-a926-e7c29c34a2f3 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:50.069836 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267dce24-cefe-4c50-a926-e7c29c34a2f3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:50.070133 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267dce24-cefe-4c50-a926-e7c29c34a2f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:50.071508 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267dce24-cefe-4c50-a926-e7c29c34a2f3 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:50.082906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 506/1015] 10.222.0.66 () {56 vars in 1112 bytes} [Mon Sep 26 05:31:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:50.084139 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f089cad-f28c-4059-bd70-d754124f3984 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:50.093558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:50.205196 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f089cad-f28c-4059-bd70-d754124f3984 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:50.246066 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a00606-f67d-4a6a-b0cc-351d7cee16aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:50.246972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a00606-f67d-4a6a-b0cc-351d7cee16aa None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:50.247397 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a00606-f67d-4a6a-b0cc-351d7cee16aa None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:50.247850 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a00606-f67d-4a6a-b0cc-351d7cee16aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:50.248675 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a00606-f67d-4a6a-b0cc-351d7cee16aa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:50.250211 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a00606-f67d-4a6a-b0cc-351d7cee16aa None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:50.273597 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 510/1016] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:31:50 2022] POST /identity/v3/endpoints => generated 334 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:31:50.418279 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefbc8d-d53d-4952-ba6a-55af9ca107ac None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:50.418551 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefbc8d-d53d-4952-ba6a-55af9ca107ac None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:50.418884 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cefbc8d-d53d-4952-ba6a-55af9ca107ac None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:50.420534 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 507/1017] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:50.426451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2e7b3-ae32-4a04-9824-5fa99c3bb0d4 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:50.426802 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2e7b3-ae32-4a04-9824-5fa99c3bb0d4 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:50.427023 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2e7b3-ae32-4a04-9824-5fa99c3bb0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:50.447471 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-20c2e7b3-ae32-4a04-9824-5fa99c3bb0d4 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:50.448824 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-20c2e7b3-ae32-4a04-9824-5fa99c3bb0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:50.520933 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:50.544076 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 511/1018] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:31:50.809626 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefbc8d-d53d-4952-ba6a-55af9ca107ac None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:50.949264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cefbc8d-d53d-4952-ba6a-55af9ca107ac None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:50.967909 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:51.000058 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d560a-d350-42cb-825f-86096eac35c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:51.000882 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d560a-d350-42cb-825f-86096eac35c5 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:51.001164 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d560a-d350-42cb-825f-86096eac35c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:51.001432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d560a-d350-42cb-825f-86096eac35c5 None admin] PATH_INFO: `/v3/services/image` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:51.002184 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d560a-d350-42cb-825f-86096eac35c5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:51.003685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83d560a-d350-42cb-825f-86096eac35c5 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:51.015581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-b83d560a-d350-42cb-825f-86096eac35c5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 05:31:51.015581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:51.015581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:31:51.015581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:31:51.015581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:31:51.015581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:31:51.015581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:31:51.015581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:51.015581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 05:31:51.015581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:51.015581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:31:51.015581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:51.015581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:51.015581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:51.015581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:51.015581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:51.015581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:51.016955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:51.016955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:51.016955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:51.016955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:51.016955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:51.016955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:51.016955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:31:51.016955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:31:51.016955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:31:51.016955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:31:51.016955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:51.016955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:51.016955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:51.016955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:51.016955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:51.016955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:51.017906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:51.017906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:51.017906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:51.017906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:51.017906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:51.017906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:51.017906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:51.017906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:51.017906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:51.017906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:51.017906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:31:51.017906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:51.017906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 05:31:51.017906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:51.017906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 508/1019] 10.222.0.66 () {56 vars in 1105 bytes} [Mon Sep 26 05:31:50 2022] GET /identity/v3/services/image => generated 86 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:51.026422 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2e7b3-ae32-4a04-9824-5fa99c3bb0d4 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:51.056873 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b518d0-7e84-4096-9f95-d749a4ac78a7 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:51.057304 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b518d0-7e84-4096-9f95-d749a4ac78a7 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:51.057680 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b518d0-7e84-4096-9f95-d749a4ac78a7 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:51.060008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 509/1020] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:31:51.067688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ceb91c-bda3-4a19-9ab3-dbaf4320a76f None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:51.068147 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ceb91c-bda3-4a19-9ab3-dbaf4320a76f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:51.068552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ceb91c-bda3-4a19-9ab3-dbaf4320a76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:51.093086 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-91ceb91c-bda3-4a19-9ab3-dbaf4320a76f None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:51.094731 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-91ceb91c-bda3-4a19-9ab3-dbaf4320a76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:51.158041 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2e7b3-ae32-4a04-9824-5fa99c3bb0d4 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:51.179182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 510/1021] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:51 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 05:31:51.203748 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe611e-6da4-4c83-aad8-b75bbc6ebed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:51.204388 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe611e-6da4-4c83-aad8-b75bbc6ebed5 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:51.204663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe611e-6da4-4c83-aad8-b75bbc6ebed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:51.204932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe611e-6da4-4c83-aad8-b75bbc6ebed5 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:51.205564 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe611e-6da4-4c83-aad8-b75bbc6ebed5 None admin] RBAC: Adding query filter params (name=image) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:51.205856 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe611e-6da4-4c83-aad8-b75bbc6ebed5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:51.207246 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe611e-6da4-4c83-aad8-b75bbc6ebed5 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:51.213392 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 512/1022] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:51.219172 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ceb91c-bda3-4a19-9ab3-dbaf4320a76f None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:51.332421 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ceb91c-bda3-4a19-9ab3-dbaf4320a76f None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:51.335793 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:51.373674 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1eecc-8c5f-43a6-89ba-57885cd254e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:51.374288 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1eecc-8c5f-43a6-89ba-57885cd254e0 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:51.374559 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1eecc-8c5f-43a6-89ba-57885cd254e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:51.374821 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1eecc-8c5f-43a6-89ba-57885cd254e0 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:51.375457 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1eecc-8c5f-43a6-89ba-57885cd254e0 None admin] RBAC: Adding query filter params (type=image) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:51.375788 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1eecc-8c5f-43a6-89ba-57885cd254e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:51.377211 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1eecc-8c5f-43a6-89ba-57885cd254e0 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:51.387587 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 511/1023] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:51.389771 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe611e-6da4-4c83-aad8-b75bbc6ebed5 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:51.451864 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:51.453356 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1eecc-8c5f-43a6-89ba-57885cd254e0 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:51.524164 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe611e-6da4-4c83-aad8-b75bbc6ebed5 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:51.566828 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1eecc-8c5f-43a6-89ba-57885cd254e0 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:51.570160 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a58fb-ac05-41ff-b124-3afcfb3889b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:51.570930 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a58fb-ac05-41ff-b124-3afcfb3889b9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:51.571199 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a58fb-ac05-41ff-b124-3afcfb3889b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:51.571477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a58fb-ac05-41ff-b124-3afcfb3889b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:51.572278 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a58fb-ac05-41ff-b124-3afcfb3889b9 None admin] RBAC: Adding query filter params (interface=public, service_id=f364c507c0f24e2a8ccd782256028755, region_id=RegionOne) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:51.572578 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a58fb-ac05-41ff-b124-3afcfb3889b9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:51.574498 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a58fb-ac05-41ff-b124-3afcfb3889b9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:51.588565 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 513/1024] 10.222.0.66 () {56 vars in 1251 bytes} [Mon Sep 26 05:31:51 2022] GET /identity/v3/endpoints?service_id=f364c507c0f24e2a8ccd782256028755&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:51.590607 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a58fb-ac05-41ff-b124-3afcfb3889b9 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:51.621361 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81be1db-e5f5-48a1-9a59-cd2c253a29e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:51.622035 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81be1db-e5f5-48a1-9a59-cd2c253a29e8 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:51.622260 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81be1db-e5f5-48a1-9a59-cd2c253a29e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:51.622525 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81be1db-e5f5-48a1-9a59-cd2c253a29e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:51.623701 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81be1db-e5f5-48a1-9a59-cd2c253a29e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:51.625165 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81be1db-e5f5-48a1-9a59-cd2c253a29e8 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:51.626788 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 512/1025] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:31:51.633034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81be1db-e5f5-48a1-9a59-cd2c253a29e8 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:51.683843 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:51.745792 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a58fb-ac05-41ff-b124-3afcfb3889b9 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:51.775631 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:51.776190 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81be1db-e5f5-48a1-9a59-cd2c253a29e8 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:51.796937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2e0d7-0886-4bb0-8171-3a06e54db23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:51.797567 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2e0d7-0886-4bb0-8171-3a06e54db23b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:51.797837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2e0d7-0886-4bb0-8171-3a06e54db23b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:51.798104 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2e0d7-0886-4bb0-8171-3a06e54db23b None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:51.798725 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2e0d7-0886-4bb0-8171-3a06e54db23b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:51.800191 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2e0d7-0886-4bb0-8171-3a06e54db23b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:51.807789 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 514/1026] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Sep 26 05:31:51 2022] GET /identity/v3/services => generated 1957 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:31:51.826157 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea9084-58a4-40f1-9925-79e2eba3e537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:51.827242 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea9084-58a4-40f1-9925-79e2eba3e537 None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:51.827433 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea9084-58a4-40f1-9925-79e2eba3e537 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:51.827860 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea9084-58a4-40f1-9925-79e2eba3e537 None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:51.828359 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea9084-58a4-40f1-9925-79e2eba3e537 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:51.829859 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea9084-58a4-40f1-9925-79e2eba3e537 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:51.871771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 513/1027] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Sep 26 05:31:51 2022] POST /identity/v3/projects => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:31:52.650153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bcb6e-6d8f-4ae2-99c4-bf9283293621 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:52.651336 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bcb6e-6d8f-4ae2-99c4-bf9283293621 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:52.651336 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bcb6e-6d8f-4ae2-99c4-bf9283293621 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:52.652101 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 515/1028] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:52.658103 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54065ee7-1950-45b5-bff0-2fc2dba114b4 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:52.658435 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54065ee7-1950-45b5-bff0-2fc2dba114b4 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:52.658661 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54065ee7-1950-45b5-bff0-2fc2dba114b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:52.678475 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-54065ee7-1950-45b5-bff0-2fc2dba114b4 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:52.679697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-54065ee7-1950-45b5-bff0-2fc2dba114b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:52.780080 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 514/1029] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:52 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:31:53.121350 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bcb6e-6d8f-4ae2-99c4-bf9283293621 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:53.227481 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bcb6e-6d8f-4ae2-99c4-bf9283293621 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:53.262291 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3cff19-9e42-498d-b88f-7f618498a3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:53.262918 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cff19-9e42-498d-b88f-7f618498a3c8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:53.263190 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cff19-9e42-498d-b88f-7f618498a3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:53.263454 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cff19-9e42-498d-b88f-7f618498a3c8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:53.273652 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3cff19-9e42-498d-b88f-7f618498a3c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:31:53.278380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-aa3cff19-9e42-498d-b88f-7f618498a3c8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 05:31:53.278380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:53.278380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:53.278380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:53.278380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:53.278380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:53.278380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:53.278380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:53.278380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:53.278380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:53.278380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:53.278380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:53.278380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:31:53.278380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:31:53.278380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:31:53.278380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:31:53.279372 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:31:53.279372 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:31:53.279372 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:31:53.279372 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:31:53.279372 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:53.279372 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:53.279372 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:53.279372 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:53.279372 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:53.279372 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:53.279372 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:53.279372 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:53.279372 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:53.279372 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:53.279372 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:53.279372 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:53.280259 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:53.280259 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:53.280259 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:53.280259 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:53.280259 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:31:53.280259 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:31:53.280259 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:31:53.280259 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:31:53.280259 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:31:53.280259 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:31:53.280259 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 05:31:53.280259 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:53.280259 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 516/1030] 10.222.0.66 () {56 vars in 1120 bytes} [Mon Sep 26 05:31:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:53.285606 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54065ee7-1950-45b5-bff0-2fc2dba114b4 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:53.304572 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:53.387037 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54065ee7-1950-45b5-bff0-2fc2dba114b4 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:53.424719 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306020a8-25d5-4774-905e-6021200b6d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:53.425332 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306020a8-25d5-4774-905e-6021200b6d7f None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:53.425602 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306020a8-25d5-4774-905e-6021200b6d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:53.425864 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306020a8-25d5-4774-905e-6021200b6d7f None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:53.426522 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306020a8-25d5-4774-905e-6021200b6d7f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:53.426811 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306020a8-25d5-4774-905e-6021200b6d7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:53.428228 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306020a8-25d5-4774-905e-6021200b6d7f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:53.436884 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 515/1031] 10.222.0.66 () {56 vars in 1115 bytes} [Mon Sep 26 05:31:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:31:53.442606 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3cff19-9e42-498d-b88f-7f618498a3c8 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:53.486777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:53.544753 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3cff19-9e42-498d-b88f-7f618498a3c8 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:53.578839 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc5d1b-a555-4fd0-9723-12978e093c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:53.579461 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc5d1b-a555-4fd0-9723-12978e093c7b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:53.579810 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc5d1b-a555-4fd0-9723-12978e093c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:53.580079 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc5d1b-a555-4fd0-9723-12978e093c7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:53.590477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc5d1b-a555-4fd0-9723-12978e093c7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:53.591975 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc5d1b-a555-4fd0-9723-12978e093c7b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:53.607580 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-87fc5d1b-a555-4fd0-9723-12978e093c7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:53.607580 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:53.607580 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:53.607580 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:53.607580 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:53.607580 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:53.607580 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:53.607580 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:53.607580 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:53.607580 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:53.607580 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:53.607580 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:53.607580 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:31:53.607580 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:31:53.607580 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:31:53.607580 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:31:53.608796 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:53.608796 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:53.608796 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:53.608796 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:53.608796 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:53.608796 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:53.608796 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:53.608796 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:53.608796 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:53.608796 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:53.608796 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:53.608796 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:53.608796 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:53.608796 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:53.608796 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:53.608796 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:53.608796 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:31:53.609721 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:31:53.609721 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:53.609721 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:53.610472 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 517/1032] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:53.614767 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306020a8-25d5-4774-905e-6021200b6d7f None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:53.702560 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:53.724674 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306020a8-25d5-4774-905e-6021200b6d7f None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:53.760409 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2491994-890d-4cdb-9cc5-e2548e66971f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:53.761009 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2491994-890d-4cdb-9cc5-e2548e66971f None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:53.761280 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2491994-890d-4cdb-9cc5-e2548e66971f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:53.761544 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2491994-890d-4cdb-9cc5-e2548e66971f None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:53.762183 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2491994-890d-4cdb-9cc5-e2548e66971f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:53.762474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2491994-890d-4cdb-9cc5-e2548e66971f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:53.763849 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2491994-890d-4cdb-9cc5-e2548e66971f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:53.780245 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 516/1033] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:53.783300 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc5d1b-a555-4fd0-9723-12978e093c7b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:53.881883 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:53.892036 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc5d1b-a555-4fd0-9723-12978e093c7b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:53.925593 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d38d96f-7226-4666-9d1f-7199a678c79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:53.926230 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38d96f-7226-4666-9d1f-7199a678c79b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:53.926506 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38d96f-7226-4666-9d1f-7199a678c79b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:53.926803 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38d96f-7226-4666-9d1f-7199a678c79b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:53.934864 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d38d96f-7226-4666-9d1f-7199a678c79b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:53.936357 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d38d96f-7226-4666-9d1f-7199a678c79b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:53.948464 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-5d38d96f-7226-4666-9d1f-7199a678c79b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:31:53.948464 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:53.948464 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:53.948464 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:53.948464 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:53.948464 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:53.948464 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:53.948464 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:53.948464 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:53.948464 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:53.948464 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:53.948464 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:53.948464 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:31:53.948464 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:31:53.948464 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:31:53.948464 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:31:53.949848 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:53.949848 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:53.949848 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:31:53.949848 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:31:53.949848 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:31:53.949848 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:31:53.949848 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:53.949848 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:53.949848 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:53.949848 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:53.949848 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:53.949848 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:53.949848 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:53.949848 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:53.949848 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:53.949848 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:53.949848 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:53.949848 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:53.951054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:53.951054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:53.951054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:31:53.951054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:31:53.951054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:31:53.951054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:31:53.951054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:31:53.951054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:31:53.951054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:31:53.951054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:53.951054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 518/1034] 10.222.0.66 () {56 vars in 1093 bytes} [Mon Sep 26 05:31:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:31:53.958676 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2491994-890d-4cdb-9cc5-e2548e66971f None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:54.075417 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2491994-890d-4cdb-9cc5-e2548e66971f None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:54.109986 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1bdab2-0057-4aa5-88f9-a97286ebf421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:54.110622 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bdab2-0057-4aa5-88f9-a97286ebf421 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:54.110896 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bdab2-0057-4aa5-88f9-a97286ebf421 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:54.111160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bdab2-0057-4aa5-88f9-a97286ebf421 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:54.111900 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1bdab2-0057-4aa5-88f9-a97286ebf421 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:54.112200 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1bdab2-0057-4aa5-88f9-a97286ebf421 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:54.113621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1bdab2-0057-4aa5-88f9-a97286ebf421 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:54.122846 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:54.134396 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80805e0-533e-4b52-b1da-4a0ced2d24b8 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:54.134706 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80805e0-533e-4b52-b1da-4a0ced2d24b8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:54.134868 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 517/1035] 10.222.0.66 () {56 vars in 1133 bytes} [Mon Sep 26 05:31:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:54.135300 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80805e0-533e-4b52-b1da-4a0ced2d24b8 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:54.136476 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb864cf-b37e-41f8-84ac-2adefc772460 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:54.136761 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb864cf-b37e-41f8-84ac-2adefc772460 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:54.136925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 519/1036] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:31:54.137008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb864cf-b37e-41f8-84ac-2adefc772460 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:54.138237 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80805e0-533e-4b52-b1da-4a0ced2d24b8 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:54.138411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 518/1037] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:31:54.143486 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6b192-4839-40b2-af40-b32fe5781184 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:54.143783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6b192-4839-40b2-af40-b32fe5781184 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:54.144050 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6b192-4839-40b2-af40-b32fe5781184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:54.162538 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-82d6b192-4839-40b2-af40-b32fe5781184 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:54.163713 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-82d6b192-4839-40b2-af40-b32fe5781184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:54.232720 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 519/1038] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 05:31:54.233908 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664887bf-9507-45c9-bb8d-dc0d5da2376b None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:54.234191 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664887bf-9507-45c9-bb8d-dc0d5da2376b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:54.234459 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664887bf-9507-45c9-bb8d-dc0d5da2376b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:54.244670 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80805e0-533e-4b52-b1da-4a0ced2d24b8 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:54.253072 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-664887bf-9507-45c9-bb8d-dc0d5da2376b None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:54.254269 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-664887bf-9507-45c9-bb8d-dc0d5da2376b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:54.284541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f79d81-3ac7-4961-82a4-0274e3c0a26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:54.285753 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f79d81-3ac7-4961-82a4-0274e3c0a26e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:54.286223 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f79d81-3ac7-4961-82a4-0274e3c0a26e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:54.286665 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f79d81-3ac7-4961-82a4-0274e3c0a26e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:54.313802 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:54.326079 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 520/1039] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:31:54.369204 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f79d81-3ac7-4961-82a4-0274e3c0a26e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:54.370673 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f79d81-3ac7-4961-82a4-0274e3c0a26e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:54.476139 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 520/1040] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:31:54 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:31:54.480440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664887bf-9507-45c9-bb8d-dc0d5da2376b None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:54.495539 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f79d81-3ac7-4961-82a4-0274e3c0a26e None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:54.546538 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:54.555467 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:54.611057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f79d81-3ac7-4961-82a4-0274e3c0a26e None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:54.611450 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664887bf-9507-45c9-bb8d-dc0d5da2376b None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:54.646584 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f385c-6c2d-499d-a76e-25406ab01665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:54.647251 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f385c-6c2d-499d-a76e-25406ab01665 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:54.647527 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f385c-6c2d-499d-a76e-25406ab01665 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:54.647848 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f385c-6c2d-499d-a76e-25406ab01665 None admin] PATH_INFO: `/v3/services/image` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:54.648430 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0f385c-6c2d-499d-a76e-25406ab01665 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:54.649804 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0f385c-6c2d-499d-a76e-25406ab01665 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:54.659536 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-9a0f385c-6c2d-499d-a76e-25406ab01665 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 05:31:54.659536 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:54.659536 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:31:54.659536 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:31:54.659536 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:31:54.659536 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:31:54.659536 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:31:54.659536 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:54.659536 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 05:31:54.659536 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:54.659536 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:31:54.659536 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:54.659536 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:54.659536 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:54.659536 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:54.659536 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:54.659536 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:54.660755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:54.660755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:54.660755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:54.660755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:54.660755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:54.660755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:54.660755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:31:54.660755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:31:54.660755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:31:54.660755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:31:54.660755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:54.660755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:54.660755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:54.660755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:54.660755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:54.660755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:54.661595 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:54.661595 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:54.661595 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:54.661595 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:54.661595 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:54.661595 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:54.661595 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:54.661595 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:54.661595 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:54.661595 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:54.661595 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:31:54.661595 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:31:54.661595 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 26 05:31:54.661595 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:54.661595 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 521/1041] 10.222.0.66 () {56 vars in 1105 bytes} [Mon Sep 26 05:31:54 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:54.662409 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f385c-6c2d-499d-a76e-25406ab01665 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:54.665332 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cec81c-a05a-4ea6-a611-3aacd411fe21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:54.666193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cec81c-a05a-4ea6-a611-3aacd411fe21 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:54.666488 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cec81c-a05a-4ea6-a611-3aacd411fe21 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:54.666897 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cec81c-a05a-4ea6-a611-3aacd411fe21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:54.678748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cec81c-a05a-4ea6-a611-3aacd411fe21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:54.680251 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cec81c-a05a-4ea6-a611-3aacd411fe21 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:54.696568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-28cec81c-a05a-4ea6-a611-3aacd411fe21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:54.696568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:54.696568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:54.696568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:54.696568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:54.696568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:54.696568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:54.696568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:54.696568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:54.696568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:54.696568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:54.696568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:54.696568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:31:54.696568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:31:54.696568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:31:54.696568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:31:54.697643 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:54.697643 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:54.697643 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:54.697643 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:54.697643 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:54.697643 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:54.697643 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:54.697643 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:54.697643 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:54.697643 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:54.697643 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:54.697643 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:54.697643 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:54.697643 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:54.697643 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:54.697643 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:54.697643 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:31:54.698580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:31:54.698580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:54.698580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:54.698580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 521/1042] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:54.699255 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cec81c-a05a-4ea6-a611-3aacd411fe21 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:54.785076 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0f385c-6c2d-499d-a76e-25406ab01665 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:54.802054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:54.809628 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cec81c-a05a-4ea6-a611-3aacd411fe21 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:54.821254 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:54.821472 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fae8f9-7f28-4af1-bd8f-be914674bac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:54.821933 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fae8f9-7f28-4af1-bd8f-be914674bac3 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:54.822207 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fae8f9-7f28-4af1-bd8f-be914674bac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:54.822518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fae8f9-7f28-4af1-bd8f-be914674bac3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:54.823633 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fae8f9-7f28-4af1-bd8f-be914674bac3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:54.825198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fae8f9-7f28-4af1-bd8f-be914674bac3 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:54.827319 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 522/1043] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:54.828083 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fae8f9-7f28-4af1-bd8f-be914674bac3 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:54.848990 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91642f7e-df24-4a2c-bdd2-830632e6ef53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:54.849661 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91642f7e-df24-4a2c-bdd2-830632e6ef53 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:54.850028 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91642f7e-df24-4a2c-bdd2-830632e6ef53 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:54.850400 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91642f7e-df24-4a2c-bdd2-830632e6ef53 None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:54.851163 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91642f7e-df24-4a2c-bdd2-830632e6ef53 None admin] RBAC: Adding query filter params (name=image) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:54.851626 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91642f7e-df24-4a2c-bdd2-830632e6ef53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:54.853411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91642f7e-df24-4a2c-bdd2-830632e6ef53 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:54.860712 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 522/1044] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:54.861383 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91642f7e-df24-4a2c-bdd2-830632e6ef53 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:54.942598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fae8f9-7f28-4af1-bd8f-be914674bac3 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:54.976819 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df387dc1-3182-433c-a501-359a88fcd14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:54.977420 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df387dc1-3182-433c-a501-359a88fcd14d None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:54.977692 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df387dc1-3182-433c-a501-359a88fcd14d None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:54.977952 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df387dc1-3182-433c-a501-359a88fcd14d None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:54.978583 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df387dc1-3182-433c-a501-359a88fcd14d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:54.978874 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df387dc1-3182-433c-a501-359a88fcd14d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:54.980281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df387dc1-3182-433c-a501-359a88fcd14d None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:54.990860 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91642f7e-df24-4a2c-bdd2-830632e6ef53 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:54.992454 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 523/1045] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:54.993263 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df387dc1-3182-433c-a501-359a88fcd14d None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:55.030660 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5170c-d5a7-4865-a1e3-311c709606a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:55.031292 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5170c-d5a7-4865-a1e3-311c709606a3 None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:55.031561 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5170c-d5a7-4865-a1e3-311c709606a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:55.031861 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5170c-d5a7-4865-a1e3-311c709606a3 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:55.032504 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5170c-d5a7-4865-a1e3-311c709606a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:55.033932 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5170c-d5a7-4865-a1e3-311c709606a3 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:55.041518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:55.063786 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 523/1046] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 26 05:31:54 2022] POST /identity/v3/users => generated 285 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:31:55.063786 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5170c-d5a7-4865-a1e3-311c709606a3 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:55.099766 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:55.113537 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df387dc1-3182-433c-a501-359a88fcd14d None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:55.153254 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ace86-234f-4d9e-b7b2-03e31a45bc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:55.153884 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ace86-234f-4d9e-b7b2-03e31a45bc9c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:55.154163 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ace86-234f-4d9e-b7b2-03e31a45bc9c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:55.154430 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ace86-234f-4d9e-b7b2-03e31a45bc9c None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:55.155077 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ace86-234f-4d9e-b7b2-03e31a45bc9c None admin] RBAC: Adding query filter params (type=image) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:55.155371 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ace86-234f-4d9e-b7b2-03e31a45bc9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:55.156850 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ace86-234f-4d9e-b7b2-03e31a45bc9c None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:55.162892 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 524/1047] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:55.169074 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ace86-234f-4d9e-b7b2-03e31a45bc9c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:55.191301 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5170c-d5a7-4865-a1e3-311c709606a3 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:55.230771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94fc95-063e-405b-a4d8-2a431c7abdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:55.231419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94fc95-063e-405b-a4d8-2a431c7abdfe None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:55.231687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94fc95-063e-405b-a4d8-2a431c7abdfe None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:55.231972 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94fc95-063e-405b-a4d8-2a431c7abdfe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:55.239410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94fc95-063e-405b-a4d8-2a431c7abdfe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:55.241216 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94fc95-063e-405b-a4d8-2a431c7abdfe None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:55.253912 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-9a94fc95-063e-405b-a4d8-2a431c7abdfe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:31:55.253912 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:55.253912 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:55.253912 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:55.253912 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:55.253912 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:55.253912 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:55.253912 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:55.253912 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:55.253912 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:55.253912 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:55.253912 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:55.253912 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:31:55.253912 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:31:55.253912 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:31:55.254937 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:31:55.254937 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:55.254937 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:55.254937 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:55.254937 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:55.254937 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:55.254937 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:55.254937 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:55.254937 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:55.254937 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:55.254937 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:55.254937 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:55.254937 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:55.254937 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:55.254937 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:55.254937 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:55.254937 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:55.256353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:31:55.256353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:31:55.256353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:31:55.256353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:31:55.256353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:31:55.256353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:31:55.256353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:31:55.256353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:55.256353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 524/1048] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:31:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:55.261077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94fc95-063e-405b-a4d8-2a431c7abdfe None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:55.292593 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ace86-234f-4d9e-b7b2-03e31a45bc9c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:55.302980 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:55.334690 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f6728-d90f-482f-b98e-a9ddd65061b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:55.335423 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f6728-d90f-482f-b98e-a9ddd65061b3 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:55.335709 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f6728-d90f-482f-b98e-a9ddd65061b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:55.336047 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f6728-d90f-482f-b98e-a9ddd65061b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:55.336723 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f6728-d90f-482f-b98e-a9ddd65061b3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:55.338232 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f6728-d90f-482f-b98e-a9ddd65061b3 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:55.367761 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 525/1049] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:31:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:31:55.385145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:55.398889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94fc95-063e-405b-a4d8-2a431c7abdfe None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:55.447345 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4f710-6768-448e-99b2-b4d6adca43dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:55.448031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4f710-6768-448e-99b2-b4d6adca43dd None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:55.448278 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4f710-6768-448e-99b2-b4d6adca43dd None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:55.448573 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4f710-6768-448e-99b2-b4d6adca43dd None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:55.449337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4f710-6768-448e-99b2-b4d6adca43dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:55.449650 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4f710-6768-448e-99b2-b4d6adca43dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:55.451591 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4f710-6768-448e-99b2-b4d6adca43dd None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:55.471826 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 525/1050] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:31:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:55.473787 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f6728-d90f-482f-b98e-a9ddd65061b3 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:55.590584 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f6728-d90f-482f-b98e-a9ddd65061b3 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:55.626108 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bcbe98-a8f0-4f65-b0da-e93c60c26609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:55.626727 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcbe98-a8f0-4f65-b0da-e93c60c26609 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:55.627003 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcbe98-a8f0-4f65-b0da-e93c60c26609 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:55.627274 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcbe98-a8f0-4f65-b0da-e93c60c26609 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:55.628068 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bcbe98-a8f0-4f65-b0da-e93c60c26609 None admin] RBAC: Adding query filter params (role.id=630ba0cecaa24efeb65159717bf41ac7, scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8, user.id=c559a36836be411b9afd076f4c9a0655) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:55.628372 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bcbe98-a8f0-4f65-b0da-e93c60c26609 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:55.629814 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bcbe98-a8f0-4f65-b0da-e93c60c26609 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:55.635661 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 526/1051] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:31:55 2022] GET /identity/v3/role_assignments?user.id=c559a36836be411b9afd076f4c9a0655&scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8&role.id=630ba0cecaa24efeb65159717bf41ac7 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:31:57.292410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf576e90-7dff-4589-af7c-4db54b3402f1 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:57.293006 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf576e90-7dff-4589-af7c-4db54b3402f1 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:57.293006 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf576e90-7dff-4589-af7c-4db54b3402f1 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:57.294282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 526/1052] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:57.300411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb97b7-7811-49dc-a31d-c3943bbb8323 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:57.300913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb97b7-7811-49dc-a31d-c3943bbb8323 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:57.300913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb97b7-7811-49dc-a31d-c3943bbb8323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:57.320139 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-bcfb97b7-7811-49dc-a31d-c3943bbb8323 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:57.321332 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-bcfb97b7-7811-49dc-a31d-c3943bbb8323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:57.346962 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:57.397410 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 527/1053] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:31:57.582161 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e006c7-c334-4d78-bcb0-1bfca6ff9087 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:57.582365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e006c7-c334-4d78-bcb0-1bfca6ff9087 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:57.582622 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e006c7-c334-4d78-bcb0-1bfca6ff9087 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:57.584130 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 527/1054] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:31:57.590456 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76dbea-e812-4078-b328-9b465b6cf467 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:57.590792 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76dbea-e812-4078-b328-9b465b6cf467 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:57.591118 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76dbea-e812-4078-b328-9b465b6cf467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:57.612311 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-de76dbea-e812-4078-b328-9b465b6cf467 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:57.613535 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-de76dbea-e812-4078-b328-9b465b6cf467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:57.665783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e006c7-c334-4d78-bcb0-1bfca6ff9087 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:57.690482 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 528/1055] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:31:57.778591 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312d914-7e62-4c9b-b690-7ffb3b59f119 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:57.778870 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312d914-7e62-4c9b-b690-7ffb3b59f119 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:57.779124 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312d914-7e62-4c9b-b690-7ffb3b59f119 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:57.780644 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 529/1056] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:31:57.785654 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0023ad-84ef-4e56-8718-3500a3faae61 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:57.785892 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0023ad-84ef-4e56-8718-3500a3faae61 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:57.786137 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0023ad-84ef-4e56-8718-3500a3faae61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:57.808305 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-dd0023ad-84ef-4e56-8718-3500a3faae61 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:31:57.810277 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-dd0023ad-84ef-4e56-8718-3500a3faae61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:31:57.817329 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e006c7-c334-4d78-bcb0-1bfca6ff9087 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:57.853029 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d85d0f-c19b-4399-adcd-8473350e3990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:57.853577 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d85d0f-c19b-4399-adcd-8473350e3990 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:57.853859 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d85d0f-c19b-4399-adcd-8473350e3990 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:57.854106 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d85d0f-c19b-4399-adcd-8473350e3990 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:57.864754 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d85d0f-c19b-4399-adcd-8473350e3990 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:31:57.869645 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-f7d85d0f-c19b-4399-adcd-8473350e3990 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:31:57.869645 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:57.869645 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:57.869645 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:57.869645 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:57.869645 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:57.869645 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:57.869645 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:57.869645 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:57.869645 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:57.869645 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:57.869645 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:57.869645 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:31:57.869645 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:31:57.869645 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:31:57.869645 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:31:57.870685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:31:57.870685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:31:57.870685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:31:57.870685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:31:57.870685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:57.870685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:57.870685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:57.870685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:57.870685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:57.870685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:57.870685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:57.870685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:57.870685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:57.870685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:57.870685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:57.870685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:57.876580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:57.876580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:57.876580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:57.876580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:57.876580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:31:57.876580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:31:57.876580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:31:57.876580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:31:57.876580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:31:57.876580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:31:57.876580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:31:57.876580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:57.876580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 528/1057] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:31:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:57.879197 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d85d0f-c19b-4399-adcd-8473350e3990 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:57.889096 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:57.898928 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 530/1058] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:31:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 05:31:57.956959 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0023ad-84ef-4e56-8718-3500a3faae61 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:57.977030 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:57.990466 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d85d0f-c19b-4399-adcd-8473350e3990 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:58.029285 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4837664-8a3d-49b8-bd14-d615d2f0a2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:58.030000 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4837664-8a3d-49b8-bd14-d615d2f0a2c1 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:58.030279 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4837664-8a3d-49b8-bd14-d615d2f0a2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:58.030550 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4837664-8a3d-49b8-bd14-d615d2f0a2c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:58.031298 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4837664-8a3d-49b8-bd14-d615d2f0a2c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:58.031516 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4837664-8a3d-49b8-bd14-d615d2f0a2c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:58.033099 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4837664-8a3d-49b8-bd14-d615d2f0a2c1 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:58.047945 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 529/1059] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:31:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:31:58.050481 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4837664-8a3d-49b8-bd14-d615d2f0a2c1 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:58.081131 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0023ad-84ef-4e56-8718-3500a3faae61 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:58.119312 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf03d2-7ba3-411e-8f5f-46ea5cac3962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:58.119539 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf03d2-7ba3-411e-8f5f-46ea5cac3962 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:58.120228 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf03d2-7ba3-411e-8f5f-46ea5cac3962 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:58.120228 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf03d2-7ba3-411e-8f5f-46ea5cac3962 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:58.128622 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:58.172315 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4837664-8a3d-49b8-bd14-d615d2f0a2c1 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:58.195594 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf03d2-7ba3-411e-8f5f-46ea5cac3962 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:58.196700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf03d2-7ba3-411e-8f5f-46ea5cac3962 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:58.207061 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648e2ba-ee95-40bc-86cc-1af78a9f4a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:58.207708 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648e2ba-ee95-40bc-86cc-1af78a9f4a4c None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:58.208008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648e2ba-ee95-40bc-86cc-1af78a9f4a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:58.208271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648e2ba-ee95-40bc-86cc-1af78a9f4a4c None admin] PATH_INFO: `/v3/users/a60536f2c61b47cc8c3590ef41ac69f7` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:58.217756 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:58.226338 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648e2ba-ee95-40bc-86cc-1af78a9f4a4c None admin] RBAC: Authorizing `identity:get_user(user_id=a60536f2c61b47cc8c3590ef41ac69f7)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:58.227818 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648e2ba-ee95-40bc-86cc-1af78a9f4a4c None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:58.229560 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 530/1060] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:31:58 2022] GET /identity/v3/users/a60536f2c61b47cc8c3590ef41ac69f7 => generated 285 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:58.230331 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648e2ba-ee95-40bc-86cc-1af78a9f4a4c None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:58.318962 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 531/1061] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:31:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:31:58.320580 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf03d2-7ba3-411e-8f5f-46ea5cac3962 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:58.352174 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648e2ba-ee95-40bc-86cc-1af78a9f4a4c None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:58.381996 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:58.392086 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fd6f0-c54d-4902-8fb9-f6a9db943664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:58.392740 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fd6f0-c54d-4902-8fb9-f6a9db943664 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:58.393026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fd6f0-c54d-4902-8fb9-f6a9db943664 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:58.393287 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fd6f0-c54d-4902-8fb9-f6a9db943664 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:58.405417 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2fd6f0-c54d-4902-8fb9-f6a9db943664 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:31:58.410313 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-ec2fd6f0-c54d-4902-8fb9-f6a9db943664 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 05:31:58.410313 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:58.410313 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:58.410313 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:58.410313 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:58.410313 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:58.410313 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:58.410313 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:58.410313 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:58.410313 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:58.410313 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:58.410313 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:58.410313 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:31:58.410313 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:31:58.410313 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:31:58.410313 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:31:58.411363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:31:58.411363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:31:58.411363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:31:58.411363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:31:58.411363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:58.411363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:58.411363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:58.411363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:58.411363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:58.411363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:58.411363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:58.411363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:58.411363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:58.411363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:58.411363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:58.411363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:58.412278 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:58.412278 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:58.412278 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:58.412278 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:58.412278 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:31:58.412278 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:31:58.412278 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:31:58.412278 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:31:58.412278 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:31:58.412278 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:31:58.412278 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 05:31:58.412278 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:58.412278 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 531/1062] 10.222.0.66 () {56 vars in 1120 bytes} [Mon Sep 26 05:31:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:58.413091 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fd6f0-c54d-4902-8fb9-f6a9db943664 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:58.434167 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf03d2-7ba3-411e-8f5f-46ea5cac3962 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:58.454905 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:58.474638 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c44df-6f33-4c9f-a4b2-72425f024c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:58.475334 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c44df-6f33-4c9f-a4b2-72425f024c7b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:58.475610 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c44df-6f33-4c9f-a4b2-72425f024c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:58.475891 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c44df-6f33-4c9f-a4b2-72425f024c7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:58.518551 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fd6f0-c54d-4902-8fb9-f6a9db943664 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:58.545260 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c44df-6f33-4c9f-a4b2-72425f024c7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:58.546738 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c44df-6f33-4c9f-a4b2-72425f024c7b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:58.556327 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6003c-8ca2-4ddd-8a93-2fb251985902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:58.557242 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6003c-8ca2-4ddd-8a93-2fb251985902 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:58.557642 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6003c-8ca2-4ddd-8a93-2fb251985902 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:58.558027 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6003c-8ca2-4ddd-8a93-2fb251985902 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:58.570567 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6003c-8ca2-4ddd-8a93-2fb251985902 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:58.572224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6003c-8ca2-4ddd-8a93-2fb251985902 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:58.589599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-64c6003c-8ca2-4ddd-8a93-2fb251985902 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:58.589599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:58.589599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:58.589599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:58.589599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:58.589599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:58.589599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:58.589599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:58.589599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:58.589599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:58.589599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:58.589599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:58.589599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:31:58.589599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:31:58.589599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:31:58.589599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:31:58.590687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:58.590687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:58.590687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:58.590687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:58.590687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:58.590687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:58.590687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:58.590687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:58.590687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:58.590687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:58.590687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:58.590687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:58.590687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:58.590687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:58.590687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:58.590687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:58.590687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:31:58.591596 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:31:58.591596 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:58.591596 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:58.591596 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 532/1063] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:58.591892 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6003c-8ca2-4ddd-8a93-2fb251985902 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:58.637553 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:58.659690 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 532/1064] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:31:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:31:58.660550 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c44df-6f33-4c9f-a4b2-72425f024c7b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:58.679368 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:58.702373 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6003c-8ca2-4ddd-8a93-2fb251985902 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:58.736052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8aa56-89d6-400e-a866-c7ca5d5a9627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:58.736660 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8aa56-89d6-400e-a866-c7ca5d5a9627 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:58.736932 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8aa56-89d6-400e-a866-c7ca5d5a9627 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:58.737198 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8aa56-89d6-400e-a866-c7ca5d5a9627 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:58.737855 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8aa56-89d6-400e-a866-c7ca5d5a9627 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:58.738157 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8aa56-89d6-400e-a866-c7ca5d5a9627 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:58.739517 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d8aa56-89d6-400e-a866-c7ca5d5a9627 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:58.747962 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 533/1065] 10.222.0.66 () {56 vars in 1115 bytes} [Mon Sep 26 05:31:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:58.748764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8aa56-89d6-400e-a866-c7ca5d5a9627 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:58.764324 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c44df-6f33-4c9f-a4b2-72425f024c7b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:58.798490 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4438fa-392b-469a-aad5-55d8d691099e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:58.799088 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4438fa-392b-469a-aad5-55d8d691099e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:58.799362 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4438fa-392b-469a-aad5-55d8d691099e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:58.799631 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4438fa-392b-469a-aad5-55d8d691099e None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:58.800304 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4438fa-392b-469a-aad5-55d8d691099e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:58.800602 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4438fa-392b-469a-aad5-55d8d691099e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:58.801995 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4438fa-392b-469a-aad5-55d8d691099e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:58.813285 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 533/1066] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:58.814181 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4438fa-392b-469a-aad5-55d8d691099e None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:58.859277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:58.863477 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8aa56-89d6-400e-a866-c7ca5d5a9627 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:58.900877 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:58.906794 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1934c6d-122f-4527-956c-97ee4d809c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:58.907451 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1934c6d-122f-4527-956c-97ee4d809c79 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:58.907723 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1934c6d-122f-4527-956c-97ee4d809c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:58.908132 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1934c6d-122f-4527-956c-97ee4d809c79 None admin] PATH_INFO: `/v3/projects/401906bd7fc74dd3b98ca2ae11e1903b` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:58.909406 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1934c6d-122f-4527-956c-97ee4d809c79 None admin] RBAC: Authorizing `identity:get_project(project_id=401906bd7fc74dd3b98ca2ae11e1903b)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:58.910902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1934c6d-122f-4527-956c-97ee4d809c79 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:58.918267 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 534/1067] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:31:58 2022] GET /identity/v3/projects/401906bd7fc74dd3b98ca2ae11e1903b => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:58.919937 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1934c6d-122f-4527-956c-97ee4d809c79 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:58.926303 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4438fa-392b-469a-aad5-55d8d691099e None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:58.968253 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9716998-d3b2-4bae-8c58-88cd75ab4c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:58.968884 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9716998-d3b2-4bae-8c58-88cd75ab4c7a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:58.969157 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9716998-d3b2-4bae-8c58-88cd75ab4c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:58.969426 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9716998-d3b2-4bae-8c58-88cd75ab4c7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:58.983630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9716998-d3b2-4bae-8c58-88cd75ab4c7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:58.985162 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9716998-d3b2-4bae-8c58-88cd75ab4c7a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:59.003561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-f9716998-d3b2-4bae-8c58-88cd75ab4c7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:59.003561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:59.003561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:59.003561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:59.003561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:59.003561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:59.003561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:59.003561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:59.003561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:59.003561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:59.003561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:59.003561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:59.003561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:31:59.003561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:31:59.003561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:31:59.003561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:31:59.004663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:59.004663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:59.004663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:59.004663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:59.004663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:59.004663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:59.004663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:59.004663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:59.004663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:59.004663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:59.004663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:59.004663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:59.004663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:59.004663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:59.004663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:59.004663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:59.004663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:31:59.005601 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:31:59.005601 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:59.005601 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:31:59.005601 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 534/1068] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:59.010866 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9716998-d3b2-4bae-8c58-88cd75ab4c7a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:59.051161 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1934c6d-122f-4527-956c-97ee4d809c79 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:59.093123 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374681d8-8c38-4d9c-894c-0e4ed770732d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:59.093743 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374681d8-8c38-4d9c-894c-0e4ed770732d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:59.094016 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374681d8-8c38-4d9c-894c-0e4ed770732d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:59.094369 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374681d8-8c38-4d9c-894c-0e4ed770732d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:59.095012 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374681d8-8c38-4d9c-894c-0e4ed770732d None admin] RBAC: Adding query filter params (role.id=cf58d66369044fb09fa65a4366dc7446, scope.project.id=401906bd7fc74dd3b98ca2ae11e1903b, user.id=a60536f2c61b47cc8c3590ef41ac69f7) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:59.095315 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374681d8-8c38-4d9c-894c-0e4ed770732d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:59.096777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374681d8-8c38-4d9c-894c-0e4ed770732d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:59.105594 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 535/1069] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:31:58 2022] GET /identity/v3/role_assignments?user.id=a60536f2c61b47cc8c3590ef41ac69f7&scope.project.id=401906bd7fc74dd3b98ca2ae11e1903b&role.id=cf58d66369044fb09fa65a4366dc7446 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:59.132267 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9716998-d3b2-4bae-8c58-88cd75ab4c7a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:59.164302 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:59.171054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909c8c0-ec3f-46d9-a6a3-4dea3b1ae1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:59.171690 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909c8c0-ec3f-46d9-a6a3-4dea3b1ae1cc None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:59.171992 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909c8c0-ec3f-46d9-a6a3-4dea3b1ae1cc None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:59.172261 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909c8c0-ec3f-46d9-a6a3-4dea3b1ae1cc None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:59.172918 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909c8c0-ec3f-46d9-a6a3-4dea3b1ae1cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:59.173220 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909c8c0-ec3f-46d9-a6a3-4dea3b1ae1cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:59.174656 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909c8c0-ec3f-46d9-a6a3-4dea3b1ae1cc None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:59.188080 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 535/1070] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:31:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:31:59.194883 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374681d8-8c38-4d9c-894c-0e4ed770732d None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:59.233091 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:59.306370 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374681d8-8c38-4d9c-894c-0e4ed770732d None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:59.340368 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c2cea-9b9f-49d3-8ce9-22b159cb3839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:59.340994 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c2cea-9b9f-49d3-8ce9-22b159cb3839 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:59.341267 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c2cea-9b9f-49d3-8ce9-22b159cb3839 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:59.341537 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c2cea-9b9f-49d3-8ce9-22b159cb3839 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:59.349019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c2cea-9b9f-49d3-8ce9-22b159cb3839 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:59.350524 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c2cea-9b9f-49d3-8ce9-22b159cb3839 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:59.361556 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-0f5c2cea-9b9f-49d3-8ce9-22b159cb3839 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:31:59.361556 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:59.361556 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:59.361556 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:59.361556 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:59.361556 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:59.361556 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:59.361556 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:59.361556 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:59.361556 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:59.361556 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:59.361556 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:59.361556 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:31:59.361556 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:31:59.361556 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:31:59.361556 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:31:59.362964 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:59.362964 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:59.362964 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:31:59.362964 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:31:59.362964 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:31:59.362964 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:31:59.362964 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:59.362964 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:59.362964 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:59.362964 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:59.362964 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:59.362964 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:59.362964 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:59.362964 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:59.362964 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:59.362964 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:59.362964 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:59.362964 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:59.363987 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:59.363987 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:59.363987 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:31:59.363987 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:31:59.363987 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:31:59.363987 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:31:59.363987 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:31:59.363987 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:31:59.363987 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:31:59.363987 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:59.363987 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 536/1071] 10.222.0.66 () {56 vars in 1093 bytes} [Mon Sep 26 05:31:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:59.368705 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909c8c0-ec3f-46d9-a6a3-4dea3b1ae1cc None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:59.471853 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909c8c0-ec3f-46d9-a6a3-4dea3b1ae1cc None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:59.508040 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01fd38-0419-4f10-a5da-1ae4d9371451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:59.508654 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01fd38-0419-4f10-a5da-1ae4d9371451 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:59.508928 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01fd38-0419-4f10-a5da-1ae4d9371451 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:59.509201 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01fd38-0419-4f10-a5da-1ae4d9371451 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:59.509924 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01fd38-0419-4f10-a5da-1ae4d9371451 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:59.510228 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01fd38-0419-4f10-a5da-1ae4d9371451 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:59.511679 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01fd38-0419-4f10-a5da-1ae4d9371451 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:59.531162 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 536/1072] 10.222.0.66 () {56 vars in 1133 bytes} [Mon Sep 26 05:31:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:59.537250 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c2cea-9b9f-49d3-8ce9-22b159cb3839 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:59.631194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:59.641050 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c2cea-9b9f-49d3-8ce9-22b159cb3839 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:59.674342 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098c424-6f65-4e3f-984d-76c334198303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:59.674984 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098c424-6f65-4e3f-984d-76c334198303 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:59.675258 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098c424-6f65-4e3f-984d-76c334198303 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:59.675523 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098c424-6f65-4e3f-984d-76c334198303 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:59.686183 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098c424-6f65-4e3f-984d-76c334198303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:59.687610 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098c424-6f65-4e3f-984d-76c334198303 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:59.701734 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-e098c424-6f65-4e3f-984d-76c334198303 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:59.701734 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:31:59.701734 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:31:59.701734 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:31:59.701734 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:31:59.701734 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:31:59.701734 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:31:59.701734 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:31:59.701734 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:31:59.701734 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:31:59.701734 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:31:59.701734 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:31:59.701734 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:31:59.701734 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:31:59.701734 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:31:59.701734 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:31:59.702825 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:31:59.702825 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:31:59.702825 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:31:59.702825 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:31:59.702825 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:31:59.702825 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:31:59.702825 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:31:59.702825 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:31:59.702825 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:31:59.702825 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:31:59.702825 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:31:59.702825 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:31:59.702825 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:31:59.702825 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:31:59.702825 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:31:59.702825 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:31:59.702825 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:31:59.703715 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:31:59.703715 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:31:59.703715 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:31:59.703715 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 537/1073] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:31:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:31:59.708790 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01fd38-0419-4f10-a5da-1ae4d9371451 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:59.760435 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:31:59.810868 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01fd38-0419-4f10-a5da-1ae4d9371451 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:31:59.847033 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785f5c9-dd8d-4343-96a8-5187e9c68ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:31:59.847640 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785f5c9-dd8d-4343-96a8-5187e9c68ecb None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:31:59.847946 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785f5c9-dd8d-4343-96a8-5187e9c68ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:31:59.848223 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785f5c9-dd8d-4343-96a8-5187e9c68ecb None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:31:59.848860 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785f5c9-dd8d-4343-96a8-5187e9c68ecb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:31:59.849158 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785f5c9-dd8d-4343-96a8-5187e9c68ecb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:31:59.850638 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785f5c9-dd8d-4343-96a8-5187e9c68ecb None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:31:59.862524 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 537/1074] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:31:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:31:59.868543 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098c424-6f65-4e3f-984d-76c334198303 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:31:59.973661 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098c424-6f65-4e3f-984d-76c334198303 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:00.014786 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a0efb-c7e9-4f47-bf7a-c3e50b9beaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:00.015321 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a0efb-c7e9-4f47-bf7a-c3e50b9beaa4 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:00.015599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a0efb-c7e9-4f47-bf7a-c3e50b9beaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:00.015920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a0efb-c7e9-4f47-bf7a-c3e50b9beaa4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:00.022871 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a0efb-c7e9-4f47-bf7a-c3e50b9beaa4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:00.024339 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a0efb-c7e9-4f47-bf7a-c3e50b9beaa4 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:00.035683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-ef3a0efb-c7e9-4f47-bf7a-c3e50b9beaa4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:32:00.035683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:32:00.035683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:32:00.035683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:32:00.035683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:32:00.035683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:32:00.035683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:32:00.035683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:32:00.035683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:32:00.035683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:32:00.035683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:32:00.035683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:32:00.035683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:32:00.035683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:32:00.035683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:32:00.036637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:32:00.036637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:32:00.036637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:32:00.036637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:32:00.036637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:32:00.036637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:32:00.036637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:32:00.036637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:32:00.036637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:32:00.036637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:32:00.036637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:32:00.036637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:32:00.036637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:32:00.036637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:32:00.036637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:32:00.036637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:32:00.036637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:32:00.037727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:32:00.037727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:32:00.037727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:32:00.037727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:32:00.037727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:32:00.037727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:32:00.037727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:32:00.037727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:32:00.037727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 538/1075] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:31:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:32:00.043083 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785f5c9-dd8d-4343-96a8-5187e9c68ecb None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:00.150841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785f5c9-dd8d-4343-96a8-5187e9c68ecb None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:00.160464 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:00.188536 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd6ac1-b98e-4689-af8a-899ba40028e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:00.189151 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd6ac1-b98e-4689-af8a-899ba40028e2 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:00.189427 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd6ac1-b98e-4689-af8a-899ba40028e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:00.189696 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd6ac1-b98e-4689-af8a-899ba40028e2 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:00.190385 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd6ac1-b98e-4689-af8a-899ba40028e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:32:00.190722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd6ac1-b98e-4689-af8a-899ba40028e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:00.192234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd6ac1-b98e-4689-af8a-899ba40028e2 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:00.207318 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 538/1076] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:32:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:00.213570 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a0efb-c7e9-4f47-bf7a-c3e50b9beaa4 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:00.217555 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:00.317461 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a0efb-c7e9-4f47-bf7a-c3e50b9beaa4 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:00.356149 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303daab9-b37d-48b6-a893-81d6239063e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:00.356823 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303daab9-b37d-48b6-a893-81d6239063e9 None admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:00.357099 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303daab9-b37d-48b6-a893-81d6239063e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:00.357372 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303daab9-b37d-48b6-a893-81d6239063e9 None admin] PATH_INFO: `/v3/projects/953bb95b0ba84d4f99a73afb426bb8c8/users/c559a36836be411b9afd076f4c9a0655/roles/630ba0cecaa24efeb65159717bf41ac7` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:00.359674 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303daab9-b37d-48b6-a893-81d6239063e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=953bb95b0ba84d4f99a73afb426bb8c8, user_id=c559a36836be411b9afd076f4c9a0655, role_id=630ba0cecaa24efeb65159717bf41ac7)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:00.361139 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303daab9-b37d-48b6-a893-81d6239063e9 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:00.376655 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 539/1077] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 26 05:32:00 2022] PUT /identity/v3/projects/953bb95b0ba84d4f99a73afb426bb8c8/users/c559a36836be411b9afd076f4c9a0655/roles/630ba0cecaa24efeb65159717bf41ac7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:32:01.263681 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173e7a6-b9ab-4c2d-b2a8-35c340a4b7f7 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:01.264321 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173e7a6-b9ab-4c2d-b2a8-35c340a4b7f7 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:01.264321 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173e7a6-b9ab-4c2d-b2a8-35c340a4b7f7 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:01.265646 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 539/1078] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:32:01.271937 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeafe71-82b0-4e80-bccf-2bf4e0338159 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:01.272356 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeafe71-82b0-4e80-bccf-2bf4e0338159 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:01.272630 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeafe71-82b0-4e80-bccf-2bf4e0338159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:01.292806 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-1eeafe71-82b0-4e80-bccf-2bf4e0338159 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:32:01.294056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1eeafe71-82b0-4e80-bccf-2bf4e0338159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:32:01.357225 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:01.366904 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 540/1079] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:32:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:32:01.633407 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173e7a6-b9ab-4c2d-b2a8-35c340a4b7f7 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:01.751761 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173e7a6-b9ab-4c2d-b2a8-35c340a4b7f7 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:01.787770 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a5040-6630-466a-8d4b-627430bfc17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:01.788526 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a5040-6630-466a-8d4b-627430bfc17e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:01.788798 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a5040-6630-466a-8d4b-627430bfc17e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:01.789065 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a5040-6630-466a-8d4b-627430bfc17e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:01.799994 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a5040-6630-466a-8d4b-627430bfc17e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:32:01.804861 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-b28a5040-6630-466a-8d4b-627430bfc17e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:32:01.804861 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:32:01.804861 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:32:01.804861 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:32:01.804861 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:32:01.804861 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:32:01.804861 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:32:01.804861 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:32:01.804861 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:32:01.804861 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:32:01.804861 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:32:01.804861 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:32:01.804861 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:32:01.804861 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:32:01.804861 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:32:01.804861 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:32:01.805841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:32:01.805841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:32:01.805841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:32:01.805841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:32:01.805841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:32:01.805841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:32:01.805841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:32:01.805841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:32:01.805841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:32:01.805841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:32:01.805841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:32:01.805841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:32:01.805841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:32:01.805841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:32:01.805841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:32:01.805841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:32:01.806691 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:32:01.806691 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:32:01.806691 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:32:01.806691 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:32:01.806691 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:32:01.806691 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:32:01.806691 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:32:01.806691 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:32:01.806691 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:32:01.806691 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:32:01.806691 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:32:01.806691 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:32:01.806691 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 540/1080] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:32:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:32:01.812359 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeafe71-82b0-4e80-bccf-2bf4e0338159 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:01.914605 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeafe71-82b0-4e80-bccf-2bf4e0338159 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:01.948318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4db62-c8f0-491d-ba09-4ef4c14344e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:01.948921 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4db62-c8f0-491d-ba09-4ef4c14344e9 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:01.949188 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4db62-c8f0-491d-ba09-4ef4c14344e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:01.949452 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4db62-c8f0-491d-ba09-4ef4c14344e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:01.950106 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a4db62-c8f0-491d-ba09-4ef4c14344e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:32:01.950398 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a4db62-c8f0-491d-ba09-4ef4c14344e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:01.952152 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a4db62-c8f0-491d-ba09-4ef4c14344e9 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:01.960723 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 541/1081] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:32:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:01.966685 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a5040-6630-466a-8d4b-627430bfc17e None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:01.996134 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:02.069222 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a5040-6630-466a-8d4b-627430bfc17e None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:02.103671 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3574c-367d-48d5-9122-07947181a7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:02.104342 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3574c-367d-48d5-9122-07947181a7de None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:02.104627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3574c-367d-48d5-9122-07947181a7de None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:02.104895 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3574c-367d-48d5-9122-07947181a7de None admin] PATH_INFO: `/v3/users/a60536f2c61b47cc8c3590ef41ac69f7` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:02.106068 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3574c-367d-48d5-9122-07947181a7de None admin] RBAC: Authorizing `identity:get_user(user_id=a60536f2c61b47cc8c3590ef41ac69f7)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:02.107510 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3574c-367d-48d5-9122-07947181a7de None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:02.109145 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 541/1082] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:32:01 2022] GET /identity/v3/users/a60536f2c61b47cc8c3590ef41ac69f7 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:02.115105 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4db62-c8f0-491d-ba09-4ef4c14344e9 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:02.176697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:02.224342 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4db62-c8f0-491d-ba09-4ef4c14344e9 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:02.260375 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c19641-4751-4eae-84de-ef4837c31b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:02.261002 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c19641-4751-4eae-84de-ef4837c31b43 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:02.261271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c19641-4751-4eae-84de-ef4837c31b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:02.261582 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c19641-4751-4eae-84de-ef4837c31b43 None admin] PATH_INFO: `/v3/projects/401906bd7fc74dd3b98ca2ae11e1903b` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:02.262723 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c19641-4751-4eae-84de-ef4837c31b43 None admin] RBAC: Authorizing `identity:get_project(project_id=401906bd7fc74dd3b98ca2ae11e1903b)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:02.264171 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c19641-4751-4eae-84de-ef4837c31b43 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:02.265808 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 542/1083] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:32:02 2022] GET /identity/v3/projects/401906bd7fc74dd3b98ca2ae11e1903b => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:02.271927 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3574c-367d-48d5-9122-07947181a7de None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:02.372388 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:02.379318 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3574c-367d-48d5-9122-07947181a7de None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:02.420036 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dee09e-a2f3-406a-8239-8a552c9c8fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:02.420719 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dee09e-a2f3-406a-8239-8a552c9c8fe8 None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:02.421025 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dee09e-a2f3-406a-8239-8a552c9c8fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:02.421297 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dee09e-a2f3-406a-8239-8a552c9c8fe8 None admin] PATH_INFO: `/v3/projects/401906bd7fc74dd3b98ca2ae11e1903b/users/a60536f2c61b47cc8c3590ef41ac69f7/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:02.423341 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dee09e-a2f3-406a-8239-8a552c9c8fe8 None admin] RBAC: Authorizing `identity:create_grant(project_id=401906bd7fc74dd3b98ca2ae11e1903b, user_id=a60536f2c61b47cc8c3590ef41ac69f7, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:02.424878 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dee09e-a2f3-406a-8239-8a552c9c8fe8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:02.440923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 542/1084] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 26 05:32:02 2022] PUT /identity/v3/projects/401906bd7fc74dd3b98ca2ae11e1903b/users/a60536f2c61b47cc8c3590ef41ac69f7/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:32:02.555235 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9c6af-0b5e-451e-997a-420dadd4407f None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:02.555627 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9c6af-0b5e-451e-997a-420dadd4407f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:02.556009 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9c6af-0b5e-451e-997a-420dadd4407f None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:02.557492 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 543/1085] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:32:02.563686 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449e91d-9275-4c15-93f7-38849775d61d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:02.564000 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449e91d-9275-4c15-93f7-38849775d61d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:02.564271 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449e91d-9275-4c15-93f7-38849775d61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:02.584342 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-6449e91d-9275-4c15-93f7-38849775d61d None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:32:02.585565 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6449e91d-9275-4c15-93f7-38849775d61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:32:02.664106 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 543/1086] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:32:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:32:02.934576 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9c6af-0b5e-451e-997a-420dadd4407f None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:03.039005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9c6af-0b5e-451e-997a-420dadd4407f None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:03.063273 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:03.075562 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bd8fc-cde9-4d40-af84-f858b6903ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:03.076588 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bd8fc-cde9-4d40-af84-f858b6903ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:03.076858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bd8fc-cde9-4d40-af84-f858b6903ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:03.077120 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bd8fc-cde9-4d40-af84-f858b6903ff9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:03.087370 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4bd8fc-cde9-4d40-af84-f858b6903ff9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:32:03.092215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-0f4bd8fc-cde9-4d40-af84-f858b6903ff9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 05:32:03.092215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:32:03.092215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:32:03.092215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:32:03.092215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:32:03.092215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:32:03.092215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:32:03.092215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:32:03.092215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:32:03.092215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:32:03.092215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:32:03.092215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:32:03.092215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:32:03.092215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:32:03.092215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:32:03.092215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:32:03.093151 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:32:03.093151 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:32:03.093151 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:32:03.093151 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:32:03.093151 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:32:03.093151 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:32:03.093151 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:32:03.093151 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:32:03.093151 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:32:03.093151 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:32:03.093151 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:32:03.093151 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:32:03.093151 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:32:03.093151 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:32:03.093151 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:32:03.093151 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:32:03.094005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:32:03.094005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:32:03.094005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:32:03.094005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:32:03.094005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:32:03.094005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:32:03.094005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:32:03.094005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:32:03.094005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:32:03.094005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:32:03.094005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 26 05:32:03.094005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:32:03.094005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 544/1087] 10.222.0.66 () {56 vars in 1120 bytes} [Mon Sep 26 05:32:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:32:03.099554 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449e91d-9275-4c15-93f7-38849775d61d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:03.184601 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:03.202565 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449e91d-9275-4c15-93f7-38849775d61d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:03.236952 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f5d07-9e9e-40aa-a3c9-d5668086b03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:03.237545 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f5d07-9e9e-40aa-a3c9-d5668086b03f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:03.237853 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f5d07-9e9e-40aa-a3c9-d5668086b03f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:03.238106 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f5d07-9e9e-40aa-a3c9-d5668086b03f None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:03.238767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f5d07-9e9e-40aa-a3c9-d5668086b03f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:32:03.239105 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f5d07-9e9e-40aa-a3c9-d5668086b03f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:03.240561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f5d07-9e9e-40aa-a3c9-d5668086b03f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:03.248820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 544/1088] 10.222.0.66 () {56 vars in 1115 bytes} [Mon Sep 26 05:32:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:03.254841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bd8fc-cde9-4d40-af84-f858b6903ff9 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:03.358566 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bd8fc-cde9-4d40-af84-f858b6903ff9 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:03.392966 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9b885-4618-4581-b0f3-6211a20ca9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:03.393604 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9b885-4618-4581-b0f3-6211a20ca9fc None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:03.393878 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9b885-4618-4581-b0f3-6211a20ca9fc None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:03.394142 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9b885-4618-4581-b0f3-6211a20ca9fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:03.404646 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9b885-4618-4581-b0f3-6211a20ca9fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:03.406078 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9b885-4618-4581-b0f3-6211a20ca9fc None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:03.421336 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-79d9b885-4618-4581-b0f3-6211a20ca9fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:32:03.421336 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:32:03.421336 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:32:03.421336 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:32:03.421336 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:32:03.421336 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:32:03.421336 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:32:03.421336 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:32:03.421336 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:32:03.421336 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:32:03.421336 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:32:03.421336 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:32:03.421336 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:32:03.421336 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:32:03.421336 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:32:03.421336 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:32:03.422348 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:32:03.422348 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:32:03.422348 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:32:03.422348 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:32:03.422348 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:32:03.422348 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:32:03.422348 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:32:03.422348 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:32:03.422348 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:32:03.422348 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:32:03.422348 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:32:03.422348 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:32:03.422348 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:32:03.422348 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:32:03.422348 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:32:03.422348 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:32:03.422348 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:32:03.423266 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:32:03.423266 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:32:03.423266 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:32:03.423266 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 545/1089] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:32:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:32:03.428577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f5d07-9e9e-40aa-a3c9-d5668086b03f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:03.530926 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f5d07-9e9e-40aa-a3c9-d5668086b03f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:03.570540 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a0eb0-0a70-4875-8350-6100801d4228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:03.571150 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a0eb0-0a70-4875-8350-6100801d4228 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:03.571425 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a0eb0-0a70-4875-8350-6100801d4228 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:03.571695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a0eb0-0a70-4875-8350-6100801d4228 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:03.572374 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a0eb0-0a70-4875-8350-6100801d4228 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:32:03.572670 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a0eb0-0a70-4875-8350-6100801d4228 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:03.574057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475a0eb0-0a70-4875-8350-6100801d4228 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:03.587366 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 545/1090] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:03.593420 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9b885-4618-4581-b0f3-6211a20ca9fc None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:03.630036 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:03.699662 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9b885-4618-4581-b0f3-6211a20ca9fc None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:03.737596 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82862cae-8274-4d8e-88b8-342c29243b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:03.738228 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82862cae-8274-4d8e-88b8-342c29243b21 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:03.738500 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82862cae-8274-4d8e-88b8-342c29243b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:03.738766 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82862cae-8274-4d8e-88b8-342c29243b21 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:03.746584 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82862cae-8274-4d8e-88b8-342c29243b21 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:03.748043 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82862cae-8274-4d8e-88b8-342c29243b21 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:03.760107 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-82862cae-8274-4d8e-88b8-342c29243b21 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:32:03.760107 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:32:03.760107 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:32:03.760107 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:32:03.760107 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:32:03.760107 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:32:03.760107 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:32:03.760107 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:32:03.760107 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:32:03.760107 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:32:03.760107 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:32:03.760107 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:32:03.760107 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:32:03.760107 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:32:03.760107 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:32:03.760107 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:32:03.761268 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:32:03.761268 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:32:03.761268 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:32:03.761268 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:32:03.761268 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:32:03.761268 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:32:03.761268 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:32:03.761268 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:32:03.761268 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:32:03.761268 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:32:03.761268 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:32:03.761268 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:32:03.761268 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:32:03.761268 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:32:03.761268 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:32:03.761268 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:32:03.761268 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:32:03.761268 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:32:03.762265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:32:03.762265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:32:03.762265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:32:03.762265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:32:03.762265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:32:03.762265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:32:03.762265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:32:03.762265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:32:03.762265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 26 05:32:03.762265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:32:03.762265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 546/1091] 10.222.0.66 () {56 vars in 1093 bytes} [Mon Sep 26 05:32:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:32:03.767722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a0eb0-0a70-4875-8350-6100801d4228 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:03.779333 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:03.875094 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a0eb0-0a70-4875-8350-6100801d4228 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:03.909358 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1f67c-fa50-4e70-b426-7ae691e315db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:03.909957 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1f67c-fa50-4e70-b426-7ae691e315db None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:03.910230 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1f67c-fa50-4e70-b426-7ae691e315db None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:03.910492 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1f67c-fa50-4e70-b426-7ae691e315db None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:03.911203 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1f67c-fa50-4e70-b426-7ae691e315db None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:32:03.911500 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1f67c-fa50-4e70-b426-7ae691e315db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:03.912965 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1f67c-fa50-4e70-b426-7ae691e315db None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:03.929652 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 546/1092] 10.222.0.66 () {56 vars in 1133 bytes} [Mon Sep 26 05:32:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:03.935569 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82862cae-8274-4d8e-88b8-342c29243b21 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:04.034408 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:04.041450 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82862cae-8274-4d8e-88b8-342c29243b21 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:04.076585 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36e873-df22-47ab-a59f-78b45b470682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:04.077191 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36e873-df22-47ab-a59f-78b45b470682 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:04.077440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36e873-df22-47ab-a59f-78b45b470682 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:04.077725 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36e873-df22-47ab-a59f-78b45b470682 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:04.154772 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba36e873-df22-47ab-a59f-78b45b470682 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:04.156240 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba36e873-df22-47ab-a59f-78b45b470682 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:04.257876 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:04.266998 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 547/1093] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:32:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:32:04.271539 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1f67c-fa50-4e70-b426-7ae691e315db None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:04.339286 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:04.374417 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1f67c-fa50-4e70-b426-7ae691e315db None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:04.408981 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826d18e-d530-4ad4-b0c2-df34fa0c60d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:04.409658 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826d18e-d530-4ad4-b0c2-df34fa0c60d8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:04.409933 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826d18e-d530-4ad4-b0c2-df34fa0c60d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:04.410196 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826d18e-d530-4ad4-b0c2-df34fa0c60d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:04.421055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826d18e-d530-4ad4-b0c2-df34fa0c60d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:04.422500 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826d18e-d530-4ad4-b0c2-df34fa0c60d8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:04.437517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-0826d18e-d530-4ad4-b0c2-df34fa0c60d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:32:04.437517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:32:04.437517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:32:04.437517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:32:04.437517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:32:04.437517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:32:04.437517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:32:04.437517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:32:04.437517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:32:04.437517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:32:04.437517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:32:04.437517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:32:04.437517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:32:04.437517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:32:04.437517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:32:04.437517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:32:04.438966 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:32:04.438966 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:32:04.438966 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:32:04.438966 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:32:04.438966 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:32:04.438966 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:32:04.438966 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:32:04.438966 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:32:04.438966 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:32:04.438966 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:32:04.438966 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:32:04.438966 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:32:04.438966 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:32:04.438966 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:32:04.438966 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:32:04.438966 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:32:04.438966 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:32:04.440009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:32:04.440009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:32:04.440009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:32:04.440009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 547/1094] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:32:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:32:04.444677 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36e873-df22-47ab-a59f-78b45b470682 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:04.554191 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36e873-df22-47ab-a59f-78b45b470682 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:04.589840 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499074c1-e938-471e-b40f-98980c8f0f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:04.590577 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499074c1-e938-471e-b40f-98980c8f0f2b None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:04.590705 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499074c1-e938-471e-b40f-98980c8f0f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:04.590963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499074c1-e938-471e-b40f-98980c8f0f2b None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:04.591593 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499074c1-e938-471e-b40f-98980c8f0f2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:32:04.591927 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499074c1-e938-471e-b40f-98980c8f0f2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:04.593583 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499074c1-e938-471e-b40f-98980c8f0f2b None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:04.605078 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 548/1095] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:04.605604 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0563d-29cf-45ca-a9a2-4e5bb3df422a None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:04.605937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0563d-29cf-45ca-a9a2-4e5bb3df422a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:04.606284 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0563d-29cf-45ca-a9a2-4e5bb3df422a None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:04.607614 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 548/1096] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:32:04.610526 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499074c1-e938-471e-b40f-98980c8f0f2b None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:04.613450 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adc3bc-ad57-4e36-989a-d9cbd77decf7 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:04.613746 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adc3bc-ad57-4e36-989a-d9cbd77decf7 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:04.614009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46adc3bc-ad57-4e36-989a-d9cbd77decf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:04.633396 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-46adc3bc-ad57-4e36-989a-d9cbd77decf7 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:32:04.634590 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-46adc3bc-ad57-4e36-989a-d9cbd77decf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:32:04.671159 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:04.710942 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 549/1097] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:32:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:32:04.726186 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499074c1-e938-471e-b40f-98980c8f0f2b None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:04.762338 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27988031-f66b-434e-90b9-da3986ac7d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:04.762971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27988031-f66b-434e-90b9-da3986ac7d7a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:04.763240 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27988031-f66b-434e-90b9-da3986ac7d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:04.763518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27988031-f66b-434e-90b9-da3986ac7d7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:04.770378 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27988031-f66b-434e-90b9-da3986ac7d7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:04.771948 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27988031-f66b-434e-90b9-da3986ac7d7a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:04.783173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-27988031-f66b-434e-90b9-da3986ac7d7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:32:04.783173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:32:04.783173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:32:04.783173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:32:04.783173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:32:04.783173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:32:04.783173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:32:04.783173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:32:04.783173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:32:04.783173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:32:04.783173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:32:04.783173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:32:04.783173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:32:04.783173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:32:04.783173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:32:04.784205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:32:04.784205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:32:04.784205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:32:04.784205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:32:04.784205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:32:04.784205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:32:04.784205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:32:04.784205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:32:04.784205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:32:04.784205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:32:04.784205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:32:04.784205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:32:04.784205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:32:04.784205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:32:04.784205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:32:04.784205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:32:04.784205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:32:04.785126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:32:04.785126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:32:04.785126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:32:04.785126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:32:04.785126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:32:04.785126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:32:04.785126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:32:04.785126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:32:04.785126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 549/1098] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:32:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:32:04.790539 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46adc3bc-ad57-4e36-989a-d9cbd77decf7 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:04.841426 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:04.893129 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46adc3bc-ad57-4e36-989a-d9cbd77decf7 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:04.927198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dfa77-b14d-42fe-ac96-6105969495ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:04.927892 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dfa77-b14d-42fe-ac96-6105969495ff None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:04.928201 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dfa77-b14d-42fe-ac96-6105969495ff None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:04.928468 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198dfa77-b14d-42fe-ac96-6105969495ff None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:04.929153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198dfa77-b14d-42fe-ac96-6105969495ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:32:04.929445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198dfa77-b14d-42fe-ac96-6105969495ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:04.930886 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198dfa77-b14d-42fe-ac96-6105969495ff None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:04.942665 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 550/1099] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:32:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:04.948867 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27988031-f66b-434e-90b9-da3986ac7d7a None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:04.977431 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dfa77-b14d-42fe-ac96-6105969495ff None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:05.060963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27988031-f66b-434e-90b9-da3986ac7d7a None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:05.079304 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:05.089804 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198dfa77-b14d-42fe-ac96-6105969495ff None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:05.097722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d76c5-653d-4b75-80f5-0496ee174d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:05.098257 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d76c5-653d-4b75-80f5-0496ee174d94 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:05.098554 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d76c5-653d-4b75-80f5-0496ee174d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:05.098819 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d76c5-653d-4b75-80f5-0496ee174d94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:05.099675 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:05.099978 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d76c5-653d-4b75-80f5-0496ee174d94 None admin] RBAC: Adding query filter params (role.id=630ba0cecaa24efeb65159717bf41ac7, scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8, user.id=c559a36836be411b9afd076f4c9a0655) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:32:05.100379 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d76c5-653d-4b75-80f5-0496ee174d94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:05.101813 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d76c5-653d-4b75-80f5-0496ee174d94 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:05.108666 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 550/1100] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:32:04 2022] GET /identity/v3/role_assignments?user.id=c559a36836be411b9afd076f4c9a0655&scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8&role.id=630ba0cecaa24efeb65159717bf41ac7 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:05.131296 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cdd295-1dc9-44c7-affe-26dd6a1d2c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:05.132008 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdd295-1dc9-44c7-affe-26dd6a1d2c78 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:05.132285 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdd295-1dc9-44c7-affe-26dd6a1d2c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:05.132552 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cdd295-1dc9-44c7-affe-26dd6a1d2c78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:05.145882 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cdd295-1dc9-44c7-affe-26dd6a1d2c78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:32:05.151004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-30cdd295-1dc9-44c7-affe-26dd6a1d2c78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:32:05.151004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:32:05.151004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:32:05.151004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:32:05.151004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:32:05.151004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:32:05.151004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:32:05.151004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:32:05.151004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:32:05.151004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:32:05.151004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:32:05.151004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:32:05.151004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:32:05.151004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:32:05.151004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:32:05.151004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:32:05.152322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:32:05.152322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:32:05.152322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:32:05.152322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:32:05.152322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:32:05.152322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:32:05.152322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:32:05.152322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:32:05.152322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:32:05.152322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:32:05.152322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:32:05.152322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:32:05.152322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:32:05.152322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:32:05.152322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:32:05.152322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:32:05.153570 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:32:05.153570 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:32:05.153570 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:32:05.153570 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:32:05.153570 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:32:05.153570 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:32:05.153570 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:32:05.153570 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:32:05.153570 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:32:05.153570 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:32:05.153570 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:32:05.153570 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:32:05.153570 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 551/1101] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:32:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:32:05.158768 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d76c5-653d-4b75-80f5-0496ee174d94 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:05.278929 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d76c5-653d-4b75-80f5-0496ee174d94 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:05.316428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8394d-5ff0-487c-88d1-552be0e7b04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:05.317043 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8394d-5ff0-487c-88d1-552be0e7b04a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:05.317344 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8394d-5ff0-487c-88d1-552be0e7b04a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:05.317608 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8394d-5ff0-487c-88d1-552be0e7b04a None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:05.318269 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8394d-5ff0-487c-88d1-552be0e7b04a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:32:05.318661 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8394d-5ff0-487c-88d1-552be0e7b04a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:05.320028 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8394d-5ff0-487c-88d1-552be0e7b04a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:05.329763 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 551/1102] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:32:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:05.336094 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cdd295-1dc9-44c7-affe-26dd6a1d2c78 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:05.440076 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cdd295-1dc9-44c7-affe-26dd6a1d2c78 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:05.475938 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27879301-484a-4283-b0fd-f467489e360e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:05.476581 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27879301-484a-4283-b0fd-f467489e360e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:05.476858 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27879301-484a-4283-b0fd-f467489e360e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:05.477129 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27879301-484a-4283-b0fd-f467489e360e None admin] PATH_INFO: `/v3/users/a60536f2c61b47cc8c3590ef41ac69f7` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:05.478276 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27879301-484a-4283-b0fd-f467489e360e None admin] RBAC: Authorizing `identity:get_user(user_id=a60536f2c61b47cc8c3590ef41ac69f7)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:05.479789 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27879301-484a-4283-b0fd-f467489e360e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:05.481374 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 552/1103] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:32:05 2022] GET /identity/v3/users/a60536f2c61b47cc8c3590ef41ac69f7 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:05.488197 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8394d-5ff0-487c-88d1-552be0e7b04a None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:05.537250 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:05.597799 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8394d-5ff0-487c-88d1-552be0e7b04a None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:05.632029 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c2e46-2c22-45fb-99a5-d29246d79320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:05.632647 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c2e46-2c22-45fb-99a5-d29246d79320 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:05.632922 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c2e46-2c22-45fb-99a5-d29246d79320 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:05.633195 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c2e46-2c22-45fb-99a5-d29246d79320 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:05.705375 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c2e46-2c22-45fb-99a5-d29246d79320 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:05.707498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084c2e46-2c22-45fb-99a5-d29246d79320 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:05.752431 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:05.814415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 552/1104] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:32:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:32:05.820954 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27879301-484a-4283-b0fd-f467489e360e None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:05.857097 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:05.928924 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27879301-484a-4283-b0fd-f467489e360e None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:05.964513 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40e636-158c-43ee-8562-fcfe9db1b7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:05.965058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40e636-158c-43ee-8562-fcfe9db1b7a6 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:05.965332 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40e636-158c-43ee-8562-fcfe9db1b7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:05.965595 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40e636-158c-43ee-8562-fcfe9db1b7a6 None admin] PATH_INFO: `/v3/projects/401906bd7fc74dd3b98ca2ae11e1903b` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:05.966690 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa40e636-158c-43ee-8562-fcfe9db1b7a6 None admin] RBAC: Authorizing `identity:get_project(project_id=401906bd7fc74dd3b98ca2ae11e1903b)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:05.968204 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa40e636-158c-43ee-8562-fcfe9db1b7a6 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:05.969824 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 553/1105] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:32:05 2022] GET /identity/v3/projects/401906bd7fc74dd3b98ca2ae11e1903b => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:05.976384 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c2e46-2c22-45fb-99a5-d29246d79320 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:06.074603 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084c2e46-2c22-45fb-99a5-d29246d79320 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:06.109822 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dafed9-5bcf-4ea9-a2da-29219f3137e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:06.110444 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dafed9-5bcf-4ea9-a2da-29219f3137e2 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:06.110686 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dafed9-5bcf-4ea9-a2da-29219f3137e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:06.110954 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dafed9-5bcf-4ea9-a2da-29219f3137e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:06.111671 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dafed9-5bcf-4ea9-a2da-29219f3137e2 None admin] RBAC: Adding query filter params (role.id=cf58d66369044fb09fa65a4366dc7446, scope.project.id=401906bd7fc74dd3b98ca2ae11e1903b, user.id=a60536f2c61b47cc8c3590ef41ac69f7) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:32:06.112007 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dafed9-5bcf-4ea9-a2da-29219f3137e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:06.113433 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dafed9-5bcf-4ea9-a2da-29219f3137e2 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:06.119407 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 553/1106] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:32:05 2022] GET /identity/v3/role_assignments?user.id=a60536f2c61b47cc8c3590ef41ac69f7&scope.project.id=401906bd7fc74dd3b98ca2ae11e1903b&role.id=cf58d66369044fb09fa65a4366dc7446 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:08.293650 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125cbd3d-610f-454d-ab6b-21d2c4da352a None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:08.294216 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125cbd3d-610f-454d-ab6b-21d2c4da352a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:08.294216 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125cbd3d-610f-454d-ab6b-21d2c4da352a None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:08.295528 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 554/1107] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:32:08.301114 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ed912-5ed7-497f-9d8b-c8711d50dc12 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:08.301521 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ed912-5ed7-497f-9d8b-c8711d50dc12 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:08.301653 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ed912-5ed7-497f-9d8b-c8711d50dc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:08.315407 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:08.321538 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-259ed912-5ed7-497f-9d8b-c8711d50dc12 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:32:08.322744 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-259ed912-5ed7-497f-9d8b-c8711d50dc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:32:08.392411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 554/1108] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:32:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:32:08.657753 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125cbd3d-610f-454d-ab6b-21d2c4da352a None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:08.767050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125cbd3d-610f-454d-ab6b-21d2c4da352a None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:08.769517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:08.805701 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436449ea-c6a7-4125-b2e5-7f7dfe9fe548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:08.806318 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436449ea-c6a7-4125-b2e5-7f7dfe9fe548 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:08.806587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436449ea-c6a7-4125-b2e5-7f7dfe9fe548 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:08.806850 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436449ea-c6a7-4125-b2e5-7f7dfe9fe548 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:08.808036 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436449ea-c6a7-4125-b2e5-7f7dfe9fe548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:08.809475 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436449ea-c6a7-4125-b2e5-7f7dfe9fe548 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:08.811054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 555/1109] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:32:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:08.817121 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ed912-5ed7-497f-9d8b-c8711d50dc12 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:08.942858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ed912-5ed7-497f-9d8b-c8711d50dc12 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:08.977445 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f62262-a268-44a2-9ff9-3cb619cf1f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:08.978049 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f62262-a268-44a2-9ff9-3cb619cf1f91 None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:08.978322 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f62262-a268-44a2-9ff9-3cb619cf1f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:08.978586 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f62262-a268-44a2-9ff9-3cb619cf1f91 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:08.979223 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f62262-a268-44a2-9ff9-3cb619cf1f91 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:08.980663 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f62262-a268-44a2-9ff9-3cb619cf1f91 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:08.989737 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:09.004120 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 555/1110] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 26 05:32:08 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:32:11.190062 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273f5c1-cfd0-4a8c-a5c6-f40c171dc711 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:11.190668 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273f5c1-cfd0-4a8c-a5c6-f40c171dc711 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:11.190668 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273f5c1-cfd0-4a8c-a5c6-f40c171dc711 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:11.191995 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 556/1111] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:32:11.197586 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e2884-15f5-4b1f-a35e-de5326d17220 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:11.198068 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e2884-15f5-4b1f-a35e-de5326d17220 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:11.198068 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e2884-15f5-4b1f-a35e-de5326d17220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:11.217291 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-f20e2884-15f5-4b1f-a35e-de5326d17220 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:32:11.218482 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f20e2884-15f5-4b1f-a35e-de5326d17220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:32:11.287359 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 556/1112] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:32:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:32:11.551403 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273f5c1-cfd0-4a8c-a5c6-f40c171dc711 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:11.662655 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273f5c1-cfd0-4a8c-a5c6-f40c171dc711 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:11.698089 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53353a-915e-43a5-aeab-c2475d7317c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:11.698707 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53353a-915e-43a5-aeab-c2475d7317c3 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:11.698979 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53353a-915e-43a5-aeab-c2475d7317c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:11.699249 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa53353a-915e-43a5-aeab-c2475d7317c3 None admin] PATH_INFO: `/v3/roles/7cb00fff13fb4eefa6a734c91c0d59ea` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:11.700700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53353a-915e-43a5-aeab-c2475d7317c3 None admin] RBAC: Authorizing `identity:get_role(role_id=7cb00fff13fb4eefa6a734c91c0d59ea)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:11.703967 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa53353a-915e-43a5-aeab-c2475d7317c3 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:11.703967 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 557/1113] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:32:11 2022] GET /identity/v3/roles/7cb00fff13fb4eefa6a734c91c0d59ea => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:11.710018 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e2884-15f5-4b1f-a35e-de5326d17220 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:11.810375 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e2884-15f5-4b1f-a35e-de5326d17220 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:11.833929 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:11.847334 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ceec20-2ab1-4f63-b08a-449af1259cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:11.848045 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ceec20-2ab1-4f63-b08a-449af1259cef None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:11.848341 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ceec20-2ab1-4f63-b08a-449af1259cef None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:11.848686 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ceec20-2ab1-4f63-b08a-449af1259cef None admin] PATH_INFO: `/v3/users/00e30e0d465542758be338226dce2b7c` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:11.862599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ceec20-2ab1-4f63-b08a-449af1259cef None admin] RBAC: Authorizing `identity:get_user(user_id=00e30e0d465542758be338226dce2b7c)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:11.864084 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ceec20-2ab1-4f63-b08a-449af1259cef None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:11.865733 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 557/1114] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:32:11 2022] GET /identity/v3/users/00e30e0d465542758be338226dce2b7c => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:11.871793 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53353a-915e-43a5-aeab-c2475d7317c3 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:11.917314 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:11.982200 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa53353a-915e-43a5-aeab-c2475d7317c3 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:12.016575 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699a030-9772-4c00-af87-5573e3dceba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:12.017181 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699a030-9772-4c00-af87-5573e3dceba8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:12.017454 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699a030-9772-4c00-af87-5573e3dceba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:12.017721 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699a030-9772-4c00-af87-5573e3dceba8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:12.085943 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699a030-9772-4c00-af87-5573e3dceba8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:12.087299 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699a030-9772-4c00-af87-5573e3dceba8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:12.126942 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:12.184518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 558/1115] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:32:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:32:12.190717 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ceec20-2ab1-4f63-b08a-449af1259cef None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:12.292443 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ceec20-2ab1-4f63-b08a-449af1259cef None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:12.330377 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae50d9-4ac0-43dd-9184-7822b85bc665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:12.331014 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae50d9-4ac0-43dd-9184-7822b85bc665 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:12.331263 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae50d9-4ac0-43dd-9184-7822b85bc665 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:12.331530 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae50d9-4ac0-43dd-9184-7822b85bc665 None admin] PATH_INFO: `/v3/projects/401906bd7fc74dd3b98ca2ae11e1903b` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:12.332739 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae50d9-4ac0-43dd-9184-7822b85bc665 None admin] RBAC: Authorizing `identity:get_project(project_id=401906bd7fc74dd3b98ca2ae11e1903b)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:12.334271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae50d9-4ac0-43dd-9184-7822b85bc665 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:12.335933 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 558/1116] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:32:12 2022] GET /identity/v3/projects/401906bd7fc74dd3b98ca2ae11e1903b => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:12.342500 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699a030-9772-4c00-af87-5573e3dceba8 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:12.448662 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699a030-9772-4c00-af87-5573e3dceba8 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:12.484329 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52bfd6c-d65c-4d56-b2b6-719b55aa7fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:12.484766 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bfd6c-d65c-4d56-b2b6-719b55aa7fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:12.485039 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bfd6c-d65c-4d56-b2b6-719b55aa7fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:12.485579 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52bfd6c-d65c-4d56-b2b6-719b55aa7fe2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:12.486141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52bfd6c-d65c-4d56-b2b6-719b55aa7fe2 None admin] RBAC: Adding query filter params (role.id=7cb00fff13fb4eefa6a734c91c0d59ea, scope.project.id=401906bd7fc74dd3b98ca2ae11e1903b, user.id=00e30e0d465542758be338226dce2b7c) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:32:12.486320 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52bfd6c-d65c-4d56-b2b6-719b55aa7fe2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:12.487778 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52bfd6c-d65c-4d56-b2b6-719b55aa7fe2 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:12.495328 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 559/1117] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:32:12 2022] GET /identity/v3/role_assignments?user.id=00e30e0d465542758be338226dce2b7c&scope.project.id=401906bd7fc74dd3b98ca2ae11e1903b&role.id=7cb00fff13fb4eefa6a734c91c0d59ea => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:14.649715 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee02fe7-ee7f-4541-ae6f-25ef768df73b None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:14.650396 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee02fe7-ee7f-4541-ae6f-25ef768df73b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:14.650396 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee02fe7-ee7f-4541-ae6f-25ef768df73b None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:14.651605 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 559/1118] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:32:14.657057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e6a6a-eb5d-4ff5-8e69-84e8b9bf9203 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:14.657529 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e6a6a-eb5d-4ff5-8e69-84e8b9bf9203 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:14.657635 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e6a6a-eb5d-4ff5-8e69-84e8b9bf9203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:14.665621 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:14.678386 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-e29e6a6a-eb5d-4ff5-8e69-84e8b9bf9203 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:32:14.679579 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e29e6a6a-eb5d-4ff5-8e69-84e8b9bf9203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:32:14.751066 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 560/1119] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:32:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:32:15.017844 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee02fe7-ee7f-4541-ae6f-25ef768df73b None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:15.070698 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:15.125149 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee02fe7-ee7f-4541-ae6f-25ef768df73b None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:15.161005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a1134-293e-4f10-9fe0-e1f2704465f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:15.161630 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a1134-293e-4f10-9fe0-e1f2704465f6 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:15.161904 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a1134-293e-4f10-9fe0-e1f2704465f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:15.162237 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a1134-293e-4f10-9fe0-e1f2704465f6 None admin] PATH_INFO: `/v3/roles/7cb00fff13fb4eefa6a734c91c0d59ea` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:15.163693 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a1134-293e-4f10-9fe0-e1f2704465f6 None admin] RBAC: Authorizing `identity:get_role(role_id=7cb00fff13fb4eefa6a734c91c0d59ea)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:15.165085 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a1134-293e-4f10-9fe0-e1f2704465f6 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:15.166446 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 560/1120] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:32:15 2022] GET /identity/v3/roles/7cb00fff13fb4eefa6a734c91c0d59ea => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:15.172653 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e6a6a-eb5d-4ff5-8e69-84e8b9bf9203 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:15.274738 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e6a6a-eb5d-4ff5-8e69-84e8b9bf9203 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:15.311212 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10330f-dec9-4fbd-8a1a-893d166e0b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:15.311871 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10330f-dec9-4fbd-8a1a-893d166e0b80 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:15.312144 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10330f-dec9-4fbd-8a1a-893d166e0b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:15.312403 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10330f-dec9-4fbd-8a1a-893d166e0b80 None admin] PATH_INFO: `/v3/users/00e30e0d465542758be338226dce2b7c` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:15.313534 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10330f-dec9-4fbd-8a1a-893d166e0b80 None admin] RBAC: Authorizing `identity:get_user(user_id=00e30e0d465542758be338226dce2b7c)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:15.314972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10330f-dec9-4fbd-8a1a-893d166e0b80 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:15.316614 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 561/1121] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:32:15 2022] GET /identity/v3/users/00e30e0d465542758be338226dce2b7c => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:15.322817 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a1134-293e-4f10-9fe0-e1f2704465f6 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:15.424623 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a1134-293e-4f10-9fe0-e1f2704465f6 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:15.441795 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:15.462130 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbcb8d-3a8d-4392-993c-c89de3f81208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:15.462745 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbcb8d-3a8d-4392-993c-c89de3f81208 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:15.462997 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbcb8d-3a8d-4392-993c-c89de3f81208 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:15.463262 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbcb8d-3a8d-4392-993c-c89de3f81208 None admin] PATH_INFO: `/v3/projects/401906bd7fc74dd3b98ca2ae11e1903b` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:15.464426 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbcb8d-3a8d-4392-993c-c89de3f81208 None admin] RBAC: Authorizing `identity:get_project(project_id=401906bd7fc74dd3b98ca2ae11e1903b)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:15.465846 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbcb8d-3a8d-4392-993c-c89de3f81208 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:15.467461 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 561/1122] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:32:15 2022] GET /identity/v3/projects/401906bd7fc74dd3b98ca2ae11e1903b => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:15.473683 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10330f-dec9-4fbd-8a1a-893d166e0b80 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:15.476696 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:15.572292 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10330f-dec9-4fbd-8a1a-893d166e0b80 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:15.606842 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b22a36-c306-4737-b852-2593db3136ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:15.607479 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b22a36-c306-4737-b852-2593db3136ed None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:15.607773 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b22a36-c306-4737-b852-2593db3136ed None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:15.608043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b22a36-c306-4737-b852-2593db3136ed None admin] PATH_INFO: `/v3/projects/401906bd7fc74dd3b98ca2ae11e1903b/users/00e30e0d465542758be338226dce2b7c/roles/7cb00fff13fb4eefa6a734c91c0d59ea` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:15.610196 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b22a36-c306-4737-b852-2593db3136ed None admin] RBAC: Authorizing `identity:create_grant(project_id=401906bd7fc74dd3b98ca2ae11e1903b, user_id=00e30e0d465542758be338226dce2b7c, role_id=7cb00fff13fb4eefa6a734c91c0d59ea)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:15.611622 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b22a36-c306-4737-b852-2593db3136ed None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:15.625733 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 562/1123] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 26 05:32:15 2022] PUT /identity/v3/projects/401906bd7fc74dd3b98ca2ae11e1903b/users/00e30e0d465542758be338226dce2b7c/roles/7cb00fff13fb4eefa6a734c91c0d59ea => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:32:17.779548 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5457e91-edf2-46df-bbf3-2a8a30206e71 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:17.780193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5457e91-edf2-46df-bbf3-2a8a30206e71 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:17.780193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5457e91-edf2-46df-bbf3-2a8a30206e71 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:17.781459 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 562/1124] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:32:17.787853 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac90936-3f87-4e0a-80e6-9d14e857e88b None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:17.788427 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac90936-3f87-4e0a-80e6-9d14e857e88b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:17.788427 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac90936-3f87-4e0a-80e6-9d14e857e88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:17.808842 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-8ac90936-3f87-4e0a-80e6-9d14e857e88b None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:32:17.810076 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8ac90936-3f87-4e0a-80e6-9d14e857e88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:32:17.877246 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:17.896718 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 563/1125] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:32:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:32:18.168216 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5457e91-edf2-46df-bbf3-2a8a30206e71 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:18.274672 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5457e91-edf2-46df-bbf3-2a8a30206e71 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:18.309517 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7dc8e-7bc6-4c5a-ba97-1844c5cd6d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:18.310137 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7dc8e-7bc6-4c5a-ba97-1844c5cd6d72 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:18.310417 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7dc8e-7bc6-4c5a-ba97-1844c5cd6d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:18.310687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7dc8e-7bc6-4c5a-ba97-1844c5cd6d72 None admin] PATH_INFO: `/v3/roles/7cb00fff13fb4eefa6a734c91c0d59ea` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:18.312120 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7dc8e-7bc6-4c5a-ba97-1844c5cd6d72 None admin] RBAC: Authorizing `identity:get_role(role_id=7cb00fff13fb4eefa6a734c91c0d59ea)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:18.313479 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7dc8e-7bc6-4c5a-ba97-1844c5cd6d72 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:18.314843 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 563/1126] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:32:18 2022] GET /identity/v3/roles/7cb00fff13fb4eefa6a734c91c0d59ea => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:18.321058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac90936-3f87-4e0a-80e6-9d14e857e88b None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:18.424256 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac90936-3f87-4e0a-80e6-9d14e857e88b None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:18.459407 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42568dac-b923-4e71-bd25-b4f938e91f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:18.460068 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42568dac-b923-4e71-bd25-b4f938e91f4e None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:18.460340 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42568dac-b923-4e71-bd25-b4f938e91f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:18.460612 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42568dac-b923-4e71-bd25-b4f938e91f4e None admin] PATH_INFO: `/v3/users/00e30e0d465542758be338226dce2b7c` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:18.461756 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42568dac-b923-4e71-bd25-b4f938e91f4e None admin] RBAC: Authorizing `identity:get_user(user_id=00e30e0d465542758be338226dce2b7c)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:18.463206 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42568dac-b923-4e71-bd25-b4f938e91f4e None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:18.464818 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 564/1127] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:32:18 2022] GET /identity/v3/users/00e30e0d465542758be338226dce2b7c => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:18.470883 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7dc8e-7bc6-4c5a-ba97-1844c5cd6d72 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:18.525367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:18.573325 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7dc8e-7bc6-4c5a-ba97-1844c5cd6d72 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:18.611560 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773af59-1658-4a5d-992a-fbb035c95fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:18.612189 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773af59-1658-4a5d-992a-fbb035c95fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:18.612462 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773af59-1658-4a5d-992a-fbb035c95fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:18.612730 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773af59-1658-4a5d-992a-fbb035c95fd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:18.680758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8773af59-1658-4a5d-992a-fbb035c95fd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:18.682098 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8773af59-1658-4a5d-992a-fbb035c95fd4 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:18.733470 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:18.783282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 564/1128] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:32:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:32:18.789530 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42568dac-b923-4e71-bd25-b4f938e91f4e None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:18.851148 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:18.892778 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42568dac-b923-4e71-bd25-b4f938e91f4e None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:18.935842 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f362cc-b37c-4d75-8b4c-9b12b140b5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:18.936415 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f362cc-b37c-4d75-8b4c-9b12b140b5ce None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:18.936688 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f362cc-b37c-4d75-8b4c-9b12b140b5ce None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:18.936956 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f362cc-b37c-4d75-8b4c-9b12b140b5ce None admin] PATH_INFO: `/v3/projects/401906bd7fc74dd3b98ca2ae11e1903b` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:18.938150 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f362cc-b37c-4d75-8b4c-9b12b140b5ce None admin] RBAC: Authorizing `identity:get_project(project_id=401906bd7fc74dd3b98ca2ae11e1903b)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:18.939632 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f362cc-b37c-4d75-8b4c-9b12b140b5ce None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:18.941307 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 565/1129] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:32:18 2022] GET /identity/v3/projects/401906bd7fc74dd3b98ca2ae11e1903b => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:18.947775 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773af59-1658-4a5d-992a-fbb035c95fd4 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:19.054099 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773af59-1658-4a5d-992a-fbb035c95fd4 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:19.089291 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26106ca-2475-4784-bd98-3e2e84328e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:19.089886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26106ca-2475-4784-bd98-3e2e84328e83 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:19.090164 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26106ca-2475-4784-bd98-3e2e84328e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:19.090420 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26106ca-2475-4784-bd98-3e2e84328e83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:19.091139 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26106ca-2475-4784-bd98-3e2e84328e83 None admin] RBAC: Adding query filter params (role.id=7cb00fff13fb4eefa6a734c91c0d59ea, scope.project.id=401906bd7fc74dd3b98ca2ae11e1903b, user.id=00e30e0d465542758be338226dce2b7c) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:32:19.091443 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26106ca-2475-4784-bd98-3e2e84328e83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:19.092900 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26106ca-2475-4784-bd98-3e2e84328e83 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:19.099337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 565/1130] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:32:18 2022] GET /identity/v3/role_assignments?user.id=00e30e0d465542758be338226dce2b7c&scope.project.id=401906bd7fc74dd3b98ca2ae11e1903b&role.id=7cb00fff13fb4eefa6a734c91c0d59ea => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:21.250038 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc5894-6b06-44c2-906e-bf9f686bf2c4 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:21.250648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc5894-6b06-44c2-906e-bf9f686bf2c4 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:21.250648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc5894-6b06-44c2-906e-bf9f686bf2c4 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:21.251969 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 566/1131] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:32:21.257847 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e26a01-4a3f-477f-945a-b4227c274d9f None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:21.258282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e26a01-4a3f-477f-945a-b4227c274d9f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:21.258387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e26a01-4a3f-477f-945a-b4227c274d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:21.277298 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-60e26a01-4a3f-477f-945a-b4227c274d9f None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:32:21.278480 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-60e26a01-4a3f-477f-945a-b4227c274d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:32:21.289802 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:21.353443 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 566/1132] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:32:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 05:32:21.621452 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc5894-6b06-44c2-906e-bf9f686bf2c4 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:21.733064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc5894-6b06-44c2-906e-bf9f686bf2c4 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:21.759555 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:21.768549 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72ca83-04ac-4cdf-8445-341684d27f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:21.769180 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72ca83-04ac-4cdf-8445-341684d27f06 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:21.769449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72ca83-04ac-4cdf-8445-341684d27f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:21.769710 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72ca83-04ac-4cdf-8445-341684d27f06 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:21.770925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72ca83-04ac-4cdf-8445-341684d27f06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:21.772408 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72ca83-04ac-4cdf-8445-341684d27f06 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:21.774000 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 567/1133] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:32:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:21.780145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e26a01-4a3f-477f-945a-b4227c274d9f None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:21.880410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e26a01-4a3f-477f-945a-b4227c274d9f None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:21.915028 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444b0afd-fa3b-4ae8-abbd-8fa2e2dd0074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:21.915627 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b0afd-fa3b-4ae8-abbd-8fa2e2dd0074 None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:21.915928 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b0afd-fa3b-4ae8-abbd-8fa2e2dd0074 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:21.916199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444b0afd-fa3b-4ae8-abbd-8fa2e2dd0074 None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:21.916832 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b0afd-fa3b-4ae8-abbd-8fa2e2dd0074 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:21.918255 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444b0afd-fa3b-4ae8-abbd-8fa2e2dd0074 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:21.940384 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:21.947823 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 567/1134] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Sep 26 05:32:21 2022] POST /identity/v3/projects => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:32:24.127452 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aed81-f3d2-4396-a6b6-bdeaf154c461 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:24.128049 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aed81-f3d2-4396-a6b6-bdeaf154c461 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:24.128049 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aed81-f3d2-4396-a6b6-bdeaf154c461 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:24.129294 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 568/1135] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:32:24.134885 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4a083-2fde-4b13-bf64-6943760e50c1 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:24.135335 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4a083-2fde-4b13-bf64-6943760e50c1 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:24.135441 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4a083-2fde-4b13-bf64-6943760e50c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:24.154121 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-70a4a083-2fde-4b13-bf64-6943760e50c1 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:32:24.155309 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-70a4a083-2fde-4b13-bf64-6943760e50c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:32:24.225632 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 568/1136] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:32:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:32:24.487808 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771aed81-f3d2-4396-a6b6-bdeaf154c461 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:24.605841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771aed81-f3d2-4396-a6b6-bdeaf154c461 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:24.645716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254aa12-5f99-48fe-bf7c-fd6bf39f8c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:24.646711 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254aa12-5f99-48fe-bf7c-fd6bf39f8c8f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:24.647126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254aa12-5f99-48fe-bf7c-fd6bf39f8c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:24.647524 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254aa12-5f99-48fe-bf7c-fd6bf39f8c8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:24.649377 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254aa12-5f99-48fe-bf7c-fd6bf39f8c8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:24.651271 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254aa12-5f99-48fe-bf7c-fd6bf39f8c8f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:24.653452 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 569/1137] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:32:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:24.659601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4a083-2fde-4b13-bf64-6943760e50c1 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:24.765080 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4a083-2fde-4b13-bf64-6943760e50c1 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:24.802902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:24.812532 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f2b09-acf1-41ee-a39b-054d894967fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:24.813151 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f2b09-acf1-41ee-a39b-054d894967fb None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:24.813430 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f2b09-acf1-41ee-a39b-054d894967fb None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:24.813699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f2b09-acf1-41ee-a39b-054d894967fb None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:24.814358 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f2b09-acf1-41ee-a39b-054d894967fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:24.815836 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f2b09-acf1-41ee-a39b-054d894967fb None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:24.839430 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 569/1138] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 26 05:32:24 2022] POST /identity/v3/users => generated 286 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:32:26.988568 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37128b-6b18-4e95-8155-8601578f48d6 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:26.989103 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37128b-6b18-4e95-8155-8601578f48d6 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:26.989103 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37128b-6b18-4e95-8155-8601578f48d6 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:26.990373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 570/1139] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:32:26.996775 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea6075-98be-4116-8bdb-36400abcfcff None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:26.997282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea6075-98be-4116-8bdb-36400abcfcff None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:26.997388 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea6075-98be-4116-8bdb-36400abcfcff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:27.019355 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-a0ea6075-98be-4116-8bdb-36400abcfcff None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:32:27.020613 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a0ea6075-98be-4116-8bdb-36400abcfcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:32:27.091307 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 570/1140] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:32:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:32:27.362291 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37128b-6b18-4e95-8155-8601578f48d6 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:27.431386 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:27.472566 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37128b-6b18-4e95-8155-8601578f48d6 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:27.507885 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd785c7-a98b-48ea-8b89-36d4fa494c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:27.508513 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd785c7-a98b-48ea-8b89-36d4fa494c24 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:27.508790 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd785c7-a98b-48ea-8b89-36d4fa494c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:27.509058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd785c7-a98b-48ea-8b89-36d4fa494c24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:27.520219 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd785c7-a98b-48ea-8b89-36d4fa494c24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:32:27.525108 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-0bd785c7-a98b-48ea-8b89-36d4fa494c24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:32:27.525108 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:32:27.525108 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:32:27.525108 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:32:27.525108 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:32:27.525108 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:32:27.525108 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:32:27.525108 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:32:27.525108 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:32:27.525108 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:32:27.525108 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:32:27.525108 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:32:27.525108 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:32:27.525108 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:32:27.525108 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:32:27.525108 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:32:27.526237 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:32:27.526237 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:32:27.526237 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:32:27.526237 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:32:27.526237 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:32:27.526237 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:32:27.526237 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:32:27.526237 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:32:27.526237 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:32:27.526237 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:32:27.526237 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:32:27.526237 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:32:27.526237 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:32:27.526237 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:32:27.526237 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:32:27.526237 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:32:27.527565 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:32:27.527565 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:32:27.527565 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:32:27.527565 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:32:27.527565 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:32:27.527565 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:32:27.527565 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:32:27.527565 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:32:27.527565 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:32:27.527565 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:32:27.527565 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:32:27.527565 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:32:27.527565 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 571/1141] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:32:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:32:27.532483 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea6075-98be-4116-8bdb-36400abcfcff None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:27.634116 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea6075-98be-4116-8bdb-36400abcfcff None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:27.650072 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:27.673292 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab2ac7-2bf6-4d34-b726-3dd268ce7ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:27.673899 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab2ac7-2bf6-4d34-b726-3dd268ce7ad9 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:27.674170 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab2ac7-2bf6-4d34-b726-3dd268ce7ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:27.674432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab2ac7-2bf6-4d34-b726-3dd268ce7ad9 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:27.675087 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab2ac7-2bf6-4d34-b726-3dd268ce7ad9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:32:27.675380 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab2ac7-2bf6-4d34-b726-3dd268ce7ad9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:27.676833 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab2ac7-2bf6-4d34-b726-3dd268ce7ad9 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:27.684963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 571/1142] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:32:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:27.691237 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd785c7-a98b-48ea-8b89-36d4fa494c24 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:27.797070 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd785c7-a98b-48ea-8b89-36d4fa494c24 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:27.821135 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:27.833068 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c8649-e89e-47a1-8e5f-79ea77430b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:27.833727 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c8649-e89e-47a1-8e5f-79ea77430b6f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:27.834001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c8649-e89e-47a1-8e5f-79ea77430b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:27.834275 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c8649-e89e-47a1-8e5f-79ea77430b6f None admin] PATH_INFO: `/v3/users/fb03c41eafe44c468aa8f8621ae647e1` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:27.847894 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c8649-e89e-47a1-8e5f-79ea77430b6f None admin] RBAC: Authorizing `identity:get_user(user_id=fb03c41eafe44c468aa8f8621ae647e1)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:27.849392 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c8649-e89e-47a1-8e5f-79ea77430b6f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:27.851152 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 572/1143] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:32:27 2022] GET /identity/v3/users/fb03c41eafe44c468aa8f8621ae647e1 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:27.857261 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab2ac7-2bf6-4d34-b726-3dd268ce7ad9 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:27.962553 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab2ac7-2bf6-4d34-b726-3dd268ce7ad9 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:27.996962 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a83cc-f92a-40ba-b0f3-963f1ddfc9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:27.997606 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a83cc-f92a-40ba-b0f3-963f1ddfc9d6 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:27.997820 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a83cc-f92a-40ba-b0f3-963f1ddfc9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:27.998083 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a83cc-f92a-40ba-b0f3-963f1ddfc9d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:28.043578 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:28.071563 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a83cc-f92a-40ba-b0f3-963f1ddfc9d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:28.073053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3a83cc-f92a-40ba-b0f3-963f1ddfc9d6 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:28.172590 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 572/1144] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:32:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:32:28.178915 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c8649-e89e-47a1-8e5f-79ea77430b6f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:28.279542 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c8649-e89e-47a1-8e5f-79ea77430b6f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:28.314048 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a95d52-5ef2-4b48-906d-6a76240c9bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:28.314662 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a95d52-5ef2-4b48-906d-6a76240c9bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:28.314932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a95d52-5ef2-4b48-906d-6a76240c9bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:28.315196 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a95d52-5ef2-4b48-906d-6a76240c9bb5 None admin] PATH_INFO: `/v3/projects/e4082cb9a3f2475f8947bc8e8d108c41` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:28.316479 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a95d52-5ef2-4b48-906d-6a76240c9bb5 None admin] RBAC: Authorizing `identity:get_project(project_id=e4082cb9a3f2475f8947bc8e8d108c41)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:28.318040 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a95d52-5ef2-4b48-906d-6a76240c9bb5 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:28.319716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 573/1145] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:32:28 2022] GET /identity/v3/projects/e4082cb9a3f2475f8947bc8e8d108c41 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:28.326553 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a83cc-f92a-40ba-b0f3-963f1ddfc9d6 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:28.400861 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:28.425477 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a83cc-f92a-40ba-b0f3-963f1ddfc9d6 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:28.459650 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61becfd-59a8-43c3-8ce5-5f22680cb9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:28.460273 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61becfd-59a8-43c3-8ce5-5f22680cb9b5 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:28.460546 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61becfd-59a8-43c3-8ce5-5f22680cb9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:28.460806 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61becfd-59a8-43c3-8ce5-5f22680cb9b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:28.461520 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61becfd-59a8-43c3-8ce5-5f22680cb9b5 None admin] RBAC: Adding query filter params (role.id=cf58d66369044fb09fa65a4366dc7446, scope.project.id=e4082cb9a3f2475f8947bc8e8d108c41, user.id=fb03c41eafe44c468aa8f8621ae647e1) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:32:28.461821 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61becfd-59a8-43c3-8ce5-5f22680cb9b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:28.463234 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61becfd-59a8-43c3-8ce5-5f22680cb9b5 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:28.468770 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 573/1146] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:32:28 2022] GET /identity/v3/role_assignments?user.id=fb03c41eafe44c468aa8f8621ae647e1&scope.project.id=e4082cb9a3f2475f8947bc8e8d108c41&role.id=cf58d66369044fb09fa65a4366dc7446 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:30.565741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8985e-0128-4c29-ad0c-f60d407ebda8 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:30.566310 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8985e-0128-4c29-ad0c-f60d407ebda8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:30.566310 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb8985e-0128-4c29-ad0c-f60d407ebda8 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:30.567621 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 574/1147] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:32:30.573053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47509e-f745-42d7-ade7-05dd43cdb46f None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:30.573470 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47509e-f745-42d7-ade7-05dd43cdb46f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:30.573576 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47509e-f745-42d7-ade7-05dd43cdb46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:30.593103 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-aa47509e-f745-42d7-ade7-05dd43cdb46f None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:32:30.594361 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-aa47509e-f745-42d7-ade7-05dd43cdb46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:32:30.662560 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 574/1148] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:32:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:32:30.923968 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8985e-0128-4c29-ad0c-f60d407ebda8 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:30.977723 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:31.029292 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb8985e-0128-4c29-ad0c-f60d407ebda8 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:31.065428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df234e3-6603-4a10-ae47-8959be27104c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:31.066047 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df234e3-6603-4a10-ae47-8959be27104c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:31.066326 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df234e3-6603-4a10-ae47-8959be27104c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:31.066581 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df234e3-6603-4a10-ae47-8959be27104c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:31.077359 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df234e3-6603-4a10-ae47-8959be27104c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:32:31.082100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-7df234e3-6603-4a10-ae47-8959be27104c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:32:31.082100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:32:31.082100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:32:31.082100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:32:31.082100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:32:31.082100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:32:31.082100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:32:31.082100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:32:31.082100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:32:31.082100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:32:31.082100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:32:31.082100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:32:31.082100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:32:31.082100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:32:31.082100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:32:31.082100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:32:31.083174 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:32:31.083174 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:32:31.083174 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:32:31.083174 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:32:31.083174 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:32:31.083174 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:32:31.083174 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:32:31.083174 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:32:31.083174 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:32:31.083174 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:32:31.083174 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:32:31.083174 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:32:31.083174 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:32:31.083174 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:32:31.083174 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:32:31.083174 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:32:31.084276 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:32:31.084276 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:32:31.084276 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:32:31.084276 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:32:31.084276 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:32:31.084276 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:32:31.084276 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:32:31.084276 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:32:31.084276 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:32:31.084276 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:32:31.084276 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:32:31.084276 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:32:31.084276 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 575/1149] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:32:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:32:31.089645 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47509e-f745-42d7-ade7-05dd43cdb46f None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:31.158842 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:31.189817 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47509e-f745-42d7-ade7-05dd43cdb46f None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:31.226157 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815144e-43b9-4358-9417-cd2b97d2b66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:31.226766 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815144e-43b9-4358-9417-cd2b97d2b66b None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:31.227032 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815144e-43b9-4358-9417-cd2b97d2b66b None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:31.227284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815144e-43b9-4358-9417-cd2b97d2b66b None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:31.227981 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815144e-43b9-4358-9417-cd2b97d2b66b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:32:31.228275 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815144e-43b9-4358-9417-cd2b97d2b66b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:31.229625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815144e-43b9-4358-9417-cd2b97d2b66b None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:31.238035 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 575/1150] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:32:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:31.245224 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df234e3-6603-4a10-ae47-8959be27104c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:31.346839 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df234e3-6603-4a10-ae47-8959be27104c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:31.357379 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:31.383278 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4519da-46ee-40df-9518-bf7c10a55b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:31.383952 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4519da-46ee-40df-9518-bf7c10a55b03 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:31.384228 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4519da-46ee-40df-9518-bf7c10a55b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:31.384496 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4519da-46ee-40df-9518-bf7c10a55b03 None admin] PATH_INFO: `/v3/users/fb03c41eafe44c468aa8f8621ae647e1` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:31.385677 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4519da-46ee-40df-9518-bf7c10a55b03 None admin] RBAC: Authorizing `identity:get_user(user_id=fb03c41eafe44c468aa8f8621ae647e1)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:31.387128 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4519da-46ee-40df-9518-bf7c10a55b03 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:31.388757 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 576/1151] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:32:31 2022] GET /identity/v3/users/fb03c41eafe44c468aa8f8621ae647e1 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:31.394883 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815144e-43b9-4358-9417-cd2b97d2b66b None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:31.496599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815144e-43b9-4358-9417-cd2b97d2b66b None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:31.525563 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:31.531067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec37f2-0d7c-47c0-82ee-90abe0927bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:31.531691 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec37f2-0d7c-47c0-82ee-90abe0927bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:31.531999 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec37f2-0d7c-47c0-82ee-90abe0927bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:31.532271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec37f2-0d7c-47c0-82ee-90abe0927bd9 None admin] PATH_INFO: `/v3/projects/e4082cb9a3f2475f8947bc8e8d108c41` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:31.533422 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec37f2-0d7c-47c0-82ee-90abe0927bd9 None admin] RBAC: Authorizing `identity:get_project(project_id=e4082cb9a3f2475f8947bc8e8d108c41)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:31.534842 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec37f2-0d7c-47c0-82ee-90abe0927bd9 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:31.536573 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 576/1152] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:32:31 2022] GET /identity/v3/projects/e4082cb9a3f2475f8947bc8e8d108c41 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:31.542732 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4519da-46ee-40df-9518-bf7c10a55b03 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:31.645436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4519da-46ee-40df-9518-bf7c10a55b03 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:31.681730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e681637-2f30-49a4-8e95-38f2f6ed9dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:31.682391 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e681637-2f30-49a4-8e95-38f2f6ed9dd9 None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:31.682667 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e681637-2f30-49a4-8e95-38f2f6ed9dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:31.682934 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e681637-2f30-49a4-8e95-38f2f6ed9dd9 None admin] PATH_INFO: `/v3/projects/e4082cb9a3f2475f8947bc8e8d108c41/users/fb03c41eafe44c468aa8f8621ae647e1/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:31.684864 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e681637-2f30-49a4-8e95-38f2f6ed9dd9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4082cb9a3f2475f8947bc8e8d108c41, user_id=fb03c41eafe44c468aa8f8621ae647e1, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:31.686305 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e681637-2f30-49a4-8e95-38f2f6ed9dd9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:31.701804 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 577/1153] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 26 05:32:31 2022] PUT /identity/v3/projects/e4082cb9a3f2475f8947bc8e8d108c41/users/fb03c41eafe44c468aa8f8621ae647e1/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:32:33.831641 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f4311-3448-4675-9875-43d509f0804c None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:33.832296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f4311-3448-4675-9875-43d509f0804c None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:33.832296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f4311-3448-4675-9875-43d509f0804c None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:33.833625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 577/1154] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:32:33.839157 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb353b9-8d86-4ec1-bbe6-4a9eefe0edd2 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:33.839617 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb353b9-8d86-4ec1-bbe6-4a9eefe0edd2 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:33.839714 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb353b9-8d86-4ec1-bbe6-4a9eefe0edd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:33.860462 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-ceb353b9-8d86-4ec1-bbe6-4a9eefe0edd2 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:32:33.861685 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ceb353b9-8d86-4ec1-bbe6-4a9eefe0edd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:32:33.893497 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:33.933020 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 578/1155] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:32:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:32:34.200013 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f4311-3448-4675-9875-43d509f0804c None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:34.306703 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f4311-3448-4675-9875-43d509f0804c None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:34.341637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9554d8-f0b2-4c3b-9d35-80f015134053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:34.342277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9554d8-f0b2-4c3b-9d35-80f015134053 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:34.342525 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9554d8-f0b2-4c3b-9d35-80f015134053 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:34.342791 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9554d8-f0b2-4c3b-9d35-80f015134053 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:34.353296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9554d8-f0b2-4c3b-9d35-80f015134053 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:32:34.358145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-1a9554d8-f0b2-4c3b-9d35-80f015134053 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:32:34.358145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:32:34.358145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:32:34.358145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:32:34.358145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:32:34.358145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:32:34.358145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:32:34.358145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:32:34.358145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:32:34.358145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:32:34.358145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:32:34.358145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:32:34.358145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:32:34.358145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:32:34.358145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:32:34.358145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:32:34.359274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:32:34.359274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:32:34.359274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:32:34.359274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:32:34.359274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:32:34.359274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:32:34.359274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:32:34.359274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:32:34.359274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:32:34.359274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:32:34.359274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:32:34.359274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:32:34.359274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:32:34.359274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:32:34.359274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:32:34.359274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:32:34.360365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:32:34.360365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:32:34.360365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:32:34.360365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:32:34.360365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:32:34.360365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:32:34.360365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:32:34.360365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:32:34.360365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:32:34.360365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:32:34.360365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:32:34.360365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:32:34.360365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 578/1156] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:32:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:32:34.365883 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb353b9-8d86-4ec1-bbe6-4a9eefe0edd2 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:34.469535 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb353b9-8d86-4ec1-bbe6-4a9eefe0edd2 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:34.504651 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880e4e6-97b3-40d9-b597-a55b387d382b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:34.505424 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880e4e6-97b3-40d9-b597-a55b387d382b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:34.505708 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880e4e6-97b3-40d9-b597-a55b387d382b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:34.505983 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880e4e6-97b3-40d9-b597-a55b387d382b None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:34.506703 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880e4e6-97b3-40d9-b597-a55b387d382b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:32:34.507005 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880e4e6-97b3-40d9-b597-a55b387d382b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:34.508429 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880e4e6-97b3-40d9-b597-a55b387d382b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:34.516799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 579/1157] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:32:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:34.523454 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9554d8-f0b2-4c3b-9d35-80f015134053 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:34.587690 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:34.630649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9554d8-f0b2-4c3b-9d35-80f015134053 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:34.665944 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71afe339-dbdb-4387-ba2e-6da31cb35ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:34.666565 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afe339-dbdb-4387-ba2e-6da31cb35ebd None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:34.666845 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afe339-dbdb-4387-ba2e-6da31cb35ebd None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:34.667226 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afe339-dbdb-4387-ba2e-6da31cb35ebd None admin] PATH_INFO: `/v3/users/fb03c41eafe44c468aa8f8621ae647e1` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:34.668432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71afe339-dbdb-4387-ba2e-6da31cb35ebd None admin] RBAC: Authorizing `identity:get_user(user_id=fb03c41eafe44c468aa8f8621ae647e1)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:34.669861 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71afe339-dbdb-4387-ba2e-6da31cb35ebd None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:34.671445 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 579/1158] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:32:34 2022] GET /identity/v3/users/fb03c41eafe44c468aa8f8621ae647e1 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:34.677702 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880e4e6-97b3-40d9-b597-a55b387d382b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:34.711268 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:34.785604 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880e4e6-97b3-40d9-b597-a55b387d382b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:34.819918 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a297cfb-e0a9-48bf-b89b-40a31fd431a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:34.820517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a297cfb-e0a9-48bf-b89b-40a31fd431a6 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:34.820791 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a297cfb-e0a9-48bf-b89b-40a31fd431a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:34.821065 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a297cfb-e0a9-48bf-b89b-40a31fd431a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:34.890206 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a297cfb-e0a9-48bf-b89b-40a31fd431a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:34.891658 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a297cfb-e0a9-48bf-b89b-40a31fd431a6 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:34.922206 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:35.001439 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 580/1159] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:32:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:32:35.007933 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71afe339-dbdb-4387-ba2e-6da31cb35ebd None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:35.110931 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71afe339-dbdb-4387-ba2e-6da31cb35ebd None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:35.138240 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:35.147039 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d692b72a-9772-4c32-98a9-6e9ce26029da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:35.147669 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692b72a-9772-4c32-98a9-6e9ce26029da None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:35.148038 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692b72a-9772-4c32-98a9-6e9ce26029da None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:35.148292 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d692b72a-9772-4c32-98a9-6e9ce26029da None admin] PATH_INFO: `/v3/projects/e4082cb9a3f2475f8947bc8e8d108c41` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:35.149471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d692b72a-9772-4c32-98a9-6e9ce26029da None admin] RBAC: Authorizing `identity:get_project(project_id=e4082cb9a3f2475f8947bc8e8d108c41)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:35.150895 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d692b72a-9772-4c32-98a9-6e9ce26029da None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:35.152579 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 580/1160] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:32:35 2022] GET /identity/v3/projects/e4082cb9a3f2475f8947bc8e8d108c41 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:35.159193 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a297cfb-e0a9-48bf-b89b-40a31fd431a6 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:35.261441 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a297cfb-e0a9-48bf-b89b-40a31fd431a6 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:35.290428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:35.297617 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a2b0ec-54d9-4bbd-9d5e-faa25af6634f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:35.298240 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2b0ec-54d9-4bbd-9d5e-faa25af6634f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:35.298518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2b0ec-54d9-4bbd-9d5e-faa25af6634f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:35.298791 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2b0ec-54d9-4bbd-9d5e-faa25af6634f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:35.299515 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2b0ec-54d9-4bbd-9d5e-faa25af6634f None admin] RBAC: Adding query filter params (role.id=cf58d66369044fb09fa65a4366dc7446, scope.project.id=e4082cb9a3f2475f8947bc8e8d108c41, user.id=fb03c41eafe44c468aa8f8621ae647e1) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:32:35.299858 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2b0ec-54d9-4bbd-9d5e-faa25af6634f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:35.301292 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a2b0ec-54d9-4bbd-9d5e-faa25af6634f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:35.307228 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 581/1161] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:32:35 2022] GET /identity/v3/role_assignments?user.id=fb03c41eafe44c468aa8f8621ae647e1&scope.project.id=e4082cb9a3f2475f8947bc8e8d108c41&role.id=cf58d66369044fb09fa65a4366dc7446 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:37.465232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fae69-7a5a-4dce-8b9d-68c8f15c07fd None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:37.465822 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fae69-7a5a-4dce-8b9d-68c8f15c07fd None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:37.465822 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62fae69-7a5a-4dce-8b9d-68c8f15c07fd None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:37.467088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 581/1162] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:32:37.472493 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d1996-bf13-4f26-88f1-910510594297 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:37.472925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d1996-bf13-4f26-88f1-910510594297 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:37.473031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d1996-bf13-4f26-88f1-910510594297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:37.492051 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-4c3d1996-bf13-4f26-88f1-910510594297 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:32:37.493240 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4c3d1996-bf13-4f26-88f1-910510594297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:32:37.561033 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 582/1163] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:32:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:32:37.823583 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fae69-7a5a-4dce-8b9d-68c8f15c07fd None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:37.927430 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62fae69-7a5a-4dce-8b9d-68c8f15c07fd None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:37.963764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450897a-6b63-40bb-af4a-7237465f25d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:37.964429 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450897a-6b63-40bb-af4a-7237465f25d6 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:37.964702 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450897a-6b63-40bb-af4a-7237465f25d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:37.964964 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450897a-6b63-40bb-af4a-7237465f25d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:38.037921 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:38.046235 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450897a-6b63-40bb-af4a-7237465f25d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:38.047927 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c450897a-6b63-40bb-af4a-7237465f25d6 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:38.151645 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 582/1164] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:32:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:32:38.157763 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d1996-bf13-4f26-88f1-910510594297 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:38.261929 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d1996-bf13-4f26-88f1-910510594297 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:38.285595 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:38.298438 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256807e-fa85-4862-90ec-26b01cd8c0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:38.299070 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256807e-fa85-4862-90ec-26b01cd8c0e8 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:38.299353 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256807e-fa85-4862-90ec-26b01cd8c0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:38.299614 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256807e-fa85-4862-90ec-26b01cd8c0e8 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:38.306604 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256807e-fa85-4862-90ec-26b01cd8c0e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:38.308088 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0256807e-fa85-4862-90ec-26b01cd8c0e8 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:38.320741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-0256807e-fa85-4862-90ec-26b01cd8c0e8 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 26 05:32:38.320741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:32:38.320741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 26 05:32:38.320741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 26 05:32:38.320741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:32:38.320741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:32:38.320741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:32:38.320741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:32:38.320741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 26 05:32:38.320741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:32:38.320741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:32:38.320741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:32:38.320741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:32:38.320741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:32:38.320741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:32:38.320741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:32:38.320741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:32:38.322670 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:32:38.322670 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:32:38.322670 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:32:38.322670 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:32:38.322670 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:32:38.322670 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:32:38.322670 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:32:38.322670 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:32:38.322670 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:32:38.322670 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:32:38.322670 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:32:38.322670 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:32:38.322670 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:32:38.322670 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:32:38.322670 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:32:38.322670 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:32:38.324521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:32:38.324521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:32:38.324521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:32:38.324521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:32:38.324521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:32:38.324521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:32:38.324521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:32:38.324521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:32:38.324521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:32:38.324521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:32:38.324521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 26 05:32:38.324521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:32:38.324521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 26 05:32:38.324521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:32:38.327940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 583/1165] 10.222.0.66 () {56 vars in 1117 bytes} [Mon Sep 26 05:32:38 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:32:38.329351 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450897a-6b63-40bb-af4a-7237465f25d6 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:38.427652 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:38.433843 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c450897a-6b63-40bb-af4a-7237465f25d6 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:38.470329 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7acddfa-4de1-431c-b0bf-35d5630053a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:38.470977 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acddfa-4de1-431c-b0bf-35d5630053a4 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:38.471225 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acddfa-4de1-431c-b0bf-35d5630053a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:38.471494 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7acddfa-4de1-431c-b0bf-35d5630053a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:38.472167 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7acddfa-4de1-431c-b0bf-35d5630053a4 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:32:38.472464 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7acddfa-4de1-431c-b0bf-35d5630053a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:38.473829 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7acddfa-4de1-431c-b0bf-35d5630053a4 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:38.481430 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 583/1166] 10.222.0.66 () {56 vars in 1115 bytes} [Mon Sep 26 05:32:38 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:40.622631 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b79b1b-dbbd-4856-95d8-79baadf58311 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:40.623205 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b79b1b-dbbd-4856-95d8-79baadf58311 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:40.623205 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b79b1b-dbbd-4856-95d8-79baadf58311 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:40.624545 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 584/1167] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:32:40.629973 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11860bd-bc4d-4d74-a787-02bfc2b85f45 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:40.630412 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11860bd-bc4d-4d74-a787-02bfc2b85f45 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:40.630522 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11860bd-bc4d-4d74-a787-02bfc2b85f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:40.649647 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-a11860bd-bc4d-4d74-a787-02bfc2b85f45 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:32:40.650866 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a11860bd-bc4d-4d74-a787-02bfc2b85f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:32:40.724740 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 584/1168] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:32:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:32:40.990133 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b79b1b-dbbd-4856-95d8-79baadf58311 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:41.108761 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b79b1b-dbbd-4856-95d8-79baadf58311 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:41.143899 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b44df-9714-42cf-bb70-796e11627e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:41.144499 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b44df-9714-42cf-bb70-796e11627e7f None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:41.144773 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b44df-9714-42cf-bb70-796e11627e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:41.145035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b44df-9714-42cf-bb70-796e11627e7f None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:41.145722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b44df-9714-42cf-bb70-796e11627e7f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:41.147093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b44df-9714-42cf-bb70-796e11627e7f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:41.165038 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 585/1169] 10.222.0.66 () {60 vars in 1138 bytes} [Mon Sep 26 05:32:40 2022] POST /identity/v3/domains => generated 267 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:32:43.324489 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe836f21-55df-4e2a-9844-bfb758890df3 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:43.325649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe836f21-55df-4e2a-9844-bfb758890df3 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:43.325649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe836f21-55df-4e2a-9844-bfb758890df3 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:43.327238 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 585/1170] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:32:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:32:43.335600 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332b631-d823-44e6-b54b-ba3497b36bf0 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:43.336115 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332b631-d823-44e6-b54b-ba3497b36bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:43.336207 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332b631-d823-44e6-b54b-ba3497b36bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:43.357197 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-3332b631-d823-44e6-b54b-ba3497b36bf0 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:32:43.358404 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3332b631-d823-44e6-b54b-ba3497b36bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:32:43.400321 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:43.432063 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 586/1171] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:32:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:32:43.695281 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe836f21-55df-4e2a-9844-bfb758890df3 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:43.800340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:43.817333 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe836f21-55df-4e2a-9844-bfb758890df3 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:43.855540 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f797e-5820-48cf-b66c-ef9235f2d96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:43.856203 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f797e-5820-48cf-b66c-ef9235f2d96d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:43.856478 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f797e-5820-48cf-b66c-ef9235f2d96d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:43.856754 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f797e-5820-48cf-b66c-ef9235f2d96d None admin] PATH_INFO: `/v3/domains/d13ff87cda894d73b6599d600c86973d` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:43.868151 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f797e-5820-48cf-b66c-ef9235f2d96d None admin] RBAC: Authorizing `identity:get_domain(domain_id=d13ff87cda894d73b6599d600c86973d)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:43.869600 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f797e-5820-48cf-b66c-ef9235f2d96d None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:43.871287 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 586/1172] 10.222.0.66 () {56 vars in 1183 bytes} [Mon Sep 26 05:32:43 2022] GET /identity/v3/domains/d13ff87cda894d73b6599d600c86973d => generated 267 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:43.877619 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332b631-d823-44e6-b54b-ba3497b36bf0 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:43.987610 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332b631-d823-44e6-b54b-ba3497b36bf0 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:44.021835 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e855f-8b1d-4919-9ff8-b4aa00a2c3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:44.022442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e855f-8b1d-4919-9ff8-b4aa00a2c3eb None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:44.022713 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e855f-8b1d-4919-9ff8-b4aa00a2c3eb None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:44.022981 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e855f-8b1d-4919-9ff8-b4aa00a2c3eb None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:44.023618 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e855f-8b1d-4919-9ff8-b4aa00a2c3eb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:44.025093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e855f-8b1d-4919-9ff8-b4aa00a2c3eb None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:44.054349 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 587/1173] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Sep 26 05:32:43 2022] POST /identity/v3/projects => generated 361 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:32:46.281148 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67a695-6c23-447d-ad43-95faa9d64adc None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:46.282183 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67a695-6c23-447d-ad43-95faa9d64adc None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:46.282183 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67a695-6c23-447d-ad43-95faa9d64adc None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:46.283168 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 587/1174] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:32:46.289930 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874fa85-742f-4b49-aaa1-2e8008fcaf9a None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:46.290529 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874fa85-742f-4b49-aaa1-2e8008fcaf9a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:46.290529 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874fa85-742f-4b49-aaa1-2e8008fcaf9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:46.313873 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-0874fa85-742f-4b49-aaa1-2e8008fcaf9a None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:32:46.315385 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0874fa85-742f-4b49-aaa1-2e8008fcaf9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:32:46.341008 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:46.392946 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 588/1175] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:32:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:32:46.696863 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67a695-6c23-447d-ad43-95faa9d64adc None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:46.806126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67a695-6c23-447d-ad43-95faa9d64adc None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:46.842677 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc6483-9819-4000-ab12-0e1f6e195fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:46.843376 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc6483-9819-4000-ab12-0e1f6e195fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:46.843649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc6483-9819-4000-ab12-0e1f6e195fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:46.843941 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc6483-9819-4000-ab12-0e1f6e195fb9 None admin] PATH_INFO: `/v3/domains/d13ff87cda894d73b6599d600c86973d` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:46.845091 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc6483-9819-4000-ab12-0e1f6e195fb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d13ff87cda894d73b6599d600c86973d)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:46.846551 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc6483-9819-4000-ab12-0e1f6e195fb9 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:46.848200 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 588/1176] 10.222.0.66 () {56 vars in 1183 bytes} [Mon Sep 26 05:32:46 2022] GET /identity/v3/domains/d13ff87cda894d73b6599d600c86973d => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:46.854441 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874fa85-742f-4b49-aaa1-2e8008fcaf9a None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:46.977364 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874fa85-742f-4b49-aaa1-2e8008fcaf9a None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:47.020808 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0043642-b6ca-4d1e-8c06-a6129579b2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:47.021452 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0043642-b6ca-4d1e-8c06-a6129579b2e0 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:47.021821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0043642-b6ca-4d1e-8c06-a6129579b2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:47.022093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0043642-b6ca-4d1e-8c06-a6129579b2e0 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:47.022876 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0043642-b6ca-4d1e-8c06-a6129579b2e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:47.024851 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0043642-b6ca-4d1e-8c06-a6129579b2e0 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:47.056930 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 589/1177] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 26 05:32:46 2022] POST /identity/v3/users => generated 311 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:32:49.315083 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d1913-0066-424e-81b0-e889aadcfaba None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:49.315688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d1913-0066-424e-81b0-e889aadcfaba None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:49.315688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d1913-0066-424e-81b0-e889aadcfaba None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:49.317048 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 589/1178] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:32:49.323415 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4969b5-e8d1-409f-bea8-5e5ed66459fe None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:49.324001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4969b5-e8d1-409f-bea8-5e5ed66459fe None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:49.324001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4969b5-e8d1-409f-bea8-5e5ed66459fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:49.343163 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-dd4969b5-e8d1-409f-bea8-5e5ed66459fe None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:32:49.344407 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-dd4969b5-e8d1-409f-bea8-5e5ed66459fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:32:49.352554 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:49.416310 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 590/1179] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:32:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:32:49.682204 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d1913-0066-424e-81b0-e889aadcfaba None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:49.704044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:49.794564 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d1913-0066-424e-81b0-e889aadcfaba None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:49.835401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c23aaa-32c2-4892-96df-7751bb430361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:49.836085 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c23aaa-32c2-4892-96df-7751bb430361 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:49.836356 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c23aaa-32c2-4892-96df-7751bb430361 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:49.836619 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c23aaa-32c2-4892-96df-7751bb430361 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:49.847694 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c23aaa-32c2-4892-96df-7751bb430361 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:32:49.852920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-77c23aaa-32c2-4892-96df-7751bb430361 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:32:49.852920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:32:49.852920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:32:49.852920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:32:49.852920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:32:49.852920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:32:49.852920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:32:49.852920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:32:49.852920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:32:49.852920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:32:49.852920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:32:49.852920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:32:49.852920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:32:49.852920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:32:49.852920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:32:49.852920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:32:49.854104 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:32:49.854104 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:32:49.854104 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:32:49.854104 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:32:49.854104 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:32:49.854104 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:32:49.854104 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:32:49.854104 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:32:49.854104 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:32:49.854104 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:32:49.854104 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:32:49.854104 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:32:49.854104 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:32:49.854104 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:32:49.854104 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:32:49.854104 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:32:49.855250 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:32:49.855250 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:32:49.855250 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:32:49.855250 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:32:49.855250 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:32:49.855250 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:32:49.855250 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:32:49.855250 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:32:49.855250 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:32:49.855250 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:32:49.855250 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:32:49.855250 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:32:49.855250 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 590/1180] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:32:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:32:49.861557 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4969b5-e8d1-409f-bea8-5e5ed66459fe None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:49.963205 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4969b5-e8d1-409f-bea8-5e5ed66459fe None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:49.999993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bedab-7c1b-4803-b86b-ba92cdfdd666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:50.000596 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bedab-7c1b-4803-b86b-ba92cdfdd666 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:50.000867 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bedab-7c1b-4803-b86b-ba92cdfdd666 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:50.001137 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bedab-7c1b-4803-b86b-ba92cdfdd666 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:50.001797 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8bedab-7c1b-4803-b86b-ba92cdfdd666 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:32:50.002097 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8bedab-7c1b-4803-b86b-ba92cdfdd666 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:50.003492 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8bedab-7c1b-4803-b86b-ba92cdfdd666 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:50.011919 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 591/1181] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:32:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:50.018125 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c23aaa-32c2-4892-96df-7751bb430361 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:50.100913 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:50.125804 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c23aaa-32c2-4892-96df-7751bb430361 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:50.161423 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0412d1-c582-4b44-82ae-86a471e67189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:50.162046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0412d1-c582-4b44-82ae-86a471e67189 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:50.162320 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0412d1-c582-4b44-82ae-86a471e67189 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:50.162596 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0412d1-c582-4b44-82ae-86a471e67189 None admin] PATH_INFO: `/v3/users/10c189f984e54f40962df48228208134` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:50.176426 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0412d1-c582-4b44-82ae-86a471e67189 None admin] RBAC: Authorizing `identity:get_user(user_id=10c189f984e54f40962df48228208134)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:50.177873 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0412d1-c582-4b44-82ae-86a471e67189 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:50.179911 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 591/1182] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:32:50 2022] GET /identity/v3/users/10c189f984e54f40962df48228208134 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:50.185796 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bedab-7c1b-4803-b86b-ba92cdfdd666 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:50.190192 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:50.291531 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bedab-7c1b-4803-b86b-ba92cdfdd666 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:50.327490 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe377b-630a-4392-9135-0812b1410a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:50.328235 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe377b-630a-4392-9135-0812b1410a65 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:50.328373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe377b-630a-4392-9135-0812b1410a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:50.328666 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe377b-630a-4392-9135-0812b1410a65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:50.397219 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe377b-630a-4392-9135-0812b1410a65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:50.398662 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe377b-630a-4392-9135-0812b1410a65 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:50.401460 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:50.510477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 592/1183] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:32:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:32:50.517036 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0412d1-c582-4b44-82ae-86a471e67189 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:50.631190 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0412d1-c582-4b44-82ae-86a471e67189 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:50.667796 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b477e1-3ba3-4da1-8b0c-791b4c91b050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:50.668484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b477e1-3ba3-4da1-8b0c-791b4c91b050 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:50.668754 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b477e1-3ba3-4da1-8b0c-791b4c91b050 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:50.669018 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b477e1-3ba3-4da1-8b0c-791b4c91b050 None admin] PATH_INFO: `/v3/projects/57abd9dd661e4f1ea1c156c96610b922` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:50.670242 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b477e1-3ba3-4da1-8b0c-791b4c91b050 None admin] RBAC: Authorizing `identity:get_project(project_id=57abd9dd661e4f1ea1c156c96610b922)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:50.671683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b477e1-3ba3-4da1-8b0c-791b4c91b050 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:50.673406 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 592/1184] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:32:50 2022] GET /identity/v3/projects/57abd9dd661e4f1ea1c156c96610b922 => generated 361 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:32:50.680272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe377b-630a-4392-9135-0812b1410a65 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:50.785954 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe377b-630a-4392-9135-0812b1410a65 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:50.788352 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:50.822169 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2736719-e5c3-4f37-a96c-66d9a2cfbbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:50.822764 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2736719-e5c3-4f37-a96c-66d9a2cfbbac None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:50.823038 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2736719-e5c3-4f37-a96c-66d9a2cfbbac None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:50.823302 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2736719-e5c3-4f37-a96c-66d9a2cfbbac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:50.824066 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2736719-e5c3-4f37-a96c-66d9a2cfbbac None admin] RBAC: Adding query filter params (role.id=cf58d66369044fb09fa65a4366dc7446, scope.project.id=57abd9dd661e4f1ea1c156c96610b922, user.id=10c189f984e54f40962df48228208134) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:32:50.824365 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2736719-e5c3-4f37-a96c-66d9a2cfbbac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:50.826178 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2736719-e5c3-4f37-a96c-66d9a2cfbbac None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:50.831822 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 593/1185] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:32:50 2022] GET /identity/v3/role_assignments?user.id=10c189f984e54f40962df48228208134&scope.project.id=57abd9dd661e4f1ea1c156c96610b922&role.id=cf58d66369044fb09fa65a4366dc7446 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:53.021331 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aece1f4-9e82-4ef3-b13d-29fdf514262d None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:53.021876 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aece1f4-9e82-4ef3-b13d-29fdf514262d None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:53.021876 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aece1f4-9e82-4ef3-b13d-29fdf514262d None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:53.023130 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 593/1186] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:32:53.028629 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdeedf-7cf8-496d-8a84-a50fcc206b79 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:53.029092 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdeedf-7cf8-496d-8a84-a50fcc206b79 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:53.029184 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdeedf-7cf8-496d-8a84-a50fcc206b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:53.048086 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-92bdeedf-7cf8-496d-8a84-a50fcc206b79 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:32:53.049273 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-92bdeedf-7cf8-496d-8a84-a50fcc206b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:32:53.130904 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 594/1187] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:32:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:32:53.402606 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aece1f4-9e82-4ef3-b13d-29fdf514262d None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:53.406930 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:53.527566 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aece1f4-9e82-4ef3-b13d-29fdf514262d None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:53.570424 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d6c31-0b90-4695-a30c-8f82cfb2c7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:53.571291 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d6c31-0b90-4695-a30c-8f82cfb2c7b5 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:53.571725 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d6c31-0b90-4695-a30c-8f82cfb2c7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:53.572075 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d6c31-0b90-4695-a30c-8f82cfb2c7b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:53.585741 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d6c31-0b90-4695-a30c-8f82cfb2c7b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:32:53.591418 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-171d6c31-0b90-4695-a30c-8f82cfb2c7b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:32:53.591418 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:32:53.591418 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:32:53.591418 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:32:53.591418 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:32:53.591418 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:32:53.591418 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:32:53.591418 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:32:53.591418 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:32:53.591418 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:32:53.591418 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:32:53.591418 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:32:53.591418 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:32:53.591418 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:32:53.591418 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:32:53.591418 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:32:53.592755 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:32:53.592755 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:32:53.592755 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:32:53.592755 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:32:53.592755 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:32:53.592755 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:32:53.592755 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:32:53.592755 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:32:53.592755 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:32:53.592755 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:32:53.592755 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:32:53.592755 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:32:53.592755 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:32:53.592755 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:32:53.592755 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:32:53.592755 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:32:53.593641 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:32:53.593641 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:32:53.593641 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:32:53.593641 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:32:53.593641 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:32:53.593641 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:32:53.593641 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:32:53.593641 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:32:53.593641 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:32:53.593641 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:32:53.593641 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:32:53.593641 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:32:53.593641 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 594/1188] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:32:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:32:53.599376 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdeedf-7cf8-496d-8a84-a50fcc206b79 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:53.710900 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:53.714903 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdeedf-7cf8-496d-8a84-a50fcc206b79 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:53.769008 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994cb261-a40b-4ec2-bf1b-cd9e45a62d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:53.769664 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994cb261-a40b-4ec2-bf1b-cd9e45a62d4f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:53.769945 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994cb261-a40b-4ec2-bf1b-cd9e45a62d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:53.770274 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994cb261-a40b-4ec2-bf1b-cd9e45a62d4f None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:53.770975 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994cb261-a40b-4ec2-bf1b-cd9e45a62d4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:32:53.771275 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994cb261-a40b-4ec2-bf1b-cd9e45a62d4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:53.772781 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994cb261-a40b-4ec2-bf1b-cd9e45a62d4f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:53.783067 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 595/1189] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:32:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:32:53.789781 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d6c31-0b90-4695-a30c-8f82cfb2c7b5 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:53.866731 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:53.909759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d6c31-0b90-4695-a30c-8f82cfb2c7b5 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:53.948155 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76dbb6-8b36-4115-b76d-34e4d6124053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:53.948796 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76dbb6-8b36-4115-b76d-34e4d6124053 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:53.949063 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76dbb6-8b36-4115-b76d-34e4d6124053 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:53.949323 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76dbb6-8b36-4115-b76d-34e4d6124053 None admin] PATH_INFO: `/v3/users/10c189f984e54f40962df48228208134` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:53.950857 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76dbb6-8b36-4115-b76d-34e4d6124053 None admin] RBAC: Authorizing `identity:get_user(user_id=10c189f984e54f40962df48228208134)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:53.952344 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea76dbb6-8b36-4115-b76d-34e4d6124053 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:53.954033 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 595/1190] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:32:53 2022] GET /identity/v3/users/10c189f984e54f40962df48228208134 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:53.960284 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994cb261-a40b-4ec2-bf1b-cd9e45a62d4f None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:54.069421 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994cb261-a40b-4ec2-bf1b-cd9e45a62d4f None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:54.104725 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb12d5-7f0b-4c43-b961-ada483756293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:54.105354 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb12d5-7f0b-4c43-b961-ada483756293 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:54.105629 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb12d5-7f0b-4c43-b961-ada483756293 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:54.105898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb12d5-7f0b-4c43-b961-ada483756293 None admin] PATH_INFO: `/v3/projects/57abd9dd661e4f1ea1c156c96610b922` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:54.107080 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb12d5-7f0b-4c43-b961-ada483756293 None admin] RBAC: Authorizing `identity:get_project(project_id=57abd9dd661e4f1ea1c156c96610b922)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:54.108563 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb12d5-7f0b-4c43-b961-ada483756293 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:54.110212 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 596/1191] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:32:53 2022] GET /identity/v3/projects/57abd9dd661e4f1ea1c156c96610b922 => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:54.116679 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76dbb6-8b36-4115-b76d-34e4d6124053 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:54.219783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76dbb6-8b36-4115-b76d-34e4d6124053 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:54.249623 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:54.257408 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956a8d9-9556-4f4e-8ff1-32589c143689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:54.258066 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956a8d9-9556-4f4e-8ff1-32589c143689 None admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:54.258344 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956a8d9-9556-4f4e-8ff1-32589c143689 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:54.258612 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956a8d9-9556-4f4e-8ff1-32589c143689 None admin] PATH_INFO: `/v3/projects/57abd9dd661e4f1ea1c156c96610b922/users/10c189f984e54f40962df48228208134/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:54.260477 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956a8d9-9556-4f4e-8ff1-32589c143689 None admin] RBAC: Authorizing `identity:create_grant(project_id=57abd9dd661e4f1ea1c156c96610b922, user_id=10c189f984e54f40962df48228208134, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:54.261902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956a8d9-9556-4f4e-8ff1-32589c143689 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:54.275642 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 596/1192] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 26 05:32:54 2022] PUT /identity/v3/projects/57abd9dd661e4f1ea1c156c96610b922/users/10c189f984e54f40962df48228208134/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:32:56.431489 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b38d4-8e23-4355-9ae2-da8532d028c0 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:56.432179 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b38d4-8e23-4355-9ae2-da8532d028c0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:56.432179 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137b38d4-8e23-4355-9ae2-da8532d028c0 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:56.433373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 597/1193] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:32:56.439133 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f26d8-369d-4bc7-8e32-fbf168c64814 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:56.439611 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f26d8-369d-4bc7-8e32-fbf168c64814 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:56.439713 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f26d8-369d-4bc7-8e32-fbf168c64814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:56.458767 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-a98f26d8-369d-4bc7-8e32-fbf168c64814 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:32:56.460002 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a98f26d8-369d-4bc7-8e32-fbf168c64814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:32:56.529565 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 597/1194] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:32:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 26 05:32:56.805117 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b38d4-8e23-4355-9ae2-da8532d028c0 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:56.837636 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:56.938351 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137b38d4-8e23-4355-9ae2-da8532d028c0 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:56.976825 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd32a1-b70b-4c58-837f-ba8437e7fe34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:56.977382 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd32a1-b70b-4c58-837f-ba8437e7fe34 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:56.977659 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd32a1-b70b-4c58-837f-ba8437e7fe34 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:56.977929 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd32a1-b70b-4c58-837f-ba8437e7fe34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:56.990645 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bd32a1-b70b-4c58-837f-ba8437e7fe34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:32:56.995697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-e0bd32a1-b70b-4c58-837f-ba8437e7fe34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:32:56.995697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:32:56.995697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:32:56.995697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:32:56.995697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:32:56.995697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:32:56.995697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:32:56.995697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:32:56.995697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:32:56.995697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:32:56.995697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:32:56.995697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:32:56.995697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:32:56.995697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:32:56.995697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:32:56.995697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:32:56.999541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:32:56.999541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:32:56.999541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:32:56.999541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:32:56.999541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:32:56.999541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:32:56.999541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:32:56.999541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:32:56.999541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:32:56.999541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:32:56.999541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:32:56.999541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:32:56.999541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:32:56.999541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:32:56.999541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:32:56.999541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:32:57.000746 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:32:57.000746 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:32:57.000746 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:32:57.000746 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:32:57.000746 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:32:57.000746 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:32:57.000746 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:32:57.000746 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:32:57.000746 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:32:57.000746 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:32:57.000746 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:32:57.000746 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:32:57.000746 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 598/1195] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:32:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:32:57.003311 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f26d8-369d-4bc7-8e32-fbf168c64814 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:57.109207 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f26d8-369d-4bc7-8e32-fbf168c64814 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:57.134974 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:57.151640 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121e5a1-d5ed-402b-8f34-e4f40935e647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:57.152294 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121e5a1-d5ed-402b-8f34-e4f40935e647 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:57.152567 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121e5a1-d5ed-402b-8f34-e4f40935e647 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:57.152832 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121e5a1-d5ed-402b-8f34-e4f40935e647 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:57.155332 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121e5a1-d5ed-402b-8f34-e4f40935e647 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:32:57.156374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121e5a1-d5ed-402b-8f34-e4f40935e647 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:57.157749 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121e5a1-d5ed-402b-8f34-e4f40935e647 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:57.166827 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 598/1196] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:32:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:57.173052 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd32a1-b70b-4c58-837f-ba8437e7fe34 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:57.265724 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:57.278912 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd32a1-b70b-4c58-837f-ba8437e7fe34 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:57.313784 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df049903-7402-40dc-a966-9169c3f42acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:57.314407 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df049903-7402-40dc-a966-9169c3f42acd None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:57.314677 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df049903-7402-40dc-a966-9169c3f42acd None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:57.314940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df049903-7402-40dc-a966-9169c3f42acd None admin] PATH_INFO: `/v3/users/10c189f984e54f40962df48228208134` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:57.316133 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df049903-7402-40dc-a966-9169c3f42acd None admin] RBAC: Authorizing `identity:get_user(user_id=10c189f984e54f40962df48228208134)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:57.317614 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df049903-7402-40dc-a966-9169c3f42acd None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:57.319191 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 599/1197] 10.222.0.66 () {56 vars in 1177 bytes} [Mon Sep 26 05:32:57 2022] GET /identity/v3/users/10c189f984e54f40962df48228208134 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:57.325674 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121e5a1-d5ed-402b-8f34-e4f40935e647 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:57.430195 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121e5a1-d5ed-402b-8f34-e4f40935e647 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:57.465399 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dffae-1d9c-4f51-9366-1342ddf85863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:57.466101 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dffae-1d9c-4f51-9366-1342ddf85863 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:57.466203 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dffae-1d9c-4f51-9366-1342ddf85863 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:57.466501 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696dffae-1d9c-4f51-9366-1342ddf85863 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:57.518892 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:57.536725 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696dffae-1d9c-4f51-9366-1342ddf85863 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:57.538174 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696dffae-1d9c-4f51-9366-1342ddf85863 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:57.641950 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 599/1198] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:32:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:32:57.648259 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df049903-7402-40dc-a966-9169c3f42acd None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:57.755512 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df049903-7402-40dc-a966-9169c3f42acd None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:57.790849 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c0758-33a2-4fc4-ae8d-96bfdcc37bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:57.791406 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c0758-33a2-4fc4-ae8d-96bfdcc37bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:57.791688 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c0758-33a2-4fc4-ae8d-96bfdcc37bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:57.791986 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c0758-33a2-4fc4-ae8d-96bfdcc37bc7 None admin] PATH_INFO: `/v3/projects/57abd9dd661e4f1ea1c156c96610b922` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:57.793222 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c0758-33a2-4fc4-ae8d-96bfdcc37bc7 None admin] RBAC: Authorizing `identity:get_project(project_id=57abd9dd661e4f1ea1c156c96610b922)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:57.794711 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c0758-33a2-4fc4-ae8d-96bfdcc37bc7 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:57.796496 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 600/1199] 10.222.0.66 () {56 vars in 1186 bytes} [Mon Sep 26 05:32:57 2022] GET /identity/v3/projects/57abd9dd661e4f1ea1c156c96610b922 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:32:57.803307 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dffae-1d9c-4f51-9366-1342ddf85863 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:32:57.893679 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:32:57.913784 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696dffae-1d9c-4f51-9366-1342ddf85863 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:32:57.951762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5261f-d69d-4f48-87ea-0a1a307c9588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:32:57.952354 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5261f-d69d-4f48-87ea-0a1a307c9588 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:32:57.952620 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5261f-d69d-4f48-87ea-0a1a307c9588 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:32:57.952880 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5261f-d69d-4f48-87ea-0a1a307c9588 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:32:57.953597 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5261f-d69d-4f48-87ea-0a1a307c9588 None admin] RBAC: Adding query filter params (role.id=cf58d66369044fb09fa65a4366dc7446, scope.project.id=57abd9dd661e4f1ea1c156c96610b922, user.id=10c189f984e54f40962df48228208134) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:32:57.953896 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5261f-d69d-4f48-87ea-0a1a307c9588 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:32:57.955296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5261f-d69d-4f48-87ea-0a1a307c9588 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:32:57.961324 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 600/1200] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:32:57 2022] GET /identity/v3/role_assignments?user.id=10c189f984e54f40962df48228208134&scope.project.id=57abd9dd661e4f1ea1c156c96610b922&role.id=cf58d66369044fb09fa65a4366dc7446 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:33:07.785704 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=88 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:33:07.958641 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=26 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:33:55.665451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0a0a9-eca2-44c7-9b95-d71e04b5b42b None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:55.665451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0a0a9-eca2-44c7-9b95-d71e04b5b42b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:55.665451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0a0a9-eca2-44c7-9b95-d71e04b5b42b None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:55.665451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 601/1201] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:33:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:33:55.672869 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1b81d-73c9-412b-b4ea-a1afec497e59 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:55.673469 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1b81d-73c9-412b-b4ea-a1afec497e59 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:55.673469 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1b81d-73c9-412b-b4ea-a1afec497e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:55.696656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-c6e1b81d-73c9-412b-b4ea-a1afec497e59 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:33:55.698390 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c6e1b81d-73c9-412b-b4ea-a1afec497e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:33:55.804111 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 601/1202] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:33:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:33:56.126269 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0a0a9-eca2-44c7-9b95-d71e04b5b42b None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:33:56.285534 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0a0a9-eca2-44c7-9b95-d71e04b5b42b None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:33:56.351511 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d977264-771b-4362-8c05-8b29a3dea366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:33:56.352212 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d977264-771b-4362-8c05-8b29a3dea366 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:56.354291 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d977264-771b-4362-8c05-8b29a3dea366 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:56.354291 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d977264-771b-4362-8c05-8b29a3dea366 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:56.370844 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d977264-771b-4362-8c05-8b29a3dea366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:33:56.372385 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d977264-771b-4362-8c05-8b29a3dea366 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:33:56.388755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-2d977264-771b-4362-8c05-8b29a3dea366 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:33:56.388755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:33:56.388755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:33:56.388755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:33:56.388755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:33:56.388755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:33:56.388755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:33:56.388755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:33:56.388755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:33:56.388755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:33:56.388755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:33:56.388755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:33:56.388755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:33:56.388755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:33:56.388755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:33:56.388755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:33:56.390050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:33:56.390050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:33:56.390050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:33:56.390050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:33:56.390050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:33:56.390050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:33:56.390050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:33:56.390050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:33:56.390050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:33:56.390050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:33:56.390050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:33:56.390050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:33:56.390050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:33:56.390050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:33:56.390050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:33:56.390050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:33:56.390050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:33:56.391299 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:33:56.391299 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:33:56.391299 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:33:56.391299 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 602/1203] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:33:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:33:56.399763 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1b81d-73c9-412b-b4ea-a1afec497e59 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:33:56.573987 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1b81d-73c9-412b-b4ea-a1afec497e59 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:33:56.627990 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:33:56.633252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a87bb-7706-465b-8685-2e433d706ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:33:56.634195 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a87bb-7706-465b-8685-2e433d706ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:56.634472 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a87bb-7706-465b-8685-2e433d706ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:56.634794 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a87bb-7706-465b-8685-2e433d706ca6 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:56.635411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a87bb-7706-465b-8685-2e433d706ca6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:33:56.635709 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a87bb-7706-465b-8685-2e433d706ca6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:33:56.637245 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a87bb-7706-465b-8685-2e433d706ca6 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:33:56.656016 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 602/1204] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:33:56.663558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d977264-771b-4362-8c05-8b29a3dea366 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:33:56.749518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:33:56.841178 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d977264-771b-4362-8c05-8b29a3dea366 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:33:56.899332 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac260a-9d3a-4381-b0d5-ec89706b18be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:33:56.900385 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac260a-9d3a-4381-b0d5-ec89706b18be None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:56.900854 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac260a-9d3a-4381-b0d5-ec89706b18be None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:56.901324 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac260a-9d3a-4381-b0d5-ec89706b18be None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:56.902481 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac260a-9d3a-4381-b0d5-ec89706b18be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:33:56.906099 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ac260a-9d3a-4381-b0d5-ec89706b18be None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:33:56.944701 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 603/1205] 10.222.0.66 () {60 vars in 1132 bytes} [Mon Sep 26 05:33:56 2022] POST /identity/v3/users => generated 251 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:33:59.571535 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8c5f2-6817-4bac-94ab-1a8a30a983de None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:59.572495 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8c5f2-6817-4bac-94ab-1a8a30a983de None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:59.572495 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8c5f2-6817-4bac-94ab-1a8a30a983de None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:59.573831 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 603/1206] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:33:59.580026 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c7e0c-dfb7-44db-aad2-2db90ea093b2 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:33:59.580807 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c7e0c-dfb7-44db-aad2-2db90ea093b2 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:33:59.580807 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c7e0c-dfb7-44db-aad2-2db90ea093b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:33:59.607989 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-205c7e0c-dfb7-44db-aad2-2db90ea093b2 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:33:59.609442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-205c7e0c-dfb7-44db-aad2-2db90ea093b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:33:59.709305 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 604/1207] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:33:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:34:00.014455 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8c5f2-6817-4bac-94ab-1a8a30a983de None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:00.164508 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8c5f2-6817-4bac-94ab-1a8a30a983de None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:00.221569 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89070d7-c376-4fc8-a9a4-ead9762cf48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:00.223160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89070d7-c376-4fc8-a9a4-ead9762cf48e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:00.223434 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89070d7-c376-4fc8-a9a4-ead9762cf48e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:00.223705 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89070d7-c376-4fc8-a9a4-ead9762cf48e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:00.245430 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89070d7-c376-4fc8-a9a4-ead9762cf48e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:34:00.251507 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-c89070d7-c376-4fc8-a9a4-ead9762cf48e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:34:00.251507 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:00.251507 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:34:00.251507 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:34:00.251507 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:34:00.251507 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:34:00.251507 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:34:00.251507 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:34:00.251507 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:34:00.251507 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:34:00.251507 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:34:00.251507 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:34:00.251507 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:34:00.251507 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:34:00.251507 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:34:00.251507 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:34:00.252938 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:34:00.252938 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:34:00.252938 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:34:00.252938 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:34:00.252938 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:34:00.252938 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:34:00.252938 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:34:00.252938 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:34:00.252938 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:34:00.252938 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:34:00.252938 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:34:00.252938 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:34:00.252938 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:34:00.252938 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:34:00.252938 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:34:00.252938 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:34:00.257048 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:34:00.257048 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:34:00.257048 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:34:00.257048 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:34:00.257048 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:34:00.257048 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:34:00.257048 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:34:00.257048 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:34:00.257048 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:34:00.257048 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:34:00.257048 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:34:00.257048 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:34:00.257048 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 604/1208] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 26 05:34:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:34:00.261589 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c7e0c-dfb7-44db-aad2-2db90ea093b2 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:00.325633 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:00.410339 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c7e0c-dfb7-44db-aad2-2db90ea093b2 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:00.462360 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254430f-49f7-4538-9a2d-53761052d88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:00.463305 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254430f-49f7-4538-9a2d-53761052d88b None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:00.463566 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254430f-49f7-4538-9a2d-53761052d88b None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:00.463921 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254430f-49f7-4538-9a2d-53761052d88b None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:00.464776 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254430f-49f7-4538-9a2d-53761052d88b None admin] RBAC: Adding query filter params (name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:00.465161 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254430f-49f7-4538-9a2d-53761052d88b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:00.467187 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254430f-49f7-4538-9a2d-53761052d88b None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:00.478991 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 605/1209] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 26 05:34:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:34:00.485666 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89070d7-c376-4fc8-a9a4-ead9762cf48e None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:00.614332 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:00.676116 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89070d7-c376-4fc8-a9a4-ead9762cf48e None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:00.723601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5c3ef-69ff-43ed-98f6-0e17956aed8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:00.724300 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5c3ef-69ff-43ed-98f6-0e17956aed8e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:00.724487 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5c3ef-69ff-43ed-98f6-0e17956aed8e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:00.724775 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5c3ef-69ff-43ed-98f6-0e17956aed8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:00.739095 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5c3ef-69ff-43ed-98f6-0e17956aed8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:00.741218 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5c3ef-69ff-43ed-98f6-0e17956aed8e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:00.759966 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-b1f5c3ef-69ff-43ed-98f6-0e17956aed8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:34:00.759966 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:00.759966 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:34:00.759966 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:34:00.759966 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:34:00.759966 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:34:00.759966 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:34:00.759966 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:34:00.759966 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:34:00.759966 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:34:00.759966 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:34:00.759966 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:34:00.759966 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:34:00.759966 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:34:00.759966 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:34:00.759966 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:34:00.761693 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:34:00.761693 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:34:00.761693 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:34:00.761693 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:34:00.761693 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:34:00.761693 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:34:00.761693 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:34:00.761693 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:34:00.761693 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:34:00.761693 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:34:00.761693 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:34:00.761693 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:34:00.761693 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:34:00.761693 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:34:00.761693 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:34:00.761693 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:34:00.761693 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:34:00.762737 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:34:00.762737 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:34:00.762737 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:34:00.762737 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 605/1210] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:34:00.768298 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254430f-49f7-4538-9a2d-53761052d88b None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:00.929584 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:00.932874 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254430f-49f7-4538-9a2d-53761052d88b None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:00.982673 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1fef7-21d8-4d74-9d06-bbe4582402c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:00.983294 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1fef7-21d8-4d74-9d06-bbe4582402c4 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:00.983569 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1fef7-21d8-4d74-9d06-bbe4582402c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:00.983867 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe1fef7-21d8-4d74-9d06-bbe4582402c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:00.984513 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1fef7-21d8-4d74-9d06-bbe4582402c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:00.984881 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1fef7-21d8-4d74-9d06-bbe4582402c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:00.986531 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe1fef7-21d8-4d74-9d06-bbe4582402c4 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:01.001560 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 606/1211] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:01.006962 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5c3ef-69ff-43ed-98f6-0e17956aed8e None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:01.158826 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5c3ef-69ff-43ed-98f6-0e17956aed8e None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:01.161372 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:01.202784 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d82c2-1fd3-40fa-8382-5f59d241145e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:01.203845 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d82c2-1fd3-40fa-8382-5f59d241145e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:01.204130 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d82c2-1fd3-40fa-8382-5f59d241145e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:01.204427 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848d82c2-1fd3-40fa-8382-5f59d241145e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:01.215508 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d82c2-1fd3-40fa-8382-5f59d241145e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:01.217201 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848d82c2-1fd3-40fa-8382-5f59d241145e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:01.231858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-848d82c2-1fd3-40fa-8382-5f59d241145e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 05:34:01.231858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:01.231858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:34:01.231858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:34:01.231858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:34:01.231858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:34:01.231858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:34:01.231858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:34:01.231858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:34:01.231858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:34:01.231858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:34:01.231858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:34:01.231858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:34:01.231858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:34:01.231858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:34:01.231858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:34:01.240271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:34:01.240271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:34:01.240271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:34:01.240271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:34:01.240271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:34:01.240271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:34:01.240271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:34:01.240271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:34:01.240271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:34:01.240271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:34:01.240271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:34:01.240271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:34:01.240271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:34:01.240271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:34:01.240271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:34:01.240271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:34:01.240271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:34:01.240271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:34:01.241700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:34:01.241700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:34:01.241700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:34:01.241700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:34:01.241700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:34:01.241700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:34:01.241700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:34:01.241700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:34:01.241700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 05:34:01.241700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:34:01.241700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 606/1212] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:34:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:34:01.242507 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1fef7-21d8-4d74-9d06-bbe4582402c4 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:01.388428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe1fef7-21d8-4d74-9d06-bbe4582402c4 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:01.434918 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9bdf8-e0ce-43ab-a62c-9d44d11ede70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:01.436202 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9bdf8-e0ce-43ab-a62c-9d44d11ede70 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:01.436883 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9bdf8-e0ce-43ab-a62c-9d44d11ede70 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:01.437379 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9bdf8-e0ce-43ab-a62c-9d44d11ede70 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:01.438718 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9bdf8-e0ce-43ab-a62c-9d44d11ede70 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:01.439621 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9bdf8-e0ce-43ab-a62c-9d44d11ede70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:01.441978 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9bdf8-e0ce-43ab-a62c-9d44d11ede70 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:01.476858 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 607/1213] 10.222.0.66 () {56 vars in 1143 bytes} [Mon Sep 26 05:34:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:01.479293 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d82c2-1fd3-40fa-8382-5f59d241145e None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:01.628073 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848d82c2-1fd3-40fa-8382-5f59d241145e None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:01.680254 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abca0ef-8a6a-4acc-82b1-d4388a90b5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:01.681325 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abca0ef-8a6a-4acc-82b1-d4388a90b5d7 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:01.682157 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abca0ef-8a6a-4acc-82b1-d4388a90b5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:01.682527 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abca0ef-8a6a-4acc-82b1-d4388a90b5d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:01.726418 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:01.780701 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abca0ef-8a6a-4acc-82b1-d4388a90b5d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:01.782126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abca0ef-8a6a-4acc-82b1-d4388a90b5d7 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:01.898931 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 607/1214] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:34:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:34:01.905204 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9bdf8-e0ce-43ab-a62c-9d44d11ede70 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:01.927981 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:02.039231 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9bdf8-e0ce-43ab-a62c-9d44d11ede70 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:02.082639 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f006289-03f2-4fd9-a189-24030286d0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:02.083280 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f006289-03f2-4fd9-a189-24030286d0c9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:02.083553 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f006289-03f2-4fd9-a189-24030286d0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:02.083853 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f006289-03f2-4fd9-a189-24030286d0c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:02.094746 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f006289-03f2-4fd9-a189-24030286d0c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:02.096316 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f006289-03f2-4fd9-a189-24030286d0c9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:02.116517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-5f006289-03f2-4fd9-a189-24030286d0c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:34:02.116517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:02.116517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:34:02.116517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:34:02.116517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:34:02.116517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:34:02.116517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:34:02.116517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:34:02.116517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:34:02.116517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:34:02.116517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:34:02.116517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:34:02.116517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:34:02.116517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:34:02.116517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:34:02.116517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:34:02.118057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:34:02.118057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:34:02.118057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:34:02.118057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:34:02.118057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:34:02.118057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:34:02.118057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:34:02.118057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:34:02.118057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:34:02.118057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:34:02.118057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:34:02.118057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:34:02.118057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:34:02.118057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:34:02.118057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:34:02.118057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:34:02.118057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:34:02.119058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:34:02.119058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:34:02.119058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:34:02.119058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 608/1215] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:34:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:34:02.126015 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abca0ef-8a6a-4acc-82b1-d4388a90b5d7 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:02.217799 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:02.279682 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abca0ef-8a6a-4acc-82b1-d4388a90b5d7 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:02.325326 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b6f4e-d0aa-49d6-ab4b-876fec02efa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:02.326036 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b6f4e-d0aa-49d6-ab4b-876fec02efa2 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:02.326312 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b6f4e-d0aa-49d6-ab4b-876fec02efa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:02.326590 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b6f4e-d0aa-49d6-ab4b-876fec02efa2 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:02.327232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b6f4e-d0aa-49d6-ab4b-876fec02efa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:02.327544 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b6f4e-d0aa-49d6-ab4b-876fec02efa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:02.328959 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b6f4e-d0aa-49d6-ab4b-876fec02efa2 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:02.345341 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 608/1216] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:02.352179 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f006289-03f2-4fd9-a189-24030286d0c9 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:02.437598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:02.478741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f006289-03f2-4fd9-a189-24030286d0c9 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:02.520234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16370c-67c3-484d-ba46-3e2d011d1b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:02.520962 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16370c-67c3-484d-ba46-3e2d011d1b98 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:02.521408 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16370c-67c3-484d-ba46-3e2d011d1b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:02.521869 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16370c-67c3-484d-ba46-3e2d011d1b98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:02.533038 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16370c-67c3-484d-ba46-3e2d011d1b98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:02.534614 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16370c-67c3-484d-ba46-3e2d011d1b98 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:02.546990 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-6f16370c-67c3-484d-ba46-3e2d011d1b98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:34:02.546990 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:02.546990 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:34:02.546990 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:34:02.546990 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:34:02.546990 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:34:02.546990 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:34:02.546990 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:34:02.546990 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:34:02.546990 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:34:02.546990 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:34:02.546990 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:34:02.546990 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:34:02.546990 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:34:02.546990 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:34:02.548347 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:34:02.548347 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:34:02.548347 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:34:02.548347 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:34:02.548347 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:34:02.548347 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:34:02.548347 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:34:02.548347 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:34:02.548347 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:34:02.548347 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:34:02.548347 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:34:02.548347 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:34:02.548347 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:34:02.548347 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:34:02.548347 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:34:02.548347 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:34:02.548347 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:34:02.549785 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:34:02.549785 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:34:02.549785 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:34:02.549785 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:34:02.549785 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:34:02.549785 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:34:02.549785 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:34:02.549785 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:34:02.549785 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 609/1217] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:34:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:34:02.554816 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b6f4e-d0aa-49d6-ab4b-876fec02efa2 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:02.690340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b6f4e-d0aa-49d6-ab4b-876fec02efa2 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:02.721466 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:02.745492 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad9cc16-3f01-4eca-a6a6-4e141889d514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:02.746766 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9cc16-3f01-4eca-a6a6-4e141889d514 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:02.747156 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9cc16-3f01-4eca-a6a6-4e141889d514 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:02.747523 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad9cc16-3f01-4eca-a6a6-4e141889d514 None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:02.748795 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9cc16-3f01-4eca-a6a6-4e141889d514 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:02.749403 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9cc16-3f01-4eca-a6a6-4e141889d514 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:02.752574 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad9cc16-3f01-4eca-a6a6-4e141889d514 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:02.769960 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 609/1218] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:34:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:02.777223 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16370c-67c3-484d-ba46-3e2d011d1b98 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:02.921518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16370c-67c3-484d-ba46-3e2d011d1b98 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:02.959670 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:02.970125 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadb8c8d-50af-4b02-b2ba-fc7d9bc98521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:02.971100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb8c8d-50af-4b02-b2ba-fc7d9bc98521 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:02.973199 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb8c8d-50af-4b02-b2ba-fc7d9bc98521 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:02.973760 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadb8c8d-50af-4b02-b2ba-fc7d9bc98521 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:02.975026 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb8c8d-50af-4b02-b2ba-fc7d9bc98521 None admin] RBAC: Adding query filter params (role.id=024a61996071437aa07a3faf2bb5ae69, scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8, user.id=895edcfb20484b188a3877c9de8b59c4) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:02.975449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb8c8d-50af-4b02-b2ba-fc7d9bc98521 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:02.977949 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadb8c8d-50af-4b02-b2ba-fc7d9bc98521 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:02.990047 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 610/1219] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:34:02 2022] GET /identity/v3/role_assignments?user.id=895edcfb20484b188a3877c9de8b59c4&scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8&role.id=024a61996071437aa07a3faf2bb5ae69 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:05.300160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac95b8-1482-4fb9-a92d-190c22844e2e None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:05.300887 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac95b8-1482-4fb9-a92d-190c22844e2e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:05.300887 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac95b8-1482-4fb9-a92d-190c22844e2e None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:05.302110 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 610/1220] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:34:05.308680 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1314137-311e-47a1-a5b4-c2d4a841a9bb None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:05.309280 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1314137-311e-47a1-a5b4-c2d4a841a9bb None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:05.309280 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1314137-311e-47a1-a5b4-c2d4a841a9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:05.328623 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b1314137-311e-47a1-a5b4-c2d4a841a9bb None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:34:05.329893 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b1314137-311e-47a1-a5b4-c2d4a841a9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:34:05.400731 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 611/1221] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:34:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:34:05.717240 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac95b8-1482-4fb9-a92d-190c22844e2e None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:05.832596 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac95b8-1482-4fb9-a92d-190c22844e2e None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:05.868995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3613893-acea-459d-8dfd-870e9c8b99cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:05.869632 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3613893-acea-459d-8dfd-870e9c8b99cf None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:05.869901 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3613893-acea-459d-8dfd-870e9c8b99cf None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:05.870258 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3613893-acea-459d-8dfd-870e9c8b99cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:05.881727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3613893-acea-459d-8dfd-870e9c8b99cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:34:05.887128 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-e3613893-acea-459d-8dfd-870e9c8b99cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:34:05.887128 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:05.887128 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:34:05.887128 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:34:05.887128 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:34:05.887128 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:34:05.887128 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:34:05.887128 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:34:05.887128 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:34:05.887128 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:34:05.887128 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:34:05.887128 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:34:05.887128 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:34:05.887128 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:34:05.887128 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:34:05.887128 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:34:05.888578 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:34:05.888578 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:34:05.888578 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:34:05.888578 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:34:05.888578 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:34:05.888578 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:34:05.888578 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:34:05.888578 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:34:05.888578 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:34:05.888578 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:34:05.888578 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:34:05.888578 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:34:05.888578 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:34:05.888578 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:34:05.888578 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:34:05.888578 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:34:05.890239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:34:05.890239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:34:05.890239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:34:05.890239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:34:05.890239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:34:05.890239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:34:05.890239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:34:05.890239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:34:05.890239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:34:05.890239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:34:05.890239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:34:05.890239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:34:05.890239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 611/1222] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 26 05:34:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:34:05.895181 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1314137-311e-47a1-a5b4-c2d4a841a9bb None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:06.006311 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1314137-311e-47a1-a5b4-c2d4a841a9bb None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:06.030926 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:06.041498 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ecd879-88c5-4770-83e9-0e0fe654cff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:06.042208 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecd879-88c5-4770-83e9-0e0fe654cff9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:06.042618 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecd879-88c5-4770-83e9-0e0fe654cff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:06.042975 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecd879-88c5-4770-83e9-0e0fe654cff9 None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:06.043906 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ecd879-88c5-4770-83e9-0e0fe654cff9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:06.044693 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ecd879-88c5-4770-83e9-0e0fe654cff9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:06.046681 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ecd879-88c5-4770-83e9-0e0fe654cff9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:06.059769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 612/1223] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 26 05:34:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:06.064233 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3613893-acea-459d-8dfd-870e9c8b99cf None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:06.115163 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:06.185892 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3613893-acea-459d-8dfd-870e9c8b99cf None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:06.229410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f4847-9eb7-40a2-a230-55d90e312c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:06.230060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f4847-9eb7-40a2-a230-55d90e312c9b None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:06.230335 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f4847-9eb7-40a2-a230-55d90e312c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:06.230600 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180f4847-9eb7-40a2-a230-55d90e312c9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:06.241939 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f4847-9eb7-40a2-a230-55d90e312c9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:06.243897 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180f4847-9eb7-40a2-a230-55d90e312c9b None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:06.261383 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-180f4847-9eb7-40a2-a230-55d90e312c9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:34:06.261383 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:06.261383 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:34:06.261383 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:34:06.261383 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:34:06.261383 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:34:06.261383 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:34:06.261383 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:34:06.261383 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:34:06.261383 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:34:06.261383 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:34:06.261383 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:34:06.261383 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:34:06.261383 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:34:06.261383 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:34:06.261383 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:34:06.262748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:34:06.262748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:34:06.262748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:34:06.262748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:34:06.262748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:34:06.262748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:34:06.262748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:34:06.262748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:34:06.262748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:34:06.262748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:34:06.262748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:34:06.262748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:34:06.262748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:34:06.262748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:34:06.262748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:34:06.262748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:34:06.262748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:34:06.264060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:34:06.264060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:34:06.264060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:34:06.264060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 612/1224] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:34:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:34:06.268909 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ecd879-88c5-4770-83e9-0e0fe654cff9 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:06.382131 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ecd879-88c5-4770-83e9-0e0fe654cff9 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:06.420993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe1fda-8c0b-4ccf-b5ff-16b3c9e1ad70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:06.421616 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe1fda-8c0b-4ccf-b5ff-16b3c9e1ad70 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:06.421922 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe1fda-8c0b-4ccf-b5ff-16b3c9e1ad70 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:06.422189 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe1fda-8c0b-4ccf-b5ff-16b3c9e1ad70 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:06.422886 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe1fda-8c0b-4ccf-b5ff-16b3c9e1ad70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:06.423320 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe1fda-8c0b-4ccf-b5ff-16b3c9e1ad70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:06.425059 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe1fda-8c0b-4ccf-b5ff-16b3c9e1ad70 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:06.442801 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 613/1225] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:06.444255 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f4847-9eb7-40a2-a230-55d90e312c9b None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:06.544082 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:06.551663 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180f4847-9eb7-40a2-a230-55d90e312c9b None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:06.592008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bc609-16ba-4c05-8e2e-f553edf888cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:06.592604 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bc609-16ba-4c05-8e2e-f553edf888cf None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:06.592895 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bc609-16ba-4c05-8e2e-f553edf888cf None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:06.593171 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bc609-16ba-4c05-8e2e-f553edf888cf None admin] PATH_INFO: `/v3/users/placement` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:06.601868 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988bc609-16ba-4c05-8e2e-f553edf888cf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:06.603361 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988bc609-16ba-4c05-8e2e-f553edf888cf None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:06.617363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-988bc609-16ba-4c05-8e2e-f553edf888cf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 05:34:06.617363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:06.617363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:34:06.617363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:34:06.617363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:34:06.617363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:34:06.617363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:34:06.617363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:34:06.617363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:34:06.617363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:34:06.617363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:34:06.617363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:34:06.617363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:34:06.617363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:34:06.617363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:34:06.617363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:34:06.618757 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:34:06.618757 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:34:06.618757 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:34:06.618757 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:34:06.618757 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:34:06.618757 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:34:06.618757 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:34:06.618757 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:34:06.618757 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:34:06.618757 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:34:06.618757 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:34:06.618757 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:34:06.618757 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:34:06.618757 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:34:06.618757 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:34:06.618757 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:34:06.618757 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:34:06.618757 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:34:06.619946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:34:06.619946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:34:06.619946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:34:06.619946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:34:06.619946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:34:06.619946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:34:06.619946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:34:06.619946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:34:06.619946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 05:34:06.619946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:34:06.619946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 613/1226] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:34:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:34:06.625271 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe1fda-8c0b-4ccf-b5ff-16b3c9e1ad70 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:06.678099 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:06.744798 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe1fda-8c0b-4ccf-b5ff-16b3c9e1ad70 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:06.785755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55e971-5178-49ed-ab6d-4a09cb950b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:06.786435 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55e971-5178-49ed-ab6d-4a09cb950b42 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:06.786725 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55e971-5178-49ed-ab6d-4a09cb950b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:06.786995 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55e971-5178-49ed-ab6d-4a09cb950b42 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:06.787857 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55e971-5178-49ed-ab6d-4a09cb950b42 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:06.788098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55e971-5178-49ed-ab6d-4a09cb950b42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:06.790470 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55e971-5178-49ed-ab6d-4a09cb950b42 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:06.810730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 614/1227] 10.222.0.66 () {56 vars in 1143 bytes} [Mon Sep 26 05:34:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:06.816884 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bc609-16ba-4c05-8e2e-f553edf888cf None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:06.950198 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988bc609-16ba-4c05-8e2e-f553edf888cf None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:06.989581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad721212-feab-4444-adf7-3f5a84680894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:06.990240 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad721212-feab-4444-adf7-3f5a84680894 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:06.990532 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad721212-feab-4444-adf7-3f5a84680894 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:06.990992 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad721212-feab-4444-adf7-3f5a84680894 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:07.003076 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad721212-feab-4444-adf7-3f5a84680894 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:07.004723 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad721212-feab-4444-adf7-3f5a84680894 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:07.020484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-ad721212-feab-4444-adf7-3f5a84680894 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:34:07.020484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:07.020484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:34:07.020484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:34:07.020484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:34:07.020484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:34:07.020484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:34:07.020484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:34:07.020484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:34:07.020484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:34:07.020484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:34:07.020484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:34:07.020484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:34:07.020484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:34:07.020484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:34:07.020484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:34:07.021777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:34:07.021777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:34:07.021777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:34:07.021777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:34:07.021777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:34:07.021777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:34:07.021777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:34:07.021777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:34:07.021777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:34:07.021777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:34:07.021777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:34:07.021777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:34:07.021777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:34:07.021777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:34:07.021777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:34:07.021777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:34:07.021777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:34:07.022693 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:34:07.022693 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:34:07.022693 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:34:07.022693 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 614/1228] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:34:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:34:07.027920 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55e971-5178-49ed-ab6d-4a09cb950b42 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:07.131912 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55e971-5178-49ed-ab6d-4a09cb950b42 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:07.134631 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:07.172043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35420f-d3fc-423c-835f-a565fc49bdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:07.172642 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35420f-d3fc-423c-835f-a565fc49bdfd None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:07.172926 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35420f-d3fc-423c-835f-a565fc49bdfd None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:07.173190 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35420f-d3fc-423c-835f-a565fc49bdfd None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:07.174117 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35420f-d3fc-423c-835f-a565fc49bdfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:07.174421 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35420f-d3fc-423c-835f-a565fc49bdfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:07.175836 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35420f-d3fc-423c-835f-a565fc49bdfd None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:07.188134 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 615/1229] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:34:07.194413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad721212-feab-4444-adf7-3f5a84680894 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:07.205045 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:07.323590 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad721212-feab-4444-adf7-3f5a84680894 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:07.363788 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede6b3e-cec4-445e-b0c8-6e11292e4bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:07.364464 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede6b3e-cec4-445e-b0c8-6e11292e4bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:07.364762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede6b3e-cec4-445e-b0c8-6e11292e4bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:07.365104 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede6b3e-cec4-445e-b0c8-6e11292e4bb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:07.372301 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede6b3e-cec4-445e-b0c8-6e11292e4bb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:07.374615 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede6b3e-cec4-445e-b0c8-6e11292e4bb0 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:07.389264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-bede6b3e-cec4-445e-b0c8-6e11292e4bb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:34:07.389264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:07.389264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:34:07.389264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:34:07.389264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:34:07.389264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:34:07.389264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:34:07.389264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:34:07.389264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:34:07.389264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:34:07.389264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:34:07.389264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:34:07.389264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:34:07.389264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:34:07.389264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:34:07.390460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:34:07.390460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:34:07.390460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:34:07.390460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:34:07.390460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:34:07.390460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:34:07.390460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:34:07.390460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:34:07.390460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:34:07.390460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:34:07.390460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:34:07.390460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:34:07.390460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:34:07.390460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:34:07.390460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:34:07.390460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:34:07.390460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:34:07.391496 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:34:07.391496 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:34:07.391496 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:34:07.391496 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:34:07.391496 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:34:07.391496 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:34:07.391496 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:34:07.391496 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:34:07.391496 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 615/1230] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:34:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:34:07.397478 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35420f-d3fc-423c-835f-a565fc49bdfd None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:07.509960 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35420f-d3fc-423c-835f-a565fc49bdfd None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:07.547060 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc449b0-9c25-44a0-aab0-ff6dcf74ba2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:07.547766 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc449b0-9c25-44a0-aab0-ff6dcf74ba2f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:07.548034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc449b0-9c25-44a0-aab0-ff6dcf74ba2f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:07.548479 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc449b0-9c25-44a0-aab0-ff6dcf74ba2f None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:07.549484 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc449b0-9c25-44a0-aab0-ff6dcf74ba2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:07.549484 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc449b0-9c25-44a0-aab0-ff6dcf74ba2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:07.550916 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc449b0-9c25-44a0-aab0-ff6dcf74ba2f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:07.566660 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 616/1231] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:34:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:07.574032 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede6b3e-cec4-445e-b0c8-6e11292e4bb0 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:07.650759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:07.691381 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede6b3e-cec4-445e-b0c8-6e11292e4bb0 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:07.753516 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756dce9-244a-425a-abe9-35862dd88453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:07.754247 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756dce9-244a-425a-abe9-35862dd88453 None admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:07.754654 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756dce9-244a-425a-abe9-35862dd88453 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:07.754789 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756dce9-244a-425a-abe9-35862dd88453 None admin] PATH_INFO: `/v3/projects/953bb95b0ba84d4f99a73afb426bb8c8/users/895edcfb20484b188a3877c9de8b59c4/roles/024a61996071437aa07a3faf2bb5ae69` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:07.773083 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756dce9-244a-425a-abe9-35862dd88453 None admin] RBAC: Authorizing `identity:create_grant(project_id=953bb95b0ba84d4f99a73afb426bb8c8, user_id=895edcfb20484b188a3877c9de8b59c4, role_id=024a61996071437aa07a3faf2bb5ae69)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:07.774647 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756dce9-244a-425a-abe9-35862dd88453 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:07.787759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 616/1232] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 26 05:34:07 2022] PUT /identity/v3/projects/953bb95b0ba84d4f99a73afb426bb8c8/users/895edcfb20484b188a3877c9de8b59c4/roles/024a61996071437aa07a3faf2bb5ae69 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:34:10.158202 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ac4e8-a4d1-4291-90a6-284ce713c7df None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:10.158756 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ac4e8-a4d1-4291-90a6-284ce713c7df None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:10.158756 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ac4e8-a4d1-4291-90a6-284ce713c7df None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:10.160048 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 617/1233] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:34:10.165708 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3dfcb-fd35-4dcd-aba9-c195fe36da30 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:10.166129 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3dfcb-fd35-4dcd-aba9-c195fe36da30 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:10.166239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3dfcb-fd35-4dcd-aba9-c195fe36da30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:10.186455 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-a4b3dfcb-fd35-4dcd-aba9-c195fe36da30 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:34:10.187655 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a4b3dfcb-fd35-4dcd-aba9-c195fe36da30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:34:10.259790 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 617/1234] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:34:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:34:10.529998 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ac4e8-a4d1-4291-90a6-284ce713c7df None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:10.557948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:10.644051 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ac4e8-a4d1-4291-90a6-284ce713c7df None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:10.684849 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3926e4-64a7-4f71-9150-eb5d14d886b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:10.685600 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3926e4-64a7-4f71-9150-eb5d14d886b1 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:10.685965 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3926e4-64a7-4f71-9150-eb5d14d886b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:10.686275 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3926e4-64a7-4f71-9150-eb5d14d886b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:10.699544 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3926e4-64a7-4f71-9150-eb5d14d886b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:34:10.704941 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-0f3926e4-64a7-4f71-9150-eb5d14d886b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:34:10.704941 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:10.704941 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:34:10.704941 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:34:10.704941 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:34:10.704941 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:34:10.704941 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:34:10.704941 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:34:10.704941 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:34:10.704941 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:34:10.704941 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:34:10.704941 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:34:10.704941 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:34:10.704941 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:34:10.704941 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:34:10.704941 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:34:10.706333 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:34:10.706333 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:34:10.706333 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:34:10.706333 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:34:10.706333 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:34:10.706333 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:34:10.706333 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:34:10.706333 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:34:10.706333 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:34:10.706333 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:34:10.706333 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:34:10.706333 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:34:10.706333 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:34:10.706333 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:34:10.706333 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:34:10.706333 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:34:10.707198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:34:10.707198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:34:10.707198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:34:10.707198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:34:10.707198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:34:10.707198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:34:10.707198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:34:10.707198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:34:10.707198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:34:10.707198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:34:10.707198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 26 05:34:10.707198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:34:10.707198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 618/1235] 10.222.0.66 () {56 vars in 1102 bytes} [Mon Sep 26 05:34:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:34:10.712465 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3dfcb-fd35-4dcd-aba9-c195fe36da30 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:10.763646 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:10.822307 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3dfcb-fd35-4dcd-aba9-c195fe36da30 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:10.863366 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6eada5-53be-457d-99ec-579865fecd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:10.864319 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6eada5-53be-457d-99ec-579865fecd2e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:10.864837 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6eada5-53be-457d-99ec-579865fecd2e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:10.865479 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6eada5-53be-457d-99ec-579865fecd2e None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:10.865588 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6eada5-53be-457d-99ec-579865fecd2e None admin] RBAC: Adding query filter params (name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:10.865975 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6eada5-53be-457d-99ec-579865fecd2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:10.867608 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6eada5-53be-457d-99ec-579865fecd2e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:10.877917 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 618/1236] 10.222.0.66 () {56 vars in 1103 bytes} [Mon Sep 26 05:34:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:10.885093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3926e4-64a7-4f71-9150-eb5d14d886b1 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:10.979317 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:10.998298 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3926e4-64a7-4f71-9150-eb5d14d886b1 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:11.039352 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0b66f-97a8-4b63-b17d-7e6416788492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:11.040129 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0b66f-97a8-4b63-b17d-7e6416788492 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:11.040401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0b66f-97a8-4b63-b17d-7e6416788492 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:11.040666 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0b66f-97a8-4b63-b17d-7e6416788492 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:11.053557 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0b66f-97a8-4b63-b17d-7e6416788492 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:11.055083 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0b66f-97a8-4b63-b17d-7e6416788492 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:11.072068 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-cac0b66f-97a8-4b63-b17d-7e6416788492 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:34:11.072068 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:11.072068 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:34:11.072068 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:34:11.072068 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:34:11.072068 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:34:11.072068 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:34:11.072068 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:34:11.072068 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:34:11.072068 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:34:11.072068 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:34:11.072068 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:34:11.072068 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:34:11.072068 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:34:11.072068 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:34:11.072068 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:34:11.073932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:34:11.073932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:34:11.073932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:34:11.073932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:34:11.073932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:34:11.073932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:34:11.073932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:34:11.073932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:34:11.073932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:34:11.073932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:34:11.073932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:34:11.073932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:34:11.073932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:34:11.073932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:34:11.073932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:34:11.073932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:34:11.073932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:34:11.075760 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:34:11.075760 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:34:11.075760 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:34:11.075760 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 619/1237] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:34:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:34:11.079387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6eada5-53be-457d-99ec-579865fecd2e None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:11.194739 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6eada5-53be-457d-99ec-579865fecd2e None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:11.205035 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:11.231857 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a251cf-3fed-42a1-9dae-41206837a21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:11.232458 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a251cf-3fed-42a1-9dae-41206837a21c None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:11.232758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a251cf-3fed-42a1-9dae-41206837a21c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:11.233023 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a251cf-3fed-42a1-9dae-41206837a21c None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:11.233652 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a251cf-3fed-42a1-9dae-41206837a21c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:11.233942 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a251cf-3fed-42a1-9dae-41206837a21c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:11.236443 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a251cf-3fed-42a1-9dae-41206837a21c None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:11.249261 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 619/1238] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:11.255290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0b66f-97a8-4b63-b17d-7e6416788492 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:11.379399 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0b66f-97a8-4b63-b17d-7e6416788492 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:11.415081 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687ec7e-e978-4f51-8101-3bb471004b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:11.415863 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687ec7e-e978-4f51-8101-3bb471004b59 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:11.416208 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687ec7e-e978-4f51-8101-3bb471004b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:11.416489 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687ec7e-e978-4f51-8101-3bb471004b59 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:11.419786 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:11.428256 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687ec7e-e978-4f51-8101-3bb471004b59 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:11.430007 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687ec7e-e978-4f51-8101-3bb471004b59 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:11.442709 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-5687ec7e-e978-4f51-8101-3bb471004b59 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 05:34:11.442709 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:11.442709 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:34:11.442709 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:34:11.442709 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:34:11.442709 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:34:11.442709 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:34:11.442709 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:34:11.442709 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:34:11.442709 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:34:11.442709 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:34:11.442709 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:34:11.442709 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:34:11.442709 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:34:11.442709 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:34:11.442709 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:34:11.443972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:34:11.443972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:34:11.443972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:34:11.443972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:34:11.443972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:34:11.443972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:34:11.443972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:34:11.443972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:34:11.443972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:34:11.443972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:34:11.443972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:34:11.443972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:34:11.443972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:34:11.443972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:34:11.443972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:34:11.443972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:34:11.443972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:34:11.443972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:34:11.445236 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:34:11.445236 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:34:11.445236 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:34:11.445236 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:34:11.445236 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:34:11.445236 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:34:11.445236 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:34:11.445236 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:34:11.445236 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 05:34:11.445236 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:34:11.445236 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 620/1239] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:34:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:34:11.450432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a251cf-3fed-42a1-9dae-41206837a21c None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:11.568471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a251cf-3fed-42a1-9dae-41206837a21c None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:11.612830 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9351151-7a82-40c1-b900-181cee70efff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:11.613451 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9351151-7a82-40c1-b900-181cee70efff None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:11.613757 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9351151-7a82-40c1-b900-181cee70efff None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:11.614099 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9351151-7a82-40c1-b900-181cee70efff None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:11.614962 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9351151-7a82-40c1-b900-181cee70efff None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:11.615447 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9351151-7a82-40c1-b900-181cee70efff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:11.617273 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9351151-7a82-40c1-b900-181cee70efff None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:11.637271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 620/1240] 10.222.0.66 () {56 vars in 1143 bytes} [Mon Sep 26 05:34:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:11.643551 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687ec7e-e978-4f51-8101-3bb471004b59 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:11.762477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687ec7e-e978-4f51-8101-3bb471004b59 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:11.811449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d9b58-0f62-4ea3-b078-c703ece87251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:11.812147 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d9b58-0f62-4ea3-b078-c703ece87251 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:11.812423 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d9b58-0f62-4ea3-b078-c703ece87251 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:11.812690 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d9b58-0f62-4ea3-b078-c703ece87251 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:11.885917 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:11.895485 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d9b58-0f62-4ea3-b078-c703ece87251 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:11.896946 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d9b58-0f62-4ea3-b078-c703ece87251 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:12.034924 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 621/1241] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:34:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:34:12.041687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9351151-7a82-40c1-b900-181cee70efff None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:12.074894 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:12.159718 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9351151-7a82-40c1-b900-181cee70efff None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:12.203822 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f9608-f444-4ddf-af12-143d4ed5ba77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:12.204677 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f9608-f444-4ddf-af12-143d4ed5ba77 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:12.205036 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f9608-f444-4ddf-af12-143d4ed5ba77 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:12.205223 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f9608-f444-4ddf-af12-143d4ed5ba77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:12.217103 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f9608-f444-4ddf-af12-143d4ed5ba77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:12.218563 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8f9608-f444-4ddf-af12-143d4ed5ba77 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:12.233995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-3d8f9608-f444-4ddf-af12-143d4ed5ba77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:34:12.233995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:12.233995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:34:12.233995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:34:12.233995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:34:12.233995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:34:12.233995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:34:12.233995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:34:12.233995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:34:12.233995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:34:12.233995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:34:12.233995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:34:12.233995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:34:12.233995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:34:12.233995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:34:12.233995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:34:12.235057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:34:12.235057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:34:12.235057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:34:12.235057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:34:12.235057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:34:12.235057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:34:12.235057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:34:12.235057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:34:12.235057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:34:12.235057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:34:12.235057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:34:12.235057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:34:12.235057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:34:12.235057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:34:12.235057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:34:12.235057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:34:12.235057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:34:12.236082 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:34:12.236082 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:34:12.236082 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:34:12.236082 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 621/1242] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:34:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:34:12.241711 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d9b58-0f62-4ea3-b078-c703ece87251 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:12.355134 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:12.361695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d9b58-0f62-4ea3-b078-c703ece87251 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:12.402141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3547ec-b0f4-4eef-989e-09c1dbdb3ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:12.402735 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3547ec-b0f4-4eef-989e-09c1dbdb3ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:12.403004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3547ec-b0f4-4eef-989e-09c1dbdb3ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:12.403265 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3547ec-b0f4-4eef-989e-09c1dbdb3ef9 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:12.403949 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3547ec-b0f4-4eef-989e-09c1dbdb3ef9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:12.404262 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3547ec-b0f4-4eef-989e-09c1dbdb3ef9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:12.405627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3547ec-b0f4-4eef-989e-09c1dbdb3ef9 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:12.419215 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 622/1243] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:12.425550 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f9608-f444-4ddf-af12-143d4ed5ba77 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:12.535398 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:12.561570 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f9608-f444-4ddf-af12-143d4ed5ba77 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:12.602288 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b9eb8-449c-4803-9e0b-cac7bee41064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:12.602936 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b9eb8-449c-4803-9e0b-cac7bee41064 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:12.603211 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b9eb8-449c-4803-9e0b-cac7bee41064 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:12.603478 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b9eb8-449c-4803-9e0b-cac7bee41064 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:12.611373 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b9eb8-449c-4803-9e0b-cac7bee41064 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:12.613136 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6b9eb8-449c-4803-9e0b-cac7bee41064 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:12.627841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-4b6b9eb8-449c-4803-9e0b-cac7bee41064 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:34:12.627841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:12.627841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:34:12.627841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:34:12.627841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:34:12.627841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:34:12.627841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:34:12.627841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:34:12.627841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:34:12.627841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:34:12.627841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:34:12.627841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:34:12.627841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:34:12.627841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:34:12.627841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:34:12.629194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:34:12.629194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:34:12.629194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:34:12.629194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:34:12.629194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:34:12.629194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:34:12.629194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:34:12.629194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:34:12.629194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:34:12.629194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:34:12.629194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:34:12.629194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:34:12.629194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:34:12.629194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:34:12.629194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:34:12.629194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:34:12.629194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:34:12.630320 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:34:12.630320 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:34:12.630320 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:34:12.630320 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:34:12.630320 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:34:12.630320 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:34:12.630320 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:34:12.630320 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:34:12.630320 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 622/1244] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:34:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:34:12.636109 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3547ec-b0f4-4eef-989e-09c1dbdb3ef9 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:12.753272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3547ec-b0f4-4eef-989e-09c1dbdb3ef9 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:12.794696 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a014a1-6335-4b5f-a76c-2b113a4387a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:12.795318 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a014a1-6335-4b5f-a76c-2b113a4387a4 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:12.795591 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a014a1-6335-4b5f-a76c-2b113a4387a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:12.795889 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a014a1-6335-4b5f-a76c-2b113a4387a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:12.796592 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a014a1-6335-4b5f-a76c-2b113a4387a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:12.796937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a014a1-6335-4b5f-a76c-2b113a4387a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:12.798482 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a014a1-6335-4b5f-a76c-2b113a4387a4 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:12.811798 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 623/1245] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:34:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:12.822363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b9eb8-449c-4803-9e0b-cac7bee41064 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:12.958676 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b9eb8-449c-4803-9e0b-cac7bee41064 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:13.007464 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b418c-e98e-4b2a-a3ba-1f1669102f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:13.008385 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b418c-e98e-4b2a-a3ba-1f1669102f6f None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:13.008657 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b418c-e98e-4b2a-a3ba-1f1669102f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:13.009128 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b418c-e98e-4b2a-a3ba-1f1669102f6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:13.009974 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b418c-e98e-4b2a-a3ba-1f1669102f6f None admin] RBAC: Adding query filter params (role.id=024a61996071437aa07a3faf2bb5ae69, scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8, user.id=895edcfb20484b188a3877c9de8b59c4) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:13.010514 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b418c-e98e-4b2a-a3ba-1f1669102f6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:13.012438 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b418c-e98e-4b2a-a3ba-1f1669102f6f None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:13.020687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 623/1246] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:34:12 2022] GET /identity/v3/role_assignments?user.id=895edcfb20484b188a3877c9de8b59c4&scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8&role.id=024a61996071437aa07a3faf2bb5ae69 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:15.433068 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff18ca-990a-430d-a104-27fd2799c9e3 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:15.433612 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff18ca-990a-430d-a104-27fd2799c9e3 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:15.433612 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff18ca-990a-430d-a104-27fd2799c9e3 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:15.434930 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 624/1247] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:34:15.441600 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a879a-6634-4874-a12d-b2fd2ec1f0d6 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:15.442055 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a879a-6634-4874-a12d-b2fd2ec1f0d6 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:15.442232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a879a-6634-4874-a12d-b2fd2ec1f0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:15.450264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:15.464456 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-620a879a-6634-4874-a12d-b2fd2ec1f0d6 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:34:15.466298 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-620a879a-6634-4874-a12d-b2fd2ec1f0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:34:15.550506 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 624/1248] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:34:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:34:15.834806 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff18ca-990a-430d-a104-27fd2799c9e3 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:15.855487 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:15.961564 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff18ca-990a-430d-a104-27fd2799c9e3 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:16.005244 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b6f37-2bc8-48c4-bff4-257a1af6c98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:16.005977 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b6f37-2bc8-48c4-bff4-257a1af6c98c None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:16.006355 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b6f37-2bc8-48c4-bff4-257a1af6c98c None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:16.006644 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b6f37-2bc8-48c4-bff4-257a1af6c98c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:16.019283 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b6f37-2bc8-48c4-bff4-257a1af6c98c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:34:16.024141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-a33b6f37-2bc8-48c4-bff4-257a1af6c98c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:34:16.024141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:16.024141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:34:16.024141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:34:16.024141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:34:16.024141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:34:16.024141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:34:16.024141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:34:16.024141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:34:16.024141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:34:16.024141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:34:16.024141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:34:16.024141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:34:16.024141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:34:16.024141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:34:16.024141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:34:16.025674 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:34:16.025674 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:34:16.025674 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:34:16.025674 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:34:16.025674 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:34:16.025674 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:34:16.025674 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:34:16.025674 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:34:16.025674 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:34:16.025674 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:34:16.025674 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:34:16.025674 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:34:16.025674 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:34:16.025674 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:34:16.025674 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:34:16.025674 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:34:16.026777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:34:16.026777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:34:16.026777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:34:16.026777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:34:16.026777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:34:16.026777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:34:16.026777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:34:16.026777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:34:16.026777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:34:16.026777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:34:16.026777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:34:16.026777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:34:16.026777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 625/1249] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:34:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:34:16.031726 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a879a-6634-4874-a12d-b2fd2ec1f0d6 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:16.142546 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a879a-6634-4874-a12d-b2fd2ec1f0d6 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:16.175922 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:16.181838 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495079f6-c66a-46f8-aab8-16bfaf166ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:16.182667 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495079f6-c66a-46f8-aab8-16bfaf166ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:16.182933 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495079f6-c66a-46f8-aab8-16bfaf166ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:16.183204 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495079f6-c66a-46f8-aab8-16bfaf166ee8 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:16.183918 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495079f6-c66a-46f8-aab8-16bfaf166ee8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:16.184215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495079f6-c66a-46f8-aab8-16bfaf166ee8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:16.185593 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495079f6-c66a-46f8-aab8-16bfaf166ee8 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:16.194691 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 625/1250] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:34:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:16.201465 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b6f37-2bc8-48c4-bff4-257a1af6c98c None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:16.293621 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:16.324083 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b6f37-2bc8-48c4-bff4-257a1af6c98c None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:16.360317 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd14869-394a-46b8-b0f9-212061c9a01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:16.360954 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd14869-394a-46b8-b0f9-212061c9a01a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:16.361233 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd14869-394a-46b8-b0f9-212061c9a01a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:16.361497 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd14869-394a-46b8-b0f9-212061c9a01a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:16.371876 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd14869-394a-46b8-b0f9-212061c9a01a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:16.373356 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd14869-394a-46b8-b0f9-212061c9a01a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:16.390830 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-6bd14869-394a-46b8-b0f9-212061c9a01a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:34:16.390830 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:16.390830 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:34:16.390830 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:34:16.390830 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:34:16.390830 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:34:16.390830 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:34:16.390830 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:34:16.390830 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:34:16.390830 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:34:16.390830 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:34:16.390830 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:34:16.390830 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:34:16.390830 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:34:16.390830 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:34:16.390830 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:34:16.392722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:34:16.392722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:34:16.392722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:34:16.392722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:34:16.392722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:34:16.392722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:34:16.392722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:34:16.392722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:34:16.392722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:34:16.392722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:34:16.392722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:34:16.392722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:34:16.392722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:34:16.392722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:34:16.392722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:34:16.392722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:34:16.392722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:34:16.394562 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:34:16.394562 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:34:16.394562 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:34:16.394562 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 626/1251] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:34:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 26 05:34:16.398288 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495079f6-c66a-46f8-aab8-16bfaf166ee8 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:16.520475 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495079f6-c66a-46f8-aab8-16bfaf166ee8 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:16.565369 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3977a5-e7f4-4817-8520-cebf9e3b7356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:16.566085 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3977a5-e7f4-4817-8520-cebf9e3b7356 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:16.566450 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3977a5-e7f4-4817-8520-cebf9e3b7356 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:16.566783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3977a5-e7f4-4817-8520-cebf9e3b7356 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:16.567410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3977a5-e7f4-4817-8520-cebf9e3b7356 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:16.567705 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3977a5-e7f4-4817-8520-cebf9e3b7356 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:16.569107 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3977a5-e7f4-4817-8520-cebf9e3b7356 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:16.584723 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 626/1252] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:16.590958 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd14869-394a-46b8-b0f9-212061c9a01a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:16.704923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd14869-394a-46b8-b0f9-212061c9a01a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:16.734655 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:16.743866 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce755a9-185b-43d2-aeaa-49c91fb937c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:16.744519 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce755a9-185b-43d2-aeaa-49c91fb937c5 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:16.744782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce755a9-185b-43d2-aeaa-49c91fb937c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:16.745047 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce755a9-185b-43d2-aeaa-49c91fb937c5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:16.753667 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce755a9-185b-43d2-aeaa-49c91fb937c5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:16.755384 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce755a9-185b-43d2-aeaa-49c91fb937c5 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:16.767652 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-7ce755a9-185b-43d2-aeaa-49c91fb937c5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 05:34:16.767652 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:16.767652 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:34:16.767652 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:34:16.767652 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:34:16.767652 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:34:16.767652 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:34:16.767652 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:34:16.767652 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:34:16.767652 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:34:16.767652 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:34:16.767652 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:34:16.767652 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:34:16.767652 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:34:16.767652 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:34:16.767652 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:34:16.768957 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:34:16.768957 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:34:16.768957 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:34:16.768957 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:34:16.768957 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:34:16.768957 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:34:16.768957 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:34:16.768957 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:34:16.768957 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:34:16.768957 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:34:16.768957 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:34:16.768957 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:34:16.768957 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:34:16.768957 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:34:16.768957 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:34:16.768957 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:34:16.768957 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:34:16.768957 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:34:16.770278 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:34:16.770278 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:34:16.770278 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:34:16.770278 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:34:16.770278 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:34:16.770278 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:34:16.770278 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:34:16.770278 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:34:16.770278 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 05:34:16.770278 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:34:16.774206 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 627/1253] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:34:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:34:16.775567 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3977a5-e7f4-4817-8520-cebf9e3b7356 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:16.835043 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:16.886379 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3977a5-e7f4-4817-8520-cebf9e3b7356 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:16.938129 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770454b-e23d-4ea7-8f03-c33985d38390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:16.938780 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770454b-e23d-4ea7-8f03-c33985d38390 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:16.939099 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770454b-e23d-4ea7-8f03-c33985d38390 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:16.939372 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770454b-e23d-4ea7-8f03-c33985d38390 None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:16.940177 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770454b-e23d-4ea7-8f03-c33985d38390 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:16.940490 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770454b-e23d-4ea7-8f03-c33985d38390 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:16.941929 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770454b-e23d-4ea7-8f03-c33985d38390 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:16.965022 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 627/1254] 10.222.0.66 () {56 vars in 1143 bytes} [Mon Sep 26 05:34:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:16.971828 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce755a9-185b-43d2-aeaa-49c91fb937c5 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:17.084477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce755a9-185b-43d2-aeaa-49c91fb937c5 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:17.125184 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55a32b-dd97-4d5c-935a-95bb42c2c8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:17.125718 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55a32b-dd97-4d5c-935a-95bb42c2c8fe None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:17.126062 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55a32b-dd97-4d5c-935a-95bb42c2c8fe None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:17.126366 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55a32b-dd97-4d5c-935a-95bb42c2c8fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:17.195755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:17.213871 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad55a32b-dd97-4d5c-935a-95bb42c2c8fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:17.215358 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad55a32b-dd97-4d5c-935a-95bb42c2c8fe None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:17.338365 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 628/1255] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:34:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:34:17.344914 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770454b-e23d-4ea7-8f03-c33985d38390 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:17.458328 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770454b-e23d-4ea7-8f03-c33985d38390 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:17.474168 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:17.503153 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591800de-adc1-4351-ada1-c57a4eff9b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:17.503850 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591800de-adc1-4351-ada1-c57a4eff9b62 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:17.504120 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591800de-adc1-4351-ada1-c57a4eff9b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:17.504387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591800de-adc1-4351-ada1-c57a4eff9b62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:17.515944 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591800de-adc1-4351-ada1-c57a4eff9b62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:17.517528 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591800de-adc1-4351-ada1-c57a4eff9b62 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:17.534808 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-591800de-adc1-4351-ada1-c57a4eff9b62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:34:17.534808 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:17.534808 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:34:17.534808 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:34:17.534808 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:34:17.534808 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:34:17.534808 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:34:17.534808 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:34:17.534808 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:34:17.534808 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:34:17.534808 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:34:17.534808 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:34:17.534808 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:34:17.534808 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:34:17.534808 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:34:17.534808 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:34:17.537199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:34:17.537199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:34:17.537199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:34:17.537199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:34:17.537199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:34:17.537199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:34:17.537199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:34:17.537199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:34:17.537199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:34:17.537199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:34:17.537199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:34:17.537199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:34:17.537199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:34:17.537199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:34:17.537199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:34:17.537199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:34:17.537199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:34:17.538920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:34:17.538920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:34:17.538920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:34:17.538920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 628/1256] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:34:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:34:17.542770 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55a32b-dd97-4d5c-935a-95bb42c2c8fe None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:17.678869 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:17.693622 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55a32b-dd97-4d5c-935a-95bb42c2c8fe None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:17.733945 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0634d-da77-40b1-9b21-0ed1c8db2278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:17.734498 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0634d-da77-40b1-9b21-0ed1c8db2278 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:17.734793 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0634d-da77-40b1-9b21-0ed1c8db2278 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:17.735057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0634d-da77-40b1-9b21-0ed1c8db2278 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:17.735859 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0634d-da77-40b1-9b21-0ed1c8db2278 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:17.736164 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0634d-da77-40b1-9b21-0ed1c8db2278 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:17.737605 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0634d-da77-40b1-9b21-0ed1c8db2278 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:17.751345 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 629/1257] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:17.757444 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591800de-adc1-4351-ada1-c57a4eff9b62 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:17.865056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591800de-adc1-4351-ada1-c57a4eff9b62 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:17.900428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc1219-f76d-4fe9-bdde-f3f579dce55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:17.901062 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc1219-f76d-4fe9-bdde-f3f579dce55a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:17.901323 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc1219-f76d-4fe9-bdde-f3f579dce55a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:17.901580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc1219-f76d-4fe9-bdde-f3f579dce55a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:17.908562 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc1219-f76d-4fe9-bdde-f3f579dce55a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:17.909981 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc1219-f76d-4fe9-bdde-f3f579dce55a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:17.921374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-8dbc1219-f76d-4fe9-bdde-f3f579dce55a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:34:17.921374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:17.921374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:34:17.921374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:34:17.921374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:34:17.921374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:34:17.921374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:34:17.921374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:34:17.921374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:34:17.921374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:34:17.921374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:34:17.921374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:34:17.921374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:34:17.921374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:34:17.921374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:34:17.922442 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:34:17.922442 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:34:17.922442 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:34:17.922442 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:34:17.922442 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:34:17.922442 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:34:17.922442 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:34:17.922442 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:34:17.922442 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:34:17.922442 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:34:17.922442 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:34:17.922442 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:34:17.922442 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:34:17.922442 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:34:17.922442 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:34:17.922442 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:34:17.922442 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:34:17.923621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:34:17.923621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:34:17.923621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:34:17.923621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:34:17.923621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:34:17.923621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:34:17.923621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:34:17.923621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:34:17.923621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 629/1258] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:34:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:34:17.929315 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0634d-da77-40b1-9b21-0ed1c8db2278 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:18.034307 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0634d-da77-40b1-9b21-0ed1c8db2278 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:18.068379 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede57844-442d-4109-92ee-4a1b05555b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:18.068983 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede57844-442d-4109-92ee-4a1b05555b3a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:18.069255 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede57844-442d-4109-92ee-4a1b05555b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:18.069522 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede57844-442d-4109-92ee-4a1b05555b3a None admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:18.070203 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede57844-442d-4109-92ee-4a1b05555b3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:18.070503 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede57844-442d-4109-92ee-4a1b05555b3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:18.072354 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede57844-442d-4109-92ee-4a1b05555b3a None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:18.084532 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 630/1259] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:34:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:18.090874 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc1219-f76d-4fe9-bdde-f3f579dce55a None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:18.118306 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:18.194860 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc1219-f76d-4fe9-bdde-f3f579dce55a None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:18.229971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8297c60-ff22-443e-bc02-44f0acb762c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:18.230575 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8297c60-ff22-443e-bc02-44f0acb762c3 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:18.230840 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8297c60-ff22-443e-bc02-44f0acb762c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:18.231107 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8297c60-ff22-443e-bc02-44f0acb762c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:18.231854 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8297c60-ff22-443e-bc02-44f0acb762c3 None admin] RBAC: Adding query filter params (role.id=cf58d66369044fb09fa65a4366dc7446, scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8, user.id=895edcfb20484b188a3877c9de8b59c4) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:18.232137 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8297c60-ff22-443e-bc02-44f0acb762c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:18.233549 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8297c60-ff22-443e-bc02-44f0acb762c3 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:18.239247 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 630/1260] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:34:18 2022] GET /identity/v3/role_assignments?user.id=895edcfb20484b188a3877c9de8b59c4&scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8&role.id=cf58d66369044fb09fa65a4366dc7446 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:20.354479 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78e642-4893-4bd4-ba08-f5dca7b1d08b None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:20.355056 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78e642-4893-4bd4-ba08-f5dca7b1d08b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:20.355056 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78e642-4893-4bd4-ba08-f5dca7b1d08b None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:20.356409 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 631/1261] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:34:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:34:20.362616 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d29bf-038d-4eb0-94fa-dd2ff8e57e75 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:20.363178 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d29bf-038d-4eb0-94fa-dd2ff8e57e75 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:20.363178 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d29bf-038d-4eb0-94fa-dd2ff8e57e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:20.383686 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-765d29bf-038d-4eb0-94fa-dd2ff8e57e75 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:34:20.384952 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-765d29bf-038d-4eb0-94fa-dd2ff8e57e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:34:20.462990 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 631/1262] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:34:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:34:20.731766 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78e642-4893-4bd4-ba08-f5dca7b1d08b None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:20.743622 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:20.839716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78e642-4893-4bd4-ba08-f5dca7b1d08b None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:20.874517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef239e7-f731-4a4a-afa9-b1dc8791693a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:20.875138 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef239e7-f731-4a4a-afa9-b1dc8791693a None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:20.875409 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef239e7-f731-4a4a-afa9-b1dc8791693a None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:20.875660 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef239e7-f731-4a4a-afa9-b1dc8791693a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:20.886063 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef239e7-f731-4a4a-afa9-b1dc8791693a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:34:20.890856 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-2ef239e7-f731-4a4a-afa9-b1dc8791693a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:34:20.890856 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:20.890856 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:34:20.890856 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:34:20.890856 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:34:20.890856 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:34:20.890856 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:34:20.890856 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:34:20.890856 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:34:20.890856 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:34:20.890856 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:34:20.890856 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:34:20.890856 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:34:20.890856 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:34:20.890856 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:34:20.890856 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:34:20.892124 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:34:20.892124 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:34:20.892124 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:34:20.892124 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:34:20.892124 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:34:20.892124 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:34:20.892124 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:34:20.892124 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:34:20.892124 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:34:20.892124 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:34:20.892124 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:34:20.892124 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:34:20.892124 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:34:20.892124 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:34:20.892124 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:34:20.892124 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:34:20.893160 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:34:20.893160 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:34:20.893160 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:34:20.893160 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:34:20.893160 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:34:20.893160 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:34:20.893160 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:34:20.893160 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:34:20.893160 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:34:20.893160 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:34:20.893160 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:34:20.893160 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:34:20.893160 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 632/1263] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:34:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:34:20.898343 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d29bf-038d-4eb0-94fa-dd2ff8e57e75 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:20.917778 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:21.001647 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d29bf-038d-4eb0-94fa-dd2ff8e57e75 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:21.038840 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6576d5-0e27-4040-8344-01ae985b67c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:21.039443 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6576d5-0e27-4040-8344-01ae985b67c0 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:21.039715 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6576d5-0e27-4040-8344-01ae985b67c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:21.040011 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6576d5-0e27-4040-8344-01ae985b67c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:21.040669 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6576d5-0e27-4040-8344-01ae985b67c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:21.040965 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6576d5-0e27-4040-8344-01ae985b67c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:21.042330 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6576d5-0e27-4040-8344-01ae985b67c0 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:21.051016 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 632/1264] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:34:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:21.057078 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef239e7-f731-4a4a-afa9-b1dc8791693a None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:21.124358 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:21.158022 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef239e7-f731-4a4a-afa9-b1dc8791693a None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:21.192582 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1a98f-497f-4594-b5f8-246d39299a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:21.193240 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1a98f-497f-4594-b5f8-246d39299a79 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:21.193514 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1a98f-497f-4594-b5f8-246d39299a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:21.193779 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a1a98f-497f-4594-b5f8-246d39299a79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:21.205547 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1a98f-497f-4594-b5f8-246d39299a79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:21.207024 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a1a98f-497f-4594-b5f8-246d39299a79 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:21.222913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-95a1a98f-497f-4594-b5f8-246d39299a79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:34:21.222913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:21.222913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:34:21.222913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:34:21.222913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:34:21.222913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:34:21.222913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:34:21.222913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:34:21.222913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:34:21.222913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:34:21.222913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:34:21.222913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:34:21.222913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:34:21.222913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:34:21.222913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:34:21.222913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:34:21.224025 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:34:21.224025 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:34:21.224025 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:34:21.224025 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:34:21.224025 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:34:21.224025 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:34:21.224025 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:34:21.224025 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:34:21.224025 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:34:21.224025 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:34:21.224025 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:34:21.224025 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:34:21.224025 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:34:21.224025 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:34:21.224025 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:34:21.224025 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:34:21.224025 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:34:21.224984 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:34:21.224984 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:34:21.224984 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:34:21.224984 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 633/1265] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:34:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:34:21.230464 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6576d5-0e27-4040-8344-01ae985b67c0 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:21.320263 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:21.339751 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6576d5-0e27-4040-8344-01ae985b67c0 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:21.382007 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9b5a8-16a7-430c-a99e-bde345b786c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:21.382730 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9b5a8-16a7-430c-a99e-bde345b786c4 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:21.382823 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9b5a8-16a7-430c-a99e-bde345b786c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:21.383113 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9b5a8-16a7-430c-a99e-bde345b786c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:21.383770 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9b5a8-16a7-430c-a99e-bde345b786c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:21.384060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9b5a8-16a7-430c-a99e-bde345b786c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:21.385422 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9b5a8-16a7-430c-a99e-bde345b786c4 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:21.397668 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 633/1266] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:21.403749 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1a98f-497f-4594-b5f8-246d39299a79 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:21.508972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a1a98f-497f-4594-b5f8-246d39299a79 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:21.528878 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:21.544937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05de73-e51d-45c8-9761-0ecc10b68f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:21.545572 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05de73-e51d-45c8-9761-0ecc10b68f71 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:21.545851 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05de73-e51d-45c8-9761-0ecc10b68f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:21.546123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05de73-e51d-45c8-9761-0ecc10b68f71 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:21.554081 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05de73-e51d-45c8-9761-0ecc10b68f71 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:21.555536 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05de73-e51d-45c8-9761-0ecc10b68f71 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:21.566692 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-aa05de73-e51d-45c8-9761-0ecc10b68f71 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 05:34:21.566692 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:21.566692 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:34:21.566692 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:34:21.566692 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:34:21.566692 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:34:21.566692 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:34:21.566692 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:34:21.566692 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:34:21.566692 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:34:21.566692 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:34:21.566692 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:34:21.566692 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:34:21.566692 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:34:21.566692 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:34:21.566692 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:34:21.567820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:34:21.567820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:34:21.567820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:34:21.567820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:34:21.567820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:34:21.567820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:34:21.567820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:34:21.567820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:34:21.567820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:34:21.567820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:34:21.567820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:34:21.567820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:34:21.567820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:34:21.567820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:34:21.567820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:34:21.567820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:34:21.567820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:34:21.567820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:34:21.568835 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:34:21.568835 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:34:21.568835 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:34:21.568835 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:34:21.568835 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:34:21.568835 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:34:21.568835 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:34:21.568835 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:34:21.568835 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 05:34:21.568835 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:34:21.568835 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 634/1267] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:34:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:34:21.574430 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9b5a8-16a7-430c-a99e-bde345b786c4 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:21.676576 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9b5a8-16a7-430c-a99e-bde345b786c4 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:21.713431 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb29a91-7862-499b-8d20-73d358d9b82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:21.714044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb29a91-7862-499b-8d20-73d358d9b82e None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:21.714316 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb29a91-7862-499b-8d20-73d358d9b82e None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:21.714583 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb29a91-7862-499b-8d20-73d358d9b82e None admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:21.715299 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb29a91-7862-499b-8d20-73d358d9b82e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:21.715624 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb29a91-7862-499b-8d20-73d358d9b82e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:21.717084 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb29a91-7862-499b-8d20-73d358d9b82e None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:21.726045 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:21.735333 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 634/1268] 10.222.0.66 () {56 vars in 1143 bytes} [Mon Sep 26 05:34:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:21.741445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05de73-e51d-45c8-9761-0ecc10b68f71 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:21.844582 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05de73-e51d-45c8-9761-0ecc10b68f71 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:21.879698 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848a920-87cf-46c7-9bdf-d90867469275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:21.880353 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848a920-87cf-46c7-9bdf-d90867469275 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:21.880628 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848a920-87cf-46c7-9bdf-d90867469275 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:21.880902 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848a920-87cf-46c7-9bdf-d90867469275 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:21.891782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848a920-87cf-46c7-9bdf-d90867469275 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:21.893271 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848a920-87cf-46c7-9bdf-d90867469275 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:21.907717 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-5848a920-87cf-46c7-9bdf-d90867469275 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:34:21.907717 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:21.907717 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:34:21.907717 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:34:21.907717 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:34:21.907717 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:34:21.907717 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:34:21.907717 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:34:21.907717 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:34:21.907717 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:34:21.907717 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:34:21.907717 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:34:21.907717 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:34:21.907717 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:34:21.907717 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:34:21.907717 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:34:21.908841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:34:21.908841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:34:21.908841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:34:21.908841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:34:21.908841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:34:21.908841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:34:21.908841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:34:21.908841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:34:21.908841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:34:21.908841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:34:21.908841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:34:21.908841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:34:21.908841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:34:21.908841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:34:21.908841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:34:21.908841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:34:21.908841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:34:21.909768 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:34:21.909768 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:34:21.909768 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:34:21.909768 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 635/1269] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:34:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:34:21.914907 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb29a91-7862-499b-8d20-73d358d9b82e None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:22.017142 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb29a91-7862-499b-8d20-73d358d9b82e None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:22.052015 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5d40c-f67b-4a15-b66c-1195363bbaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:22.052619 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5d40c-f67b-4a15-b66c-1195363bbaeb None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:22.052895 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5d40c-f67b-4a15-b66c-1195363bbaeb None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:22.053159 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5d40c-f67b-4a15-b66c-1195363bbaeb None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:22.053795 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5d40c-f67b-4a15-b66c-1195363bbaeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:22.054088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5d40c-f67b-4a15-b66c-1195363bbaeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:22.055452 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5d40c-f67b-4a15-b66c-1195363bbaeb None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:22.066868 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 635/1270] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:22.073312 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848a920-87cf-46c7-9bdf-d90867469275 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:22.109185 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:22.179983 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848a920-87cf-46c7-9bdf-d90867469275 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:22.215307 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b659a-22e6-42eb-9602-540c5443cede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:22.215935 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b659a-22e6-42eb-9602-540c5443cede None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:22.216244 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b659a-22e6-42eb-9602-540c5443cede None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:22.216512 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b659a-22e6-42eb-9602-540c5443cede None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:22.223584 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9b659a-22e6-42eb-9602-540c5443cede None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:22.225077 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9b659a-22e6-42eb-9602-540c5443cede None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:22.236820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-af9b659a-22e6-42eb-9602-540c5443cede None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:34:22.236820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:22.236820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:34:22.236820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:34:22.236820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:34:22.236820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:34:22.236820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:34:22.236820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:34:22.236820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:34:22.236820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:34:22.236820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:34:22.236820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:34:22.236820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:34:22.236820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:34:22.236820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:34:22.237837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:34:22.237837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:34:22.237837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:34:22.237837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:34:22.237837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:34:22.237837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:34:22.237837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:34:22.237837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:34:22.237837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:34:22.237837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:34:22.237837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:34:22.237837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:34:22.237837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:34:22.237837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:34:22.237837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:34:22.237837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:34:22.237837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:34:22.238812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:34:22.238812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:34:22.238812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:34:22.238812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:34:22.238812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:34:22.238812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:34:22.238812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:34:22.238812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:34:22.238812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 636/1271] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:34:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:34:22.244153 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5d40c-f67b-4a15-b66c-1195363bbaeb None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:22.310256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:22.355680 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5d40c-f67b-4a15-b66c-1195363bbaeb None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:22.393973 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01497fc2-0e32-41b5-9faf-b7ccd6057be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:22.394639 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01497fc2-0e32-41b5-9faf-b7ccd6057be4 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:22.394730 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01497fc2-0e32-41b5-9faf-b7ccd6057be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:22.394993 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01497fc2-0e32-41b5-9faf-b7ccd6057be4 None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:22.395680 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01497fc2-0e32-41b5-9faf-b7ccd6057be4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:22.396015 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01497fc2-0e32-41b5-9faf-b7ccd6057be4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:22.397447 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01497fc2-0e32-41b5-9faf-b7ccd6057be4 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:22.410056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 636/1272] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:34:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:22.416544 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b659a-22e6-42eb-9602-540c5443cede None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:22.520861 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:22.531164 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b659a-22e6-42eb-9602-540c5443cede None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:22.566424 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecfecc6-1d9b-4171-bdab-607b2f59c6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:22.567072 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfecc6-1d9b-4171-bdab-607b2f59c6db None admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:22.567344 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfecc6-1d9b-4171-bdab-607b2f59c6db None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:22.567611 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecfecc6-1d9b-4171-bdab-607b2f59c6db None admin] PATH_INFO: `/v3/projects/953bb95b0ba84d4f99a73afb426bb8c8/users/895edcfb20484b188a3877c9de8b59c4/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:22.569679 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecfecc6-1d9b-4171-bdab-607b2f59c6db None admin] RBAC: Authorizing `identity:create_grant(project_id=953bb95b0ba84d4f99a73afb426bb8c8, user_id=895edcfb20484b188a3877c9de8b59c4, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:22.571477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecfecc6-1d9b-4171-bdab-607b2f59c6db None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:22.586031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 637/1273] 10.222.0.66 () {58 vars in 1439 bytes} [Mon Sep 26 05:34:22 2022] PUT /identity/v3/projects/953bb95b0ba84d4f99a73afb426bb8c8/users/895edcfb20484b188a3877c9de8b59c4/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:34:24.726140 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a62797-a839-4652-ac02-4b353102c7e3 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:24.726690 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a62797-a839-4652-ac02-4b353102c7e3 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:24.726690 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a62797-a839-4652-ac02-4b353102c7e3 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:24.728068 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 637/1274] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:34:24.733587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc465c-0c3e-4d20-b05e-e6fbe6134582 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:24.734026 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc465c-0c3e-4d20-b05e-e6fbe6134582 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:24.734116 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc465c-0c3e-4d20-b05e-e6fbe6134582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:24.753496 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-f3bc465c-0c3e-4d20-b05e-e6fbe6134582 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:34:24.754690 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f3bc465c-0c3e-4d20-b05e-e6fbe6134582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:34:24.823704 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 638/1275] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:34:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:34:25.092242 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a62797-a839-4652-ac02-4b353102c7e3 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:25.199365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a62797-a839-4652-ac02-4b353102c7e3 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:25.217592 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:25.235205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a26e6-93aa-463a-a28f-85d3c827b40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:25.235848 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a26e6-93aa-463a-a28f-85d3c827b40d None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:25.236144 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a26e6-93aa-463a-a28f-85d3c827b40d None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:25.236406 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a26e6-93aa-463a-a28f-85d3c827b40d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:25.246895 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a26e6-93aa-463a-a28f-85d3c827b40d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 26 05:34:25.251727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-4a3a26e6-93aa-463a-a28f-85d3c827b40d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:34:25.251727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:25.251727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:34:25.251727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:34:25.251727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:34:25.251727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:34:25.251727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:34:25.251727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:34:25.251727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:34:25.251727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:34:25.251727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:34:25.251727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:34:25.251727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 26 05:34:25.251727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 26 05:34:25.251727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 26 05:34:25.251727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 26 05:34:25.252848 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 26 05:34:25.252848 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 26 05:34:25.252848 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 26 05:34:25.252848 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 26 05:34:25.252848 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:34:25.252848 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:34:25.252848 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:34:25.252848 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:34:25.252848 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:34:25.252848 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:34:25.252848 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:34:25.252848 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:34:25.252848 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:34:25.252848 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:34:25.252848 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:34:25.252848 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:34:25.254209 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:34:25.254209 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:34:25.254209 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:34:25.254209 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:34:25.254209 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 26 05:34:25.254209 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 26 05:34:25.254209 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 26 05:34:25.254209 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 26 05:34:25.254209 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 26 05:34:25.254209 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 26 05:34:25.254209 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 26 05:34:25.254209 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:34:25.254209 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 638/1276] 10.222.0.66 () {56 vars in 1096 bytes} [Mon Sep 26 05:34:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:34:25.260086 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc465c-0c3e-4d20-b05e-e6fbe6134582 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:25.352253 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:25.370258 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc465c-0c3e-4d20-b05e-e6fbe6134582 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:25.404078 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c1d7e-c7d6-4daa-8d3b-8f59e80461df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:25.404686 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c1d7e-c7d6-4daa-8d3b-8f59e80461df None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:25.404962 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c1d7e-c7d6-4daa-8d3b-8f59e80461df None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:25.405227 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530c1d7e-c7d6-4daa-8d3b-8f59e80461df None admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:25.405881 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c1d7e-c7d6-4daa-8d3b-8f59e80461df None admin] RBAC: Adding query filter params (name=admin) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:25.406178 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c1d7e-c7d6-4daa-8d3b-8f59e80461df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:25.407668 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530c1d7e-c7d6-4daa-8d3b-8f59e80461df None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:25.416644 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 639/1277] 10.222.0.66 () {56 vars in 1099 bytes} [Mon Sep 26 05:34:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:25.422898 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a26e6-93aa-463a-a28f-85d3c827b40d None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:25.537377 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a26e6-93aa-463a-a28f-85d3c827b40d None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:25.574021 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f031655-98e6-416e-8f53-d88a246e4212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:25.574648 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f031655-98e6-416e-8f53-d88a246e4212 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:25.574917 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f031655-98e6-416e-8f53-d88a246e4212 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:25.575181 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f031655-98e6-416e-8f53-d88a246e4212 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:25.585656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f031655-98e6-416e-8f53-d88a246e4212 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:25.587106 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f031655-98e6-416e-8f53-d88a246e4212 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:25.601905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-7f031655-98e6-416e-8f53-d88a246e4212 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:34:25.601905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:25.601905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:34:25.601905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:34:25.601905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:34:25.601905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:34:25.601905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:34:25.601905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:34:25.601905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:34:25.601905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:34:25.601905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:34:25.601905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:34:25.601905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:34:25.601905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:34:25.601905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:34:25.601905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:34:25.603088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:34:25.603088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:34:25.603088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:34:25.603088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:34:25.603088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:34:25.603088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:34:25.603088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:34:25.603088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:34:25.603088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:34:25.603088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:34:25.603088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:34:25.603088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:34:25.603088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:34:25.603088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:34:25.603088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:34:25.603088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:34:25.603088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:34:25.604230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:34:25.604230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:34:25.604230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:34:25.604230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 639/1278] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:34:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:34:25.609146 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c1d7e-c7d6-4daa-8d3b-8f59e80461df None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:25.717727 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530c1d7e-c7d6-4daa-8d3b-8f59e80461df None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:25.752069 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c79450-80f0-4404-baa6-90acd54c2fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:25.752657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c79450-80f0-4404-baa6-90acd54c2fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:25.752920 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c79450-80f0-4404-baa6-90acd54c2fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:25.753187 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c79450-80f0-4404-baa6-90acd54c2fc4 None admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:25.753806 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c79450-80f0-4404-baa6-90acd54c2fc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:25.754107 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c79450-80f0-4404-baa6-90acd54c2fc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:25.755481 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c79450-80f0-4404-baa6-90acd54c2fc4 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:25.767231 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 640/1279] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:25.773131 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f031655-98e6-416e-8f53-d88a246e4212 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:25.805723 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:25.877279 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f031655-98e6-416e-8f53-d88a246e4212 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:25.911405 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2103e19-b482-4fc3-b617-8d4a444aa895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:25.912051 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2103e19-b482-4fc3-b617-8d4a444aa895 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:25.912328 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2103e19-b482-4fc3-b617-8d4a444aa895 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:25.912589 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2103e19-b482-4fc3-b617-8d4a444aa895 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:25.920178 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2103e19-b482-4fc3-b617-8d4a444aa895 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:25.921595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2103e19-b482-4fc3-b617-8d4a444aa895 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:25.932840 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-d2103e19-b482-4fc3-b617-8d4a444aa895 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 26 05:34:25.932840 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:25.932840 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:34:25.932840 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:34:25.932840 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:34:25.932840 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:34:25.932840 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:34:25.932840 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:34:25.932840 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:34:25.932840 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:34:25.932840 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:34:25.932840 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:34:25.932840 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 26 05:34:25.932840 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 26 05:34:25.932840 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 26 05:34:25.932840 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 26 05:34:25.933934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:34:25.933934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:34:25.933934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 26 05:34:25.933934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:34:25.933934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 26 05:34:25.933934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 26 05:34:25.933934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:34:25.933934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:34:25.933934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:34:25.933934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:34:25.933934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:34:25.933934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:34:25.933934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:34:25.933934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:34:25.933934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:34:25.933934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:34:25.933934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:34:25.933934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:34:25.935277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:34:25.935277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:34:25.935277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 26 05:34:25.935277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 26 05:34:25.935277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 26 05:34:25.935277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 26 05:34:25.935277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 26 05:34:25.935277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 26 05:34:25.935277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 26 05:34:25.935277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:34:25.935277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 640/1280] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:34:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:34:25.940037 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c79450-80f0-4404-baa6-90acd54c2fc4 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:25.944125 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:26.054426 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c79450-80f0-4404-baa6-90acd54c2fc4 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:26.090257 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90491c37-a897-45ee-8eaa-a9b56af4aba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:26.090857 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90491c37-a897-45ee-8eaa-a9b56af4aba1 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:26.091135 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90491c37-a897-45ee-8eaa-a9b56af4aba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:26.091401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90491c37-a897-45ee-8eaa-a9b56af4aba1 None admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:26.092148 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90491c37-a897-45ee-8eaa-a9b56af4aba1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:26.092446 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90491c37-a897-45ee-8eaa-a9b56af4aba1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:26.093900 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90491c37-a897-45ee-8eaa-a9b56af4aba1 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:26.111001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 641/1281] 10.222.0.66 () {56 vars in 1143 bytes} [Mon Sep 26 05:34:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:26.117085 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2103e19-b482-4fc3-b617-8d4a444aa895 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:26.213290 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:26.223576 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2103e19-b482-4fc3-b617-8d4a444aa895 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:26.259235 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65a916-a5c3-4818-bd82-359e6518b8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:26.259832 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65a916-a5c3-4818-bd82-359e6518b8a3 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:26.260066 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65a916-a5c3-4818-bd82-359e6518b8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:26.260309 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65a916-a5c3-4818-bd82-359e6518b8a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:26.331480 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f65a916-a5c3-4818-bd82-359e6518b8a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:26.332962 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f65a916-a5c3-4818-bd82-359e6518b8a3 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:26.423399 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:26.436538 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 641/1282] 10.222.0.66 () {58 vars in 1282 bytes} [Mon Sep 26 05:34:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 26 05:34:26.444997 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90491c37-a897-45ee-8eaa-a9b56af4aba1 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:26.513965 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:26.556373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90491c37-a897-45ee-8eaa-a9b56af4aba1 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:26.593995 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff6014-5634-40f7-8794-ec3917918189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:26.594634 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff6014-5634-40f7-8794-ec3917918189 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:26.594904 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff6014-5634-40f7-8794-ec3917918189 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:26.595167 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff6014-5634-40f7-8794-ec3917918189 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:26.606619 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff6014-5634-40f7-8794-ec3917918189 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:26.608113 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff6014-5634-40f7-8794-ec3917918189 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:26.625842 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-d6ff6014-5634-40f7-8794-ec3917918189 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:34:26.625842 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:26.625842 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:34:26.625842 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:34:26.625842 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:34:26.625842 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:34:26.625842 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:34:26.625842 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:34:26.625842 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:34:26.625842 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:34:26.625842 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:34:26.625842 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:34:26.625842 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 26 05:34:26.625842 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 26 05:34:26.625842 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 26 05:34:26.625842 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 26 05:34:26.627010 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:34:26.627010 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:34:26.627010 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:34:26.627010 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:34:26.627010 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:34:26.627010 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:34:26.627010 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:34:26.627010 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:34:26.627010 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:34:26.627010 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:34:26.627010 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:34:26.627010 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:34:26.627010 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:34:26.627010 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:34:26.627010 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:34:26.627010 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:34:26.627010 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 26 05:34:26.628088 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 26 05:34:26.628088 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 26 05:34:26.628088 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:34:26.628088 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 642/1283] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:34:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:34:26.633471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65a916-a5c3-4818-bd82-359e6518b8a3 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:26.741718 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65a916-a5c3-4818-bd82-359e6518b8a3 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:26.780635 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92936eb-4446-4058-ae05-9c204ef3a1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:26.781318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92936eb-4446-4058-ae05-9c204ef3a1b4 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:26.781411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92936eb-4446-4058-ae05-9c204ef3a1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:26.781653 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92936eb-4446-4058-ae05-9c204ef3a1b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:26.782343 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92936eb-4446-4058-ae05-9c204ef3a1b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:26.782635 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92936eb-4446-4058-ae05-9c204ef3a1b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:26.783998 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92936eb-4446-4058-ae05-9c204ef3a1b4 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:26.801102 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 642/1284] 10.222.0.66 () {56 vars in 1109 bytes} [Mon Sep 26 05:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:26.807385 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff6014-5634-40f7-8794-ec3917918189 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:26.918481 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff6014-5634-40f7-8794-ec3917918189 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:26.934933 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:26.957874 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b807a2-e3c6-49bf-b1a4-0b50f27946aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:26.958830 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b807a2-e3c6-49bf-b1a4-0b50f27946aa None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:26.959290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b807a2-e3c6-49bf-b1a4-0b50f27946aa None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:26.959775 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b807a2-e3c6-49bf-b1a4-0b50f27946aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:26.967199 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b807a2-e3c6-49bf-b1a4-0b50f27946aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:26.968688 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b807a2-e3c6-49bf-b1a4-0b50f27946aa None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:26.980445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application [None req-07b807a2-e3c6-49bf-b1a4-0b50f27946aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:34:26.980445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:26.980445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:34:26.980445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:34:26.980445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:34:26.980445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:34:26.980445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:34:26.980445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:34:26.980445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:34:26.980445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:34:26.980445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:34:26.980445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:34:26.980445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 26 05:34:26.980445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 26 05:34:26.980445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 26 05:34:26.981471 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 26 05:34:26.981471 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:34:26.981471 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:34:26.981471 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:34:26.981471 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:34:26.981471 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:34:26.981471 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:34:26.981471 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:34:26.981471 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application with Lock( Sep 26 05:34:26.981471 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:34:26.981471 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:34:26.981471 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:34:26.981471 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:34:26.981471 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:34:26.981471 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:34:26.981471 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:34:26.981471 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:34:26.982744 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 26 05:34:26.982744 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 26 05:34:26.982744 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 26 05:34:26.982744 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 26 05:34:26.982744 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 26 05:34:26.982744 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 26 05:34:26.982744 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 26 05:34:26.982744 dv-cinder-836083-14-smb devstack@keystone.service[81683]: ERROR keystone.server.flask.application Sep 26 05:34:26.982744 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 643/1285] 10.222.0.66 () {56 vars in 1111 bytes} [Mon Sep 26 05:34:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:34:26.989934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92936eb-4446-4058-ae05-9c204ef3a1b4 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:27.050816 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:27.102537 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92936eb-4446-4058-ae05-9c204ef3a1b4 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:27.163364 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94d3271-caf5-4ea9-b72a-aaa2a0d91788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:27.164217 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d3271-caf5-4ea9-b72a-aaa2a0d91788 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:27.167146 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d3271-caf5-4ea9-b72a-aaa2a0d91788 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:27.167496 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94d3271-caf5-4ea9-b72a-aaa2a0d91788 None admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:27.168641 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d3271-caf5-4ea9-b72a-aaa2a0d91788 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:27.169025 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d3271-caf5-4ea9-b72a-aaa2a0d91788 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:27.173342 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94d3271-caf5-4ea9-b72a-aaa2a0d91788 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:27.188488 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 643/1286] 10.222.0.66 () {56 vars in 1148 bytes} [Mon Sep 26 05:34:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:27.196281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b807a2-e3c6-49bf-b1a4-0b50f27946aa None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:27.312533 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b807a2-e3c6-49bf-b1a4-0b50f27946aa None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:27.349687 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33df45-881a-464e-81de-73b9aeb27c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:27.350282 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33df45-881a-464e-81de-73b9aeb27c19 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:27.350551 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33df45-881a-464e-81de-73b9aeb27c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:27.350824 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33df45-881a-464e-81de-73b9aeb27c19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:27.351536 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab33df45-881a-464e-81de-73b9aeb27c19 None admin] RBAC: Adding query filter params (role.id=cf58d66369044fb09fa65a4366dc7446, scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8, user.id=895edcfb20484b188a3877c9de8b59c4) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:27.351859 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab33df45-881a-464e-81de-73b9aeb27c19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:27.353290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab33df45-881a-464e-81de-73b9aeb27c19 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:27.359195 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 644/1287] 10.222.0.66 () {56 vars in 1374 bytes} [Mon Sep 26 05:34:27 2022] GET /identity/v3/role_assignments?user.id=895edcfb20484b188a3877c9de8b59c4&scope.project.id=953bb95b0ba84d4f99a73afb426bb8c8&role.id=cf58d66369044fb09fa65a4366dc7446 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:29.536508 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85feae4-e068-4bc0-8d64-5d1051842e2f None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:29.537135 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85feae4-e068-4bc0-8d64-5d1051842e2f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:29.537135 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85feae4-e068-4bc0-8d64-5d1051842e2f None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:29.538357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 644/1288] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:34:29.544244 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6a328-c4ee-462a-aee1-084c17f84eea None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:29.544740 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6a328-c4ee-462a-aee1-084c17f84eea None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:29.544740 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa6a328-c4ee-462a-aee1-084c17f84eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:29.564468 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-8aa6a328-c4ee-462a-aee1-084c17f84eea None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:34:29.565690 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8aa6a328-c4ee-462a-aee1-084c17f84eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:34:29.597816 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:29.638709 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 645/1289] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:34:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:34:29.901002 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85feae4-e068-4bc0-8d64-5d1051842e2f None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:30.009162 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85feae4-e068-4bc0-8d64-5d1051842e2f None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:30.020798 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:30.045510 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dd53b-a238-487d-a0a7-5449b51baf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:30.046142 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dd53b-a238-487d-a0a7-5449b51baf95 None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:30.046414 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dd53b-a238-487d-a0a7-5449b51baf95 None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:30.046676 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181dd53b-a238-487d-a0a7-5449b51baf95 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:30.047692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181dd53b-a238-487d-a0a7-5449b51baf95 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:30.049080 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181dd53b-a238-487d-a0a7-5449b51baf95 None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:30.058067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-181dd53b-a238-487d-a0a7-5449b51baf95 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 05:34:30.058067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:30.058067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:34:30.058067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:34:30.058067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:34:30.058067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:34:30.058067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:34:30.058067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:34:30.058067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 05:34:30.058067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:34:30.058067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:34:30.058067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:34:30.058067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:30.058067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:34:30.058067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:34:30.058067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:34:30.058067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:34:30.064230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:34:30.064230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:34:30.064230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:34:30.064230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:34:30.064230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:34:30.064230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:34:30.064230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:34:30.064230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:34:30.064230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:34:30.064230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:34:30.064230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:34:30.064230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:34:30.064230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:34:30.064230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:34:30.064230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:34:30.064230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:34:30.065282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:34:30.065282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:34:30.065282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:34:30.065282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:34:30.065282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:34:30.065282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:34:30.065282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:34:30.065282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:34:30.065282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:34:30.065282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:34:30.065282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:34:30.065282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:34:30.065282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 05:34:30.065282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:34:30.065282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 645/1290] 10.222.0.66 () {56 vars in 1117 bytes} [Mon Sep 26 05:34:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:34:30.066868 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6a328-c4ee-462a-aee1-084c17f84eea None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:30.189610 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa6a328-c4ee-462a-aee1-084c17f84eea None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:30.226233 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a837835-d4a6-4f3c-9f36-cbb97aa86196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:30.226837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a837835-d4a6-4f3c-9f36-cbb97aa86196 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:30.227111 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a837835-d4a6-4f3c-9f36-cbb97aa86196 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:30.227379 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a837835-d4a6-4f3c-9f36-cbb97aa86196 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:30.228031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a837835-d4a6-4f3c-9f36-cbb97aa86196 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:30.228326 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a837835-d4a6-4f3c-9f36-cbb97aa86196 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:30.229718 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a837835-d4a6-4f3c-9f36-cbb97aa86196 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:30.234830 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 646/1291] 10.222.0.66 () {56 vars in 1116 bytes} [Mon Sep 26 05:34:30 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:30.241054 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dd53b-a238-487d-a0a7-5449b51baf95 None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:30.370194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181dd53b-a238-487d-a0a7-5449b51baf95 None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:30.408026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb5cdd-c93f-4c17-bf1b-34c25a72840b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:30.408647 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb5cdd-c93f-4c17-bf1b-34c25a72840b None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:30.408898 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb5cdd-c93f-4c17-bf1b-34c25a72840b None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:30.409187 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb5cdd-c93f-4c17-bf1b-34c25a72840b None admin] PATH_INFO: `/v3/services` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:30.409946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb5cdd-c93f-4c17-bf1b-34c25a72840b None admin] RBAC: Adding query filter params (type=placement) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:30.410197 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb5cdd-c93f-4c17-bf1b-34c25a72840b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:30.411612 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb5cdd-c93f-4c17-bf1b-34c25a72840b None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:30.417018 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 646/1292] 10.222.0.66 () {56 vars in 1116 bytes} [Mon Sep 26 05:34:30 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:32.829820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e206b-8384-4af9-a4dd-87d452a8321a None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:32.830436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e206b-8384-4af9-a4dd-87d452a8321a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:32.830436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e206b-8384-4af9-a4dd-87d452a8321a None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:32.831694 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 647/1293] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:34:32.839446 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff646aa3-bd99-42f3-9e66-dd5bb7dd3be1 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:32.840099 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff646aa3-bd99-42f3-9e66-dd5bb7dd3be1 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:32.840099 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff646aa3-bd99-42f3-9e66-dd5bb7dd3be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:32.859664 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-ff646aa3-bd99-42f3-9e66-dd5bb7dd3be1 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:34:32.860898 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ff646aa3-bd99-42f3-9e66-dd5bb7dd3be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:34:32.892057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:32.940212 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 647/1294] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:34:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:34:33.254159 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e206b-8384-4af9-a4dd-87d452a8321a None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:33.295388 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:33.381878 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e206b-8384-4af9-a4dd-87d452a8321a None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:33.424763 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0078448-af25-4572-82cb-8e32a0cf6cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:33.425472 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0078448-af25-4572-82cb-8e32a0cf6cb0 None admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:33.425790 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0078448-af25-4572-82cb-8e32a0cf6cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:33.426264 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0078448-af25-4572-82cb-8e32a0cf6cb0 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:33.427186 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0078448-af25-4572-82cb-8e32a0cf6cb0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:33.429091 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0078448-af25-4572-82cb-8e32a0cf6cb0 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:33.447414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 648/1295] 10.222.0.66 () {60 vars in 1141 bytes} [Mon Sep 26 05:34:33 2022] POST /identity/v3/services => generated 246 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:34:35.880268 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e76954-3b94-4dac-af9d-5b8c9f5584b3 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:35.880871 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e76954-3b94-4dac-af9d-5b8c9f5584b3 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:35.880871 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e76954-3b94-4dac-af9d-5b8c9f5584b3 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:35.882353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 648/1296] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:34:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:34:35.895838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b54ea8-b656-447d-bdf2-6b67b69e8d52 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:35.896470 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b54ea8-b656-447d-bdf2-6b67b69e8d52 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:35.896470 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b54ea8-b656-447d-bdf2-6b67b69e8d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:35.929347 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-69b54ea8-b656-447d-bdf2-6b67b69e8d52 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:34:35.930908 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-69b54ea8-b656-447d-bdf2-6b67b69e8d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:34:36.023152 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 649/1297] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:34:35 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:34:36.334058 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e76954-3b94-4dac-af9d-5b8c9f5584b3 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:36.454776 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e76954-3b94-4dac-af9d-5b8c9f5584b3 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:36.491995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79a7ad-fde8-4bf4-80fc-beeb15f6419c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:36.492721 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79a7ad-fde8-4bf4-80fc-beeb15f6419c None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:36.493091 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79a7ad-fde8-4bf4-80fc-beeb15f6419c None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:36.493383 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79a7ad-fde8-4bf4-80fc-beeb15f6419c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:36.494146 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79a7ad-fde8-4bf4-80fc-beeb15f6419c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:36.495695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79a7ad-fde8-4bf4-80fc-beeb15f6419c None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:36.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-5d79a7ad-fde8-4bf4-80fc-beeb15f6419c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 05:34:36.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:36.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:34:36.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:34:36.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:34:36.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:34:36.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:34:36.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:34:36.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 05:34:36.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:34:36.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:34:36.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:34:36.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:36.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:34:36.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:34:36.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:34:36.505995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:34:36.507331 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:34:36.507331 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:34:36.507331 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:34:36.507331 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:34:36.507331 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:34:36.507331 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:34:36.507331 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:34:36.507331 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:34:36.507331 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:34:36.507331 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:34:36.507331 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:34:36.507331 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:34:36.507331 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:34:36.507331 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:34:36.507331 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:34:36.507331 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:34:36.508419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:34:36.508419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:34:36.508419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:34:36.508419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:34:36.508419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:34:36.508419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:34:36.508419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:34:36.508419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:34:36.508419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:34:36.508419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:34:36.508419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:34:36.508419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:34:36.508419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 05:34:36.508419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:34:36.508419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 649/1298] 10.222.0.66 () {56 vars in 1117 bytes} [Mon Sep 26 05:34:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:34:36.513824 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b54ea8-b656-447d-bdf2-6b67b69e8d52 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:36.533006 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:36.636132 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b54ea8-b656-447d-bdf2-6b67b69e8d52 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:36.676861 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c97f3d-9051-4af4-95f7-b92a3ce22624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:36.677524 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c97f3d-9051-4af4-95f7-b92a3ce22624 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:36.677830 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c97f3d-9051-4af4-95f7-b92a3ce22624 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:36.678166 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c97f3d-9051-4af4-95f7-b92a3ce22624 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:36.678863 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c97f3d-9051-4af4-95f7-b92a3ce22624 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:36.679163 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c97f3d-9051-4af4-95f7-b92a3ce22624 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:36.680744 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c97f3d-9051-4af4-95f7-b92a3ce22624 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:36.688153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 650/1299] 10.222.0.66 () {56 vars in 1116 bytes} [Mon Sep 26 05:34:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:36.696441 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79a7ad-fde8-4bf4-80fc-beeb15f6419c None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:36.748715 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:36.832864 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79a7ad-fde8-4bf4-80fc-beeb15f6419c None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:36.871407 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96f2d1-e992-4d6d-affb-74cd6840375a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:36.872124 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96f2d1-e992-4d6d-affb-74cd6840375a None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:36.872437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96f2d1-e992-4d6d-affb-74cd6840375a None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:36.872721 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96f2d1-e992-4d6d-affb-74cd6840375a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:36.873554 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96f2d1-e992-4d6d-affb-74cd6840375a None admin] RBAC: Adding query filter params (interface=public, service_id=4cd14f411cd44935b539c2fc103c18b3, region_id=RegionOne) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:36.873887 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96f2d1-e992-4d6d-affb-74cd6840375a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:36.875466 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96f2d1-e992-4d6d-affb-74cd6840375a None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:36.881941 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 650/1300] 10.222.0.66 () {56 vars in 1251 bytes} [Mon Sep 26 05:34:36 2022] GET /identity/v3/endpoints?service_id=4cd14f411cd44935b539c2fc103c18b3&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:36.888650 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c97f3d-9051-4af4-95f7-b92a3ce22624 None admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:36.988328 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:37.007281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c97f3d-9051-4af4-95f7-b92a3ce22624 None admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:37.051032 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdec4de-e7a4-48c4-aef2-1c241f922670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:37.059963 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdec4de-e7a4-48c4-aef2-1c241f922670 None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:37.060229 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdec4de-e7a4-48c4-aef2-1c241f922670 None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:37.060517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdec4de-e7a4-48c4-aef2-1c241f922670 None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:37.061116 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdec4de-e7a4-48c4-aef2-1c241f922670 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:37.062532 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdec4de-e7a4-48c4-aef2-1c241f922670 None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:37.070997 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 651/1301] 10.222.0.66 () {56 vars in 1087 bytes} [Mon Sep 26 05:34:36 2022] GET /identity/v3/services => generated 2191 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:34:39.229932 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893cb5f-2e42-4237-9675-ae6fcd3c532f None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:39.230580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893cb5f-2e42-4237-9675-ae6fcd3c532f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:39.230580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893cb5f-2e42-4237-9675-ae6fcd3c532f None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:39.231861 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 651/1302] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:34:39.237482 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4f3cd-b95e-4cdf-9d56-37b6ba24676f None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:39.238095 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4f3cd-b95e-4cdf-9d56-37b6ba24676f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:39.238095 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4f3cd-b95e-4cdf-9d56-37b6ba24676f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:39.259607 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-83e4f3cd-b95e-4cdf-9d56-37b6ba24676f None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:34:39.261201 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-83e4f3cd-b95e-4cdf-9d56-37b6ba24676f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:34:39.341520 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 652/1303] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:34:39 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 26 05:34:39.619617 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893cb5f-2e42-4237-9675-ae6fcd3c532f None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:39.748082 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:39.755776 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893cb5f-2e42-4237-9675-ae6fcd3c532f None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:39.800457 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a9239-dc15-4179-bf3c-733e384a5cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:39.801121 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a9239-dc15-4179-bf3c-733e384a5cde None admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:39.801391 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a9239-dc15-4179-bf3c-733e384a5cde None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:39.801664 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a9239-dc15-4179-bf3c-733e384a5cde None admin] PATH_INFO: `/v3/services/placement` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:39.802252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a9239-dc15-4179-bf3c-733e384a5cde None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:39.803626 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a9239-dc15-4179-bf3c-733e384a5cde None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:39.813568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application [None req-772a9239-dc15-4179-bf3c-733e384a5cde None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 05:34:39.813568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:39.813568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 26 05:34:39.813568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 26 05:34:39.813568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 26 05:34:39.813568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 26 05:34:39.813568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 26 05:34:39.813568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:34:39.813568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 05:34:39.813568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:34:39.813568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 26 05:34:39.813568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:34:39.813568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 26 05:34:39.813568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 26 05:34:39.813568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 26 05:34:39.813568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 26 05:34:39.813568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 26 05:34:39.816042 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 26 05:34:39.816042 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 26 05:34:39.816042 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 26 05:34:39.816042 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 26 05:34:39.816042 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 26 05:34:39.816042 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 26 05:34:39.816042 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 26 05:34:39.816042 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 26 05:34:39.816042 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 26 05:34:39.816042 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 26 05:34:39.816042 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 26 05:34:39.816042 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 26 05:34:39.816042 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 26 05:34:39.816042 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 26 05:34:39.816042 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 26 05:34:39.816042 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.get_or_create( Sep 26 05:34:39.817718 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 26 05:34:39.817718 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application with Lock( Sep 26 05:34:39.817718 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 26 05:34:39.817718 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self._enter() Sep 26 05:34:39.817718 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 26 05:34:39.817718 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 26 05:34:39.817718 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 26 05:34:39.817718 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application return self.creator() Sep 26 05:34:39.817718 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 26 05:34:39.817718 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application created_value = creator( Sep 26 05:34:39.817718 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 26 05:34:39.817718 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 26 05:34:39.817718 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 26 05:34:39.817718 dv-cinder-836083-14-smb devstack@keystone.service[81682]: ERROR keystone.server.flask.application Sep 26 05:34:39.817718 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 652/1304] 10.222.0.66 () {56 vars in 1117 bytes} [Mon Sep 26 05:34:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 26 05:34:39.821452 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4f3cd-b95e-4cdf-9d56-37b6ba24676f None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:39.901438 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:39.925888 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4f3cd-b95e-4cdf-9d56-37b6ba24676f None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:39.962325 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bd1c1-f488-4750-a157-ad1ea730de8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:39.962937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bd1c1-f488-4750-a157-ad1ea730de8f None admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:39.963211 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bd1c1-f488-4750-a157-ad1ea730de8f None admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:39.963474 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bd1c1-f488-4750-a157-ad1ea730de8f None admin] PATH_INFO: `/v3/services` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:39.964133 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bd1c1-f488-4750-a157-ad1ea730de8f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:34:39.964429 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bd1c1-f488-4750-a157-ad1ea730de8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:39.965821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bd1c1-f488-4750-a157-ad1ea730de8f None admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:39.971611 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 653/1305] 10.222.0.66 () {56 vars in 1116 bytes} [Mon Sep 26 05:34:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:34:39.977554 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a9239-dc15-4179-bf3c-733e384a5cde None admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:34:40.090373 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a9239-dc15-4179-bf3c-733e384a5cde None admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:34:40.135312 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed499338-a492-42f2-99bb-59911f88e9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:34:40.135952 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed499338-a492-42f2-99bb-59911f88e9cb None admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:34:40.136228 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed499338-a492-42f2-99bb-59911f88e9cb None admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:34:40.136493 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed499338-a492-42f2-99bb-59911f88e9cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:34:40.137158 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed499338-a492-42f2-99bb-59911f88e9cb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:34:40.138509 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed499338-a492-42f2-99bb-59911f88e9cb None admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:34:40.166511 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 653/1306] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:34:39 2022] POST /identity/v3/endpoints => generated 331 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:34:49.969331 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=30 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:34:50.156507 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:35:47.184503 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc52d7-f62c-4a1f-b71a-083c1a62b5ea None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:35:47.185131 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc52d7-f62c-4a1f-b71a-083c1a62b5ea None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:35:47.185386 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc52d7-f62c-4a1f-b71a-083c1a62b5ea None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:35:47.187933 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 654/1307] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:35:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:35:47.197196 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbba171-ee50-42b2-a854-0a84c41e338f None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:35:47.197776 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbba171-ee50-42b2-a854-0a84c41e338f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:35:47.198152 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbba171-ee50-42b2-a854-0a84c41e338f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:35:47.350724 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-7bbba171-ee50-42b2-a854-0a84c41e338f None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:35:47.352798 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-7bbba171-ee50-42b2-a854-0a84c41e338f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:35:47.532050 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 654/1308] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:35:47.823017 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3cd9f-66f9-4097-8d9b-28ed266e0016 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:35:47.823356 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3cd9f-66f9-4097-8d9b-28ed266e0016 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:35:47.823559 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3cd9f-66f9-4097-8d9b-28ed266e0016 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:35:47.825416 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 655/1309] 10.222.0.66 () {54 vars in 964 bytes} [Mon Sep 26 05:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:35:47.831924 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e28a3-3dc6-496a-83d4-1b4617aedce1 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:35:47.832498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e28a3-3dc6-496a-83d4-1b4617aedce1 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:35:47.832768 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e28a3-3dc6-496a-83d4-1b4617aedce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:35:47.945664 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-7c5e28a3-3dc6-496a-83d4-1b4617aedce1 None None] MFA Rules not processed for user `26b3d51ac6ca41cf9e535e751ac94675`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:35:47.946905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-7c5e28a3-3dc6-496a-83d4-1b4617aedce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:35:47.972290 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:35:48.047410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 655/1310] 10.222.0.66 () {58 vars in 1061 bytes} [Mon Sep 26 05:35:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:35:48.058424 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3cd9f-66f9-4097-8d9b-28ed266e0016 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:35:48.060524 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-65c3cd9f-66f9-4097-8d9b-28ed266e0016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:35:48.255638 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3cd9f-66f9-4097-8d9b-28ed266e0016 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:35:48.366428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4315c-773f-4d93-bda5-fe561e95171e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:35:48.367092 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4315c-773f-4d93-bda5-fe561e95171e service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:35:48.367395 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4315c-773f-4d93-bda5-fe561e95171e service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:35:48.367666 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4315c-773f-4d93-bda5-fe561e95171e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:35:48.370235 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-acb4315c-773f-4d93-bda5-fe561e95171e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:35:48.492287 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:35:48.580892 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4315c-773f-4d93-bda5-fe561e95171e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:35:48.582399 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4315c-773f-4d93-bda5-fe561e95171e service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:35:48.607791 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 656/1311] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:35:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:35:51.144284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08030772-d34c-4a82-9ef1-b952fec1d54f None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:35:51.144916 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08030772-d34c-4a82-9ef1-b952fec1d54f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:35:51.144916 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08030772-d34c-4a82-9ef1-b952fec1d54f None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:35:51.146181 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 656/1312] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:35:51.151872 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b5517-b7e4-4618-9259-17671b62a9de None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:35:51.152349 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b5517-b7e4-4618-9259-17671b62a9de None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:35:51.152462 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b5517-b7e4-4618-9259-17671b62a9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:35:51.230349 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-268b5517-b7e4-4618-9259-17671b62a9de None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:35:51.231784 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-268b5517-b7e4-4618-9259-17671b62a9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:35:51.341019 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 657/1313] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:35:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:35:51.625934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08030772-d34c-4a82-9ef1-b952fec1d54f None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:35:51.627513 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-08030772-d34c-4a82-9ef1-b952fec1d54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:35:51.743505 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08030772-d34c-4a82-9ef1-b952fec1d54f None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:35:51.822179 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:35:51.826705 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f051557-a9db-40e3-83ff-7aafb315b163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:35:51.827663 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f051557-a9db-40e3-83ff-7aafb315b163 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:35:51.828058 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f051557-a9db-40e3-83ff-7aafb315b163 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:35:51.828434 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f051557-a9db-40e3-83ff-7aafb315b163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:35:51.830635 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5f051557-a9db-40e3-83ff-7aafb315b163 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:35:51.951772 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f051557-a9db-40e3-83ff-7aafb315b163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:35:51.953243 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f051557-a9db-40e3-83ff-7aafb315b163 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:35:51.973121 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 657/1314] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:35:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:35:54.488758 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116b189-73b1-4fcc-9e35-ba19028156d3 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:35:54.489323 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116b189-73b1-4fcc-9e35-ba19028156d3 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:35:54.489323 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116b189-73b1-4fcc-9e35-ba19028156d3 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:35:54.490633 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 658/1315] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:35:54.496610 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416eea7-f179-49ed-b215-d1aec78e509b None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:35:54.497060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416eea7-f179-49ed-b215-d1aec78e509b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:35:54.497156 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f416eea7-f179-49ed-b215-d1aec78e509b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:35:54.576877 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-f416eea7-f179-49ed-b215-d1aec78e509b None None] MFA Rules not processed for user `79a88eb97e944d76b6e903c71c5cf94c`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:35:54.578061 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f416eea7-f179-49ed-b215-d1aec78e509b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:35:54.633324 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:35:54.684417 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 658/1316] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:35:54 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:35:54.973702 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116b189-73b1-4fcc-9e35-ba19028156d3 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:35:54.975269 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6116b189-73b1-4fcc-9e35-ba19028156d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:35:54.985938 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:35:55.094815 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116b189-73b1-4fcc-9e35-ba19028156d3 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:35:55.177871 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6081a707-abd7-47b7-a658-340378feab5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:35:55.178486 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081a707-abd7-47b7-a658-340378feab5d service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:35:55.178760 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081a707-abd7-47b7-a658-340378feab5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:35:55.179025 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6081a707-abd7-47b7-a658-340378feab5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:35:55.180705 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6081a707-abd7-47b7-a658-340378feab5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:35:55.251424 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:35:55.308733 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081a707-abd7-47b7-a658-340378feab5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:35:55.310220 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6081a707-abd7-47b7-a658-340378feab5d service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:35:55.331823 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 659/1317] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:35:54 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:35:58.100384 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998838d-2af1-4af8-801c-e4f8900c2b1f None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:35:58.100945 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998838d-2af1-4af8-801c-e4f8900c2b1f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:35:58.100945 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998838d-2af1-4af8-801c-e4f8900c2b1f None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:35:58.102165 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 659/1318] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:35:58.107903 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9d7f2-4c33-4f30-ae4d-724bba2507b3 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:35:58.108362 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9d7f2-4c33-4f30-ae4d-724bba2507b3 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:35:58.108472 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9d7f2-4c33-4f30-ae4d-724bba2507b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:35:58.196032 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-1fc9d7f2-4c33-4f30-ae4d-724bba2507b3 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:35:58.197295 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1fc9d7f2-4c33-4f30-ae4d-724bba2507b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:35:58.312222 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 660/1319] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:35:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:35:58.609974 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998838d-2af1-4af8-801c-e4f8900c2b1f None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:35:58.611523 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1998838d-2af1-4af8-801c-e4f8900c2b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:35:58.725685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998838d-2af1-4af8-801c-e4f8900c2b1f None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:35:58.815885 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1f1df-819b-409d-a899-bdf92b5026ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:35:58.816866 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1f1df-819b-409d-a899-bdf92b5026ec service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:35:58.817151 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1f1df-819b-409d-a899-bdf92b5026ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:35:58.817409 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1f1df-819b-409d-a899-bdf92b5026ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:35:58.819015 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2ce1f1df-819b-409d-a899-bdf92b5026ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:35:58.826877 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:35:58.938420 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1f1df-819b-409d-a899-bdf92b5026ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:35:58.939887 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1f1df-819b-409d-a899-bdf92b5026ec service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:35:58.959275 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 660/1320] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:35:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:36:01.809409 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764e6e3-d10b-4a71-ab7f-46e2536d733f None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:01.810116 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764e6e3-d10b-4a71-ab7f-46e2536d733f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:01.810116 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764e6e3-d10b-4a71-ab7f-46e2536d733f None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:01.811327 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 661/1321] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:36:01.817600 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fc1d2-de2e-4e8c-99b1-743aa85a2f1c None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:01.818105 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fc1d2-de2e-4e8c-99b1-743aa85a2f1c None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:01.818289 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fc1d2-de2e-4e8c-99b1-743aa85a2f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:01.895380 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-1a6fc1d2-de2e-4e8c-99b1-743aa85a2f1c None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:01.896677 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1a6fc1d2-de2e-4e8c-99b1-743aa85a2f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:01.963203 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:02.007239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 661/1322] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:36:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:02.281540 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764e6e3-d10b-4a71-ab7f-46e2536d733f None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:02.283091 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b764e6e3-d10b-4a71-ab7f-46e2536d733f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:02.303806 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:02.396437 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764e6e3-d10b-4a71-ab7f-46e2536d733f None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:02.480380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e468d-7563-4c35-9e8d-ee214ebb293c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:02.481000 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e468d-7563-4c35-9e8d-ee214ebb293c service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:02.481312 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e468d-7563-4c35-9e8d-ee214ebb293c service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:02.481538 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e468d-7563-4c35-9e8d-ee214ebb293c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:02.483947 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f23e468d-7563-4c35-9e8d-ee214ebb293c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:02.580156 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:02.626343 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e468d-7563-4c35-9e8d-ee214ebb293c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:02.628921 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e468d-7563-4c35-9e8d-ee214ebb293c service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:02.649976 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 662/1323] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:36:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:36:04.889441 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f05069-5e3e-4ec0-91f4-dfc10aa27a37 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:04.890014 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f05069-5e3e-4ec0-91f4-dfc10aa27a37 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:04.890014 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f05069-5e3e-4ec0-91f4-dfc10aa27a37 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:04.891332 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 662/1324] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:36:04.896941 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ca322-dd88-41a9-9eda-985e4ea666dd None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:04.897471 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ca322-dd88-41a9-9eda-985e4ea666dd None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:04.897471 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ca322-dd88-41a9-9eda-985e4ea666dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:04.984966 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-642ca322-dd88-41a9-9eda-985e4ea666dd None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:04.986651 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-642ca322-dd88-41a9-9eda-985e4ea666dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:05.101280 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 663/1325] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:36:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:05.391174 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6757aa-cab5-4f66-8ae0-8897be4e3dac None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:05.391452 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6757aa-cab5-4f66-8ae0-8897be4e3dac None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:05.391719 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6757aa-cab5-4f66-8ae0-8897be4e3dac None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:05.393125 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 663/1326] 10.222.0.66 () {54 vars in 964 bytes} [Mon Sep 26 05:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:36:05.399078 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e3b9a-84c1-496d-a165-3d12b771ee28 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:05.399362 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e3b9a-84c1-496d-a165-3d12b771ee28 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:05.399638 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e3b9a-84c1-496d-a165-3d12b771ee28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:05.433882 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:05.481608 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-761e3b9a-84c1-496d-a165-3d12b771ee28 None None] MFA Rules not processed for user `26b3d51ac6ca41cf9e535e751ac94675`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:05.482857 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-761e3b9a-84c1-496d-a165-3d12b771ee28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:05.570241 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 664/1327] 10.222.0.66 () {58 vars in 1061 bytes} [Mon Sep 26 05:36:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:05.580474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6757aa-cab5-4f66-8ae0-8897be4e3dac None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:05.582058 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-df6757aa-cab5-4f66-8ae0-8897be4e3dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:05.695309 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6757aa-cab5-4f66-8ae0-8897be4e3dac None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:05.779077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dde11bb-47b5-45a9-9ab3-0478762a5398 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:05.779077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde11bb-47b5-45a9-9ab3-0478762a5398 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:05.779077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde11bb-47b5-45a9-9ab3-0478762a5398 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:05.779077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dde11bb-47b5-45a9-9ab3-0478762a5398 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:05.779873 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2dde11bb-47b5-45a9-9ab3-0478762a5398 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:05.799240 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:05.899622 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde11bb-47b5-45a9-9ab3-0478762a5398 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:05.901274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dde11bb-47b5-45a9-9ab3-0478762a5398 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:05.921834 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 664/1328] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:36:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:36:08.399056 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6ac06-99b7-459e-9b91-2f309d7eb1c1 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:08.399653 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6ac06-99b7-459e-9b91-2f309d7eb1c1 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:08.399653 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6ac06-99b7-459e-9b91-2f309d7eb1c1 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:08.401004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 665/1329] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:36:08.406872 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b84a2-fbd5-4b71-83b3-acc2a08d0053 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:08.407420 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b84a2-fbd5-4b71-83b3-acc2a08d0053 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:08.407420 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b84a2-fbd5-4b71-83b3-acc2a08d0053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:08.486428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-b37b84a2-fbd5-4b71-83b3-acc2a08d0053 None None] MFA Rules not processed for user `79a88eb97e944d76b6e903c71c5cf94c`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:08.488611 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b37b84a2-fbd5-4b71-83b3-acc2a08d0053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:08.570577 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:08.614636 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 665/1330] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:36:08 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:08.918902 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6ac06-99b7-459e-9b91-2f309d7eb1c1 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:08.920558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9fc6ac06-99b7-459e-9b91-2f309d7eb1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:09.039489 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6ac06-99b7-459e-9b91-2f309d7eb1c1 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:09.063541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:09.126848 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed15f57-efc8-4689-a1f8-c80e7d504db0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:09.127470 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed15f57-efc8-4689-a1f8-c80e7d504db0 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:09.127753 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed15f57-efc8-4689-a1f8-c80e7d504db0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:09.128029 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed15f57-efc8-4689-a1f8-c80e7d504db0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:09.129706 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2ed15f57-efc8-4689-a1f8-c80e7d504db0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:09.281040 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed15f57-efc8-4689-a1f8-c80e7d504db0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:09.282435 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed15f57-efc8-4689-a1f8-c80e7d504db0 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:09.303022 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 666/1331] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:36:08 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:36:11.971520 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6bf3a-909d-437c-8fa0-9527b820694c None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:11.972090 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6bf3a-909d-437c-8fa0-9527b820694c None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:11.972090 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6bf3a-909d-437c-8fa0-9527b820694c None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:11.973370 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 666/1332] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:36:11.979069 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999d84f-ce3d-4719-b415-3cf0e8125b11 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:11.979472 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999d84f-ce3d-4719-b415-3cf0e8125b11 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:11.979672 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999d84f-ce3d-4719-b415-3cf0e8125b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:12.047843 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:12.051625 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-5999d84f-ce3d-4719-b415-3cf0e8125b11 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:12.053472 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5999d84f-ce3d-4719-b415-3cf0e8125b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:12.157712 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 667/1333] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:36:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:12.433558 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6bf3a-909d-437c-8fa0-9527b820694c None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:12.435096 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d7a6bf3a-909d-437c-8fa0-9527b820694c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:12.551041 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6bf3a-909d-437c-8fa0-9527b820694c None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:12.629378 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52fd16-c3b7-4f5b-88ed-d3ba945347e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:12.629994 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52fd16-c3b7-4f5b-88ed-d3ba945347e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:12.630364 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52fd16-c3b7-4f5b-88ed-d3ba945347e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:12.630548 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52fd16-c3b7-4f5b-88ed-d3ba945347e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:12.632202 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2a52fd16-c3b7-4f5b-88ed-d3ba945347e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:12.660790 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:12.748281 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52fd16-c3b7-4f5b-88ed-d3ba945347e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:12.749712 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52fd16-c3b7-4f5b-88ed-d3ba945347e2 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:12.768974 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 667/1334] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:36:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:36:15.017071 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4ceea-8700-4c21-8400-999e671b6760 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:15.017657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4ceea-8700-4c21-8400-999e671b6760 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:15.017657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4ceea-8700-4c21-8400-999e671b6760 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:15.018966 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 668/1335] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:36:15.024966 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d9a10-0077-4401-a010-d85992968de1 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:15.025537 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d9a10-0077-4401-a010-d85992968de1 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:15.025537 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d9a10-0077-4401-a010-d85992968de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:15.102661 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-f62d9a10-0077-4401-a010-d85992968de1 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:15.104070 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f62d9a10-0077-4401-a010-d85992968de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:15.185666 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:15.210829 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 668/1336] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:36:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:15.491825 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4ceea-8700-4c21-8400-999e671b6760 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:15.493357 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9da4ceea-8700-4c21-8400-999e671b6760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:15.611912 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4ceea-8700-4c21-8400-999e671b6760 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:15.647558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:15.701779 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f34d0b-6adb-4dcd-aecb-df553ac45931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:15.702370 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f34d0b-6adb-4dcd-aecb-df553ac45931 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:15.702644 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f34d0b-6adb-4dcd-aecb-df553ac45931 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:15.702914 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f34d0b-6adb-4dcd-aecb-df553ac45931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:15.704889 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-99f34d0b-6adb-4dcd-aecb-df553ac45931 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:15.839197 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f34d0b-6adb-4dcd-aecb-df553ac45931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:15.840624 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f34d0b-6adb-4dcd-aecb-df553ac45931 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:15.861831 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 669/1337] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:36:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:36:18.428461 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704438c-c969-4488-8f50-1a85d582ca79 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:18.429147 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704438c-c969-4488-8f50-1a85d582ca79 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:18.429147 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704438c-c969-4488-8f50-1a85d582ca79 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:18.430344 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 669/1338] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:36:18.436292 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84834742-deac-4bde-b61f-591d9fa7849f None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:18.436967 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84834742-deac-4bde-b61f-591d9fa7849f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:18.436967 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84834742-deac-4bde-b61f-591d9fa7849f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:18.517866 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-84834742-deac-4bde-b61f-591d9fa7849f None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:18.519099 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-84834742-deac-4bde-b61f-591d9fa7849f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:18.528668 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:18.634545 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 670/1339] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:36:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:18.917035 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704438c-c969-4488-8f50-1a85d582ca79 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:18.919937 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-3704438c-c969-4488-8f50-1a85d582ca79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:19.041889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704438c-c969-4488-8f50-1a85d582ca79 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:19.121253 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91071188-1ce1-4547-b2bc-9adf3c7ad023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:19.121872 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91071188-1ce1-4547-b2bc-9adf3c7ad023 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:19.122131 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91071188-1ce1-4547-b2bc-9adf3c7ad023 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:19.122371 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91071188-1ce1-4547-b2bc-9adf3c7ad023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:19.123973 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-91071188-1ce1-4547-b2bc-9adf3c7ad023 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:19.159663 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:19.237538 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91071188-1ce1-4547-b2bc-9adf3c7ad023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:19.238961 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91071188-1ce1-4547-b2bc-9adf3c7ad023 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:19.258563 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 670/1340] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:36:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:36:23.494355 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433aa20e-f612-435e-82ad-244573a9dde4 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:23.495161 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433aa20e-f612-435e-82ad-244573a9dde4 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:23.495307 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433aa20e-f612-435e-82ad-244573a9dde4 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:23.500322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 671/1341] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:36:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:36:23.506966 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd152c-f539-4e24-a4c9-34f18e211ab8 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:23.507793 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd152c-f539-4e24-a4c9-34f18e211ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:23.507956 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd152c-f539-4e24-a4c9-34f18e211ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:23.619100 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-6bbd152c-f539-4e24-a4c9-34f18e211ab8 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:23.620725 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-6bbd152c-f539-4e24-a4c9-34f18e211ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:23.749071 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:23.767913 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 671/1342] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:36:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:24.049926 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433aa20e-f612-435e-82ad-244573a9dde4 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:24.051580 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-433aa20e-f612-435e-82ad-244573a9dde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:24.172679 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433aa20e-f612-435e-82ad-244573a9dde4 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:24.222932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:24.270067 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f76be91-7196-4b29-84b7-d5a147ca9ac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:24.270748 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76be91-7196-4b29-84b7-d5a147ca9ac4 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:24.271057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76be91-7196-4b29-84b7-d5a147ca9ac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:24.271373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76be91-7196-4b29-84b7-d5a147ca9ac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:24.273280 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5f76be91-7196-4b29-84b7-d5a147ca9ac4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:24.397294 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f76be91-7196-4b29-84b7-d5a147ca9ac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:24.398674 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f76be91-7196-4b29-84b7-d5a147ca9ac4 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:24.419719 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 672/1343] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:36:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:36:27.791757 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907a48e-acbe-4a9a-903e-bb1aea0906fa None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:27.792600 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907a48e-acbe-4a9a-903e-bb1aea0906fa None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:27.792600 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f907a48e-acbe-4a9a-903e-bb1aea0906fa None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:27.794247 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 672/1344] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:36:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:36:27.801260 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce0e1c-b36c-45aa-b71e-486983f33b38 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:27.801830 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce0e1c-b36c-45aa-b71e-486983f33b38 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:27.802323 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce0e1c-b36c-45aa-b71e-486983f33b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:27.920680 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-2fce0e1c-b36c-45aa-b71e-486983f33b38 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:27.922718 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2fce0e1c-b36c-45aa-b71e-486983f33b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:27.956766 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:28.056123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 673/1345] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:36:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:28.365298 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907a48e-acbe-4a9a-903e-bb1aea0906fa None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:28.367585 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f907a48e-acbe-4a9a-903e-bb1aea0906fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:28.517668 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f907a48e-acbe-4a9a-903e-bb1aea0906fa None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:28.606341 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593a0fd-1df3-473c-b86f-15859b68777d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:28.607174 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593a0fd-1df3-473c-b86f-15859b68777d service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:28.607541 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593a0fd-1df3-473c-b86f-15859b68777d service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:28.608005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593a0fd-1df3-473c-b86f-15859b68777d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:28.609849 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d593a0fd-1df3-473c-b86f-15859b68777d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:28.683279 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:28.782884 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593a0fd-1df3-473c-b86f-15859b68777d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:28.784440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593a0fd-1df3-473c-b86f-15859b68777d service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:28.806149 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 673/1346] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:36:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:36:33.614285 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae6116-a230-40ee-9b81-b1f4e53b2403 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:33.614985 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae6116-a230-40ee-9b81-b1f4e53b2403 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:33.614985 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae6116-a230-40ee-9b81-b1f4e53b2403 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:33.616587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 674/1347] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:36:33.622516 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821c5d1-ca07-4098-abbb-2667ef21bca7 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:33.622976 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821c5d1-ca07-4098-abbb-2667ef21bca7 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:33.623191 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3821c5d1-ca07-4098-abbb-2667ef21bca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:33.711034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-3821c5d1-ca07-4098-abbb-2667ef21bca7 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:33.712262 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-3821c5d1-ca07-4098-abbb-2667ef21bca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:33.830519 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:33.833545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 674/1348] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:36:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:34.114207 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae6116-a230-40ee-9b81-b1f4e53b2403 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:34.116886 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b4ae6116-a230-40ee-9b81-b1f4e53b2403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:34.229001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae6116-a230-40ee-9b81-b1f4e53b2403 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:34.279755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:34.306382 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63609a6b-5569-492a-a6b3-8e50970ca5ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:34.307054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63609a6b-5569-492a-a6b3-8e50970ca5ab service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:34.307326 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63609a6b-5569-492a-a6b3-8e50970ca5ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:34.307570 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63609a6b-5569-492a-a6b3-8e50970ca5ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:34.309208 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-63609a6b-5569-492a-a6b3-8e50970ca5ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:34.442767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63609a6b-5569-492a-a6b3-8e50970ca5ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:34.444359 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63609a6b-5569-492a-a6b3-8e50970ca5ab service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:34.465640 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 675/1349] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:36:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:36:40.130660 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4958300-8c30-4203-b351-3095d356cad5 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:40.131777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4958300-8c30-4203-b351-3095d356cad5 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:40.132232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4958300-8c30-4203-b351-3095d356cad5 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:40.135042 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 675/1350] 10.222.0.66 () {54 vars in 921 bytes} [Mon Sep 26 05:36:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:36:40.141169 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c43ac3-f2e7-47b3-a6f2-b56cf52bb7ac None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:40.142026 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c43ac3-f2e7-47b3-a6f2-b56cf52bb7ac None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:40.142457 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c43ac3-f2e7-47b3-a6f2-b56cf52bb7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:40.283846 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-44c43ac3-f2e7-47b3-a6f2-b56cf52bb7ac None None] MFA Rules not processed for user `895edcfb20484b188a3877c9de8b59c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:40.285151 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-44c43ac3-f2e7-47b3-a6f2-b56cf52bb7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:40.340355 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:40.508999 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 676/1351] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Sep 26 05:36:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:45.121679 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31148e-c422-45ef-919c-56dfdaac15af None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:45.122277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31148e-c422-45ef-919c-56dfdaac15af None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:45.122677 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31148e-c422-45ef-919c-56dfdaac15af None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:45.125088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 676/1352] 10.222.0.66 () {54 vars in 921 bytes} [Mon Sep 26 05:36:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:36:45.131349 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb573adc-6cd6-4f2a-bb39-3853c797df03 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:45.132005 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb573adc-6cd6-4f2a-bb39-3853c797df03 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:45.132706 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb573adc-6cd6-4f2a-bb39-3853c797df03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:45.257727 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-cb573adc-6cd6-4f2a-bb39-3853c797df03 None None] MFA Rules not processed for user `895edcfb20484b188a3877c9de8b59c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:45.259600 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-cb573adc-6cd6-4f2a-bb39-3853c797df03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:45.411495 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:45.487669 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 677/1353] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Sep 26 05:36:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:46.690457 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26572d60-d1f2-4235-a6e9-61f1a401668d None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:46.691008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26572d60-d1f2-4235-a6e9-61f1a401668d None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:46.691008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26572d60-d1f2-4235-a6e9-61f1a401668d None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:46.692365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 677/1354] 10.222.0.66 () {54 vars in 921 bytes} [Mon Sep 26 05:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:36:46.697957 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff1e13-e4a5-41bc-a4cd-b2e9356fcd15 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:46.698471 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff1e13-e4a5-41bc-a4cd-b2e9356fcd15 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:46.698576 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff1e13-e4a5-41bc-a4cd-b2e9356fcd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:46.787329 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-d8ff1e13-e4a5-41bc-a4cd-b2e9356fcd15 None None] MFA Rules not processed for user `895edcfb20484b188a3877c9de8b59c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:46.788724 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d8ff1e13-e4a5-41bc-a4cd-b2e9356fcd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:46.909496 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 678/1355] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Sep 26 05:36:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:50.744626 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1b2d0-4faa-4169-8520-4db7b57dca24 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:50.745118 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1b2d0-4faa-4169-8520-4db7b57dca24 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:50.745566 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1b2d0-4faa-4169-8520-4db7b57dca24 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:50.748179 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 678/1356] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:36:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:36:50.758268 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ffb37-ac16-40bb-a3ee-33daba818cf7 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:50.760872 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ffb37-ac16-40bb-a3ee-33daba818cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:50.761571 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ffb37-ac16-40bb-a3ee-33daba818cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:50.809058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:50.854071 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-5f8ffb37-ac16-40bb-a3ee-33daba818cf7 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:50.855566 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5f8ffb37-ac16-40bb-a3ee-33daba818cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:51.027863 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 679/1357] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:36:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:51.328081 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece4ecd-8a76-4e89-907a-f7188455770b None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:51.328891 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece4ecd-8a76-4e89-907a-f7188455770b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:51.329926 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece4ecd-8a76-4e89-907a-f7188455770b None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:51.335827 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 679/1358] 10.222.0.66 () {54 vars in 961 bytes} [Mon Sep 26 05:36:51 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:36:51.343962 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642aad9-5da5-433e-bffe-9a063f639eda None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:51.345692 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642aad9-5da5-433e-bffe-9a063f639eda None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:51.346403 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642aad9-5da5-433e-bffe-9a063f639eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:51.445542 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-2642aad9-5da5-433e-bffe-9a063f639eda None None] MFA Rules not processed for user `c559a36836be411b9afd076f4c9a0655`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:51.446911 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2642aad9-5da5-433e-bffe-9a063f639eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:51.520369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:51.612164 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 680/1359] 10.222.0.66 () {58 vars in 1058 bytes} [Mon Sep 26 05:36:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:51.621760 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece4ecd-8a76-4e89-907a-f7188455770b None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:51.624114 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0ece4ecd-8a76-4e89-907a-f7188455770b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:51.835044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece4ecd-8a76-4e89-907a-f7188455770b None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:51.950544 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:52.013209 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76555711-200e-44e9-bd75-bfc212467229 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:52.013967 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76555711-200e-44e9-bd75-bfc212467229 service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:52.014418 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76555711-200e-44e9-bd75-bfc212467229 service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:52.014750 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76555711-200e-44e9-bd75-bfc212467229 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:52.016642 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-76555711-200e-44e9-bd75-bfc212467229 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:52.194880 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76555711-200e-44e9-bd75-bfc212467229 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:52.197943 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76555711-200e-44e9-bd75-bfc212467229 service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:52.236096 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 680/1360] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:36:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:36:55.021342 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b3dc9-e2da-4765-ae88-66a8357a9960 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:55.021928 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b3dc9-e2da-4765-ae88-66a8357a9960 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:55.021928 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b3dc9-e2da-4765-ae88-66a8357a9960 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:55.023685 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 681/1361] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:36:55.029371 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327d87f-ff5b-477b-8ecf-79756299b6a5 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:55.029900 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327d87f-ff5b-477b-8ecf-79756299b6a5 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:55.029900 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327d87f-ff5b-477b-8ecf-79756299b6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:55.111188 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-5327d87f-ff5b-477b-8ecf-79756299b6a5 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:55.112514 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5327d87f-ff5b-477b-8ecf-79756299b6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:55.156284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:55.242157 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 681/1362] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:55.539115 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b3dc9-e2da-4765-ae88-66a8357a9960 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:55.540757 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f51b3dc9-e2da-4765-ae88-66a8357a9960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:55.746947 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b3dc9-e2da-4765-ae88-66a8357a9960 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:55.759869 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:55.942002 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b008049-27a0-44c8-8c20-0d67c1d933ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:55.942881 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b008049-27a0-44c8-8c20-0d67c1d933ec service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:55.942881 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b008049-27a0-44c8-8c20-0d67c1d933ec service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:55.943066 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b008049-27a0-44c8-8c20-0d67c1d933ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:55.945766 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2b008049-27a0-44c8-8c20-0d67c1d933ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:56.090311 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b008049-27a0-44c8-8c20-0d67c1d933ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:36:56.092011 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b008049-27a0-44c8-8c20-0d67c1d933ec service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:36:56.116289 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 682/1363] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:36:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:36:58.727964 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b25d0-0a40-4376-84c1-fdde5ef95d22 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:58.728712 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b25d0-0a40-4376-84c1-fdde5ef95d22 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:58.728712 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b25d0-0a40-4376-84c1-fdde5ef95d22 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:58.731341 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 682/1364] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:36:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:36:58.736400 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa06569-6ce0-496b-8e85-a95c4d7dc6c0 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:58.737092 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa06569-6ce0-496b-8e85-a95c4d7dc6c0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:58.737092 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa06569-6ce0-496b-8e85-a95c4d7dc6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:58.754993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:58.832220 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-eaa06569-6ce0-496b-8e85-a95c4d7dc6c0 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:58.833619 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-eaa06569-6ce0-496b-8e85-a95c4d7dc6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:58.962209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 683/1365] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:36:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:59.257970 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5946ea-897e-4ba5-9564-f591c2f604a1 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:59.258526 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5946ea-897e-4ba5-9564-f591c2f604a1 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:59.258526 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5946ea-897e-4ba5-9564-f591c2f604a1 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:59.260520 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 683/1366] 10.222.0.66 () {54 vars in 961 bytes} [Mon Sep 26 05:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:36:59.266593 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc13c6-82a9-4d87-9831-759c905e21a9 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:59.266936 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc13c6-82a9-4d87-9831-759c905e21a9 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:59.267273 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc13c6-82a9-4d87-9831-759c905e21a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:59.409051 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-48dc13c6-82a9-4d87-9831-759c905e21a9 None None] MFA Rules not processed for user `c559a36836be411b9afd076f4c9a0655`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:59.411212 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-48dc13c6-82a9-4d87-9831-759c905e21a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:59.464588 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:59.571840 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 684/1367] 10.222.0.66 () {58 vars in 1058 bytes} [Mon Sep 26 05:36:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:36:59.579644 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5946ea-897e-4ba5-9564-f591c2f604a1 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:36:59.581245 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-3a5946ea-897e-4ba5-9564-f591c2f604a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:59.769760 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5946ea-897e-4ba5-9564-f591c2f604a1 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:36:59.796791 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:36:59.862458 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261c2a1-5b7c-4ec1-871a-53f4f0bcbd2a None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:59.863219 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261c2a1-5b7c-4ec1-871a-53f4f0bcbd2a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:59.863219 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261c2a1-5b7c-4ec1-871a-53f4f0bcbd2a None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:59.864371 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 685/1368] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:36:59.871767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6ad3c-b5d3-4026-b5d3-8d3729ab97da None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:59.872057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6ad3c-b5d3-4026-b5d3-8d3729ab97da None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:59.872793 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6ad3c-b5d3-4026-b5d3-8d3729ab97da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:59.949023 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-6fd6ad3c-b5d3-4026-b5d3-8d3729ab97da None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:36:59.950219 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c04e8a-d159-4798-8917-18a63dfb94ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:36:59.950352 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6fd6ad3c-b5d3-4026-b5d3-8d3729ab97da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:36:59.950841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c04e8a-d159-4798-8917-18a63dfb94ed service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:36:59.951113 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c04e8a-d159-4798-8917-18a63dfb94ed service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:36:59.951380 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c04e8a-d159-4798-8917-18a63dfb94ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:36:59.954864 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-28c04e8a-d159-4798-8917-18a63dfb94ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:00.062359 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:00.071795 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 686/1369] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:36:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:37:00.080070 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c04e8a-d159-4798-8917-18a63dfb94ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:00.081813 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c04e8a-d159-4798-8917-18a63dfb94ed service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:00.103542 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 684/1370] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:36:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:37:00.382161 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a92af-3207-4498-9225-e0c7100b53d0 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:00.382427 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a92af-3207-4498-9225-e0c7100b53d0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:00.382699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a92af-3207-4498-9225-e0c7100b53d0 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:00.384403 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 687/1371] 10.222.0.66 () {54 vars in 963 bytes} [Mon Sep 26 05:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:37:00.389809 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229229d-4bca-46dd-9626-d460bfd40ecd None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:00.390278 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229229d-4bca-46dd-9626-d460bfd40ecd None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:00.390751 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229229d-4bca-46dd-9626-d460bfd40ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:00.425851 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:00.479245 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-0229229d-4bca-46dd-9626-d460bfd40ecd None None] MFA Rules not processed for user `842ef2c8cd794023ac29bd03c768986b`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:00.480700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0229229d-4bca-46dd-9626-d460bfd40ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:00.573158 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 685/1372] 10.222.0.66 () {58 vars in 1060 bytes} [Mon Sep 26 05:37:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:37:00.580807 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a92af-3207-4498-9225-e0c7100b53d0 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:00.582317 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8f9a92af-3207-4498-9225-e0c7100b53d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:00.711436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a92af-3207-4498-9225-e0c7100b53d0 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:00.818270 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275e6acd-bf73-4b1d-8931-3b2f20affca9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:00.818904 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e6acd-bf73-4b1d-8931-3b2f20affca9 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:00.819592 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e6acd-bf73-4b1d-8931-3b2f20affca9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:00.820491 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275e6acd-bf73-4b1d-8931-3b2f20affca9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:00.821987 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-275e6acd-bf73-4b1d-8931-3b2f20affca9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:00.879025 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:00.974134 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e6acd-bf73-4b1d-8931-3b2f20affca9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:00.975644 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275e6acd-bf73-4b1d-8931-3b2f20affca9 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:00.999211 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 688/1373] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:37:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:37:02.424942 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4d2d8-cf04-4a6c-932d-feb7b0ced717 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:02.425521 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4d2d8-cf04-4a6c-932d-feb7b0ced717 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:02.425521 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4d2d8-cf04-4a6c-932d-feb7b0ced717 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:02.427043 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 686/1374] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:37:02.432709 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a85b9-e7ab-4cec-8769-5f6bd8b5ca84 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:02.433227 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a85b9-e7ab-4cec-8769-5f6bd8b5ca84 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:02.433227 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a85b9-e7ab-4cec-8769-5f6bd8b5ca84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:02.519580 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-e48a85b9-e7ab-4cec-8769-5f6bd8b5ca84 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:02.521275 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e48a85b9-e7ab-4cec-8769-5f6bd8b5ca84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:02.672369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 689/1375] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:37:02.969098 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4d2d8-cf04-4a6c-932d-feb7b0ced717 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:02.970656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a6c4d2d8-cf04-4a6c-932d-feb7b0ced717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:03.104323 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:03.146791 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4d2d8-cf04-4a6c-932d-feb7b0ced717 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:03.291497 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcc85c-bcf8-48e4-84a1-1da2998cf9ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:03.292174 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcc85c-bcf8-48e4-84a1-1da2998cf9ac service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:03.292452 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcc85c-bcf8-48e4-84a1-1da2998cf9ac service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:03.292712 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcc85c-bcf8-48e4-84a1-1da2998cf9ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:03.294427 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c8fcc85c-bcf8-48e4-84a1-1da2998cf9ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:03.389485 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:03.404865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fcc85c-bcf8-48e4-84a1-1da2998cf9ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:03.406381 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fcc85c-bcf8-48e4-84a1-1da2998cf9ac service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:03.427990 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 687/1376] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:37:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:37:05.815586 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7286c0f-b275-46db-9833-63ecb5db939e None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:05.816580 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7286c0f-b275-46db-9833-63ecb5db939e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:05.816580 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7286c0f-b275-46db-9833-63ecb5db939e None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:05.817557 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 690/1377] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:37:05.823885 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f700d-15a9-4d3b-ad88-baca68cc075a None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:05.824542 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f700d-15a9-4d3b-ad88-baca68cc075a None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:05.824542 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f700d-15a9-4d3b-ad88-baca68cc075a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:05.911030 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-454f700d-15a9-4d3b-ad88-baca68cc075a None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:05.913233 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-454f700d-15a9-4d3b-ad88-baca68cc075a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:06.056518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 688/1378] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:37:06.349412 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7286c0f-b275-46db-9833-63ecb5db939e None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:06.350912 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d7286c0f-b275-46db-9833-63ecb5db939e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:06.354105 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:06.551206 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7286c0f-b275-46db-9833-63ecb5db939e None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:06.692780 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:06.758588 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd9b44-d84e-4023-9996-0dabe58f7649 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:06.759242 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd9b44-d84e-4023-9996-0dabe58f7649 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:06.759613 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd9b44-d84e-4023-9996-0dabe58f7649 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:06.759936 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd9b44-d84e-4023-9996-0dabe58f7649 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:06.761655 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-19cd9b44-d84e-4023-9996-0dabe58f7649 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:06.871395 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd9b44-d84e-4023-9996-0dabe58f7649 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:06.872944 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd9b44-d84e-4023-9996-0dabe58f7649 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:06.894828 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 691/1379] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:37:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:37:09.263867 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d467d-77ae-416c-8146-364fac483689 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:09.264479 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d467d-77ae-416c-8146-364fac483689 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:09.264479 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d467d-77ae-416c-8146-364fac483689 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:09.265774 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 689/1380] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:37:09.275454 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026557f-9cdb-4eb2-818e-77b43da6e297 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:09.276532 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026557f-9cdb-4eb2-818e-77b43da6e297 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:09.276532 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026557f-9cdb-4eb2-818e-77b43da6e297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:09.367002 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-f026557f-9cdb-4eb2-818e-77b43da6e297 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:09.368450 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f026557f-9cdb-4eb2-818e-77b43da6e297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:09.430602 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:09.517666 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 692/1381] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:37:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:37:09.826360 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d467d-77ae-416c-8146-364fac483689 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:09.827983 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-fc9d467d-77ae-416c-8146-364fac483689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:09.907161 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:10.023034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d467d-77ae-416c-8146-364fac483689 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:10.220531 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd008c02-95f2-4bba-9c6c-4406c211f048 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:10.222118 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd008c02-95f2-4bba-9c6c-4406c211f048 service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:10.222750 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd008c02-95f2-4bba-9c6c-4406c211f048 service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:10.223449 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd008c02-95f2-4bba-9c6c-4406c211f048 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:10.228044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-bd008c02-95f2-4bba-9c6c-4406c211f048 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:10.281470 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:10.422342 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd008c02-95f2-4bba-9c6c-4406c211f048 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:10.424164 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd008c02-95f2-4bba-9c6c-4406c211f048 service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:10.449248 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 690/1382] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:37:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:37:12.848692 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fdf5d-ce8b-4a2d-896e-c7ad823eda68 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:12.849551 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fdf5d-ce8b-4a2d-896e-c7ad823eda68 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:12.849758 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fdf5d-ce8b-4a2d-896e-c7ad823eda68 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:12.851771 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 693/1383] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:37:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:37:12.858639 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e611f79-33b9-4006-98da-bad65d6de3b3 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:12.859439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e611f79-33b9-4006-98da-bad65d6de3b3 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:12.859439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e611f79-33b9-4006-98da-bad65d6de3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:12.958924 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-6e611f79-33b9-4006-98da-bad65d6de3b3 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:12.961023 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-6e611f79-33b9-4006-98da-bad65d6de3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:13.096166 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:13.108513 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 691/1384] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:37:13.432597 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809fdf5d-ce8b-4a2d-896e-c7ad823eda68 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:13.434692 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-809fdf5d-ce8b-4a2d-896e-c7ad823eda68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:13.649532 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809fdf5d-ce8b-4a2d-896e-c7ad823eda68 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:13.678074 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:13.789113 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d288f-83e5-4165-9369-bea15b24dde2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:13.789711 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d288f-83e5-4165-9369-bea15b24dde2 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:13.790001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d288f-83e5-4165-9369-bea15b24dde2 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:13.790268 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d288f-83e5-4165-9369-bea15b24dde2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:13.792277 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-775d288f-83e5-4165-9369-bea15b24dde2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:13.898812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d288f-83e5-4165-9369-bea15b24dde2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:13.901453 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d288f-83e5-4165-9369-bea15b24dde2 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:13.933381 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 694/1385] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:37:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:37:16.294059 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceef718-8d72-4970-b5f7-d5c74c0f9e51 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:16.294636 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceef718-8d72-4970-b5f7-d5c74c0f9e51 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:16.294636 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceef718-8d72-4970-b5f7-d5c74c0f9e51 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:16.296001 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 692/1386] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:37:16.302704 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aafb29-25e9-45c2-87da-60b46aa90dea None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:16.303295 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aafb29-25e9-45c2-87da-60b46aa90dea None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:16.303295 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aafb29-25e9-45c2-87da-60b46aa90dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:16.345841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:16.381235 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-72aafb29-25e9-45c2-87da-60b46aa90dea None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:16.382470 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-72aafb29-25e9-45c2-87da-60b46aa90dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:16.500822 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 695/1387] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:37:16.832865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceef718-8d72-4970-b5f7-d5c74c0f9e51 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:16.835999 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4ceef718-8d72-4970-b5f7-d5c74c0f9e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:16.941902 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c70a9-0edf-4c50-ae3e-e28db33467d0 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:16.942172 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c70a9-0edf-4c50-ae3e-e28db33467d0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:16.942442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c70a9-0edf-4c50-ae3e-e28db33467d0 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:16.944133 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 696/1388] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:37:16.950751 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61abfb-3e39-4a69-8334-0ab11c599aa2 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:16.951121 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61abfb-3e39-4a69-8334-0ab11c599aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:16.951365 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61abfb-3e39-4a69-8334-0ab11c599aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:17.032755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-fd61abfb-3e39-4a69-8334-0ab11c599aa2 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:17.034070 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-fd61abfb-3e39-4a69-8334-0ab11c599aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:17.068686 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceef718-8d72-4970-b5f7-d5c74c0f9e51 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:17.102037 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:17.147209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 697/1389] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:37:17.172247 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:17.238619 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f58715-26ca-42d8-a856-a46a073594fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:17.239136 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f58715-26ca-42d8-a856-a46a073594fd service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:17.239411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f58715-26ca-42d8-a856-a46a073594fd service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:17.239678 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f58715-26ca-42d8-a856-a46a073594fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:17.241316 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-20f58715-26ca-42d8-a856-a46a073594fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:17.347406 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f58715-26ca-42d8-a856-a46a073594fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:17.349072 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f58715-26ca-42d8-a856-a46a073594fd service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:17.377427 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 693/1390] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:37:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:37:17.462701 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca091f0-1615-439a-80f1-063e90b25e44 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:17.463281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca091f0-1615-439a-80f1-063e90b25e44 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:17.463937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca091f0-1615-439a-80f1-063e90b25e44 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:17.466802 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 698/1391] 10.222.0.66 () {54 vars in 962 bytes} [Mon Sep 26 05:37:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:37:17.474057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82242da9-5b33-458b-bb97-348e23e2d0f7 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:17.474423 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82242da9-5b33-458b-bb97-348e23e2d0f7 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:17.474766 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82242da9-5b33-458b-bb97-348e23e2d0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:17.576203 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-82242da9-5b33-458b-bb97-348e23e2d0f7 None None] MFA Rules not processed for user `766ad3d6be374fc482a7c0bf6a1e56ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:17.577600 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-82242da9-5b33-458b-bb97-348e23e2d0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:17.608407 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:17.677966 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 694/1392] 10.222.0.66 () {58 vars in 1059 bytes} [Mon Sep 26 05:37:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:37:17.688091 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca091f0-1615-439a-80f1-063e90b25e44 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:17.691386 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-eca091f0-1615-439a-80f1-063e90b25e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:17.819211 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca091f0-1615-439a-80f1-063e90b25e44 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:17.898852 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2829c-9a10-4daf-80b2-e5e59071eb8c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '766ad3d6be374fc482a7c0bf6a1e56ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:17.899354 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2829c-9a10-4daf-80b2-e5e59071eb8c service glance] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:17.899645 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2829c-9a10-4daf-80b2-e5e59071eb8c service glance] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:17.899955 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2829c-9a10-4daf-80b2-e5e59071eb8c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:17.901609 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8fc2829c-9a10-4daf-80b2-e5e59071eb8c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:17.921671 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:18.041370 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2829c-9a10-4daf-80b2-e5e59071eb8c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:18.042838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2829c-9a10-4daf-80b2-e5e59071eb8c service glance] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:18.066703 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 699/1393] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:37:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:37:18.906865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8572261-65d7-4a44-9239-e6088f930a2f None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:18.907680 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8572261-65d7-4a44-9239-e6088f930a2f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:18.907873 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8572261-65d7-4a44-9239-e6088f930a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:19.015709 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-f8572261-65d7-4a44-9239-e6088f930a2f None None] MFA Rules not processed for user `5bdaf32400b94aa291ad43a3131e1d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:19.016856 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f8572261-65d7-4a44-9239-e6088f930a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:19.132567 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 695/1394] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Sep 26 05:37:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:37:19.184990 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fa419-b086-4c02-8ab8-e8c165ec916a None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:19.185533 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fa419-b086-4c02-8ab8-e8c165ec916a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:19.186120 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fa419-b086-4c02-8ab8-e8c165ec916a None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:19.188906 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 700/1395] 10.222.0.66 () {54 vars in 943 bytes} [Mon Sep 26 05:37:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:37:19.196243 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad98cdc-a57a-4192-bd11-6398ad5658d7 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:19.196529 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad98cdc-a57a-4192-bd11-6398ad5658d7 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:19.196799 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad98cdc-a57a-4192-bd11-6398ad5658d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:19.269479 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:19.302916 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-0ad98cdc-a57a-4192-bd11-6398ad5658d7 None None] MFA Rules not processed for user `830cd52ac42548b2ade17b5215aefd28`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:19.304169 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0ad98cdc-a57a-4192-bd11-6398ad5658d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:19.456933 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 696/1396] 10.222.0.66 () {58 vars in 1040 bytes} [Mon Sep 26 05:37:19 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:37:19.468359 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fa419-b086-4c02-8ab8-e8c165ec916a None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:19.470650 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ba0fa419-b086-4c02-8ab8-e8c165ec916a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:19.619098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:19.641805 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d8039-64e2-4fe1-bffe-70e16c10ac1b None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:19.642167 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d8039-64e2-4fe1-bffe-70e16c10ac1b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:19.642535 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d8039-64e2-4fe1-bffe-70e16c10ac1b None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:19.644286 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 697/1397] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:37:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:37:19.647881 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fa419-b086-4c02-8ab8-e8c165ec916a None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:19.649922 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571f22a-5497-46b9-a4ab-a323c4b8e74f None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:19.650124 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571f22a-5497-46b9-a4ab-a323c4b8e74f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:19.650429 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571f22a-5497-46b9-a4ab-a323c4b8e74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:19.728644 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-9571f22a-5497-46b9-a4ab-a323c4b8e74f None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:19.730060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-9571f22a-5497-46b9-a4ab-a323c4b8e74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:19.766798 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2febd-592c-4a81-a00a-55ec2518b649 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '830cd52ac42548b2ade17b5215aefd28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:19.767411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2febd-592c-4a81-a00a-55ec2518b649 service swift] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:19.767684 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2febd-592c-4a81-a00a-55ec2518b649 service swift] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:19.767980 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2febd-592c-4a81-a00a-55ec2518b649 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:19.769654 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-bec2febd-592c-4a81-a00a-55ec2518b649 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:19.782068 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:19.846408 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 698/1398] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:37:19.879550 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec2febd-592c-4a81-a00a-55ec2518b649 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:19.881213 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec2febd-592c-4a81-a00a-55ec2518b649 service swift] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:19.890510 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 701/1399] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 26 05:37:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 05:37:20.137475 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571f22a-5497-46b9-a4ab-a323c4b8e74f None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:20.138761 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-9571f22a-5497-46b9-a4ab-a323c4b8e74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:20.298480 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571f22a-5497-46b9-a4ab-a323c4b8e74f None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:20.398098 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:20.468511 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750a200-f111-489e-b77b-d7668e0901ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:20.469308 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750a200-f111-489e-b77b-d7668e0901ab service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:20.469607 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750a200-f111-489e-b77b-d7668e0901ab service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:20.469859 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750a200-f111-489e-b77b-d7668e0901ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:20.471649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c750a200-f111-489e-b77b-d7668e0901ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:20.624690 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750a200-f111-489e-b77b-d7668e0901ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:20.626489 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750a200-f111-489e-b77b-d7668e0901ab service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:20.650441 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 699/1400] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:37:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:37:22.875466 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1a346-1477-4f1d-8f43-a8954baed60c None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:22.876118 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1a346-1477-4f1d-8f43-a8954baed60c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:22.876118 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1a346-1477-4f1d-8f43-a8954baed60c None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:22.877419 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 702/1401] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:37:22.883125 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68265a31-371e-4699-a776-f145e1d509a6 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:22.883581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68265a31-371e-4699-a776-f145e1d509a6 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:22.883678 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68265a31-371e-4699-a776-f145e1d509a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:22.965609 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-68265a31-371e-4699-a776-f145e1d509a6 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:22.966737 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-68265a31-371e-4699-a776-f145e1d509a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:22.989700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:23.078325 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 700/1402] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:37:23.376763 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1a346-1477-4f1d-8f43-a8954baed60c None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:23.376763 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c7c1a346-1477-4f1d-8f43-a8954baed60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:23.393844 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:23.560951 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1a346-1477-4f1d-8f43-a8954baed60c None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:23.666924 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:23.706369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e094fa8-7755-47ef-a492-6565c252e5b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:23.708265 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e094fa8-7755-47ef-a492-6565c252e5b0 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:23.708730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e094fa8-7755-47ef-a492-6565c252e5b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:23.709002 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e094fa8-7755-47ef-a492-6565c252e5b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:23.710687 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2e094fa8-7755-47ef-a492-6565c252e5b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:23.823601 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e094fa8-7755-47ef-a492-6565c252e5b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:23.825271 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e094fa8-7755-47ef-a492-6565c252e5b0 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:23.850249 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 703/1403] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:37:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:37:26.220808 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5f05b-fdca-4886-b2a7-a25aa89d0528 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:26.221404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5f05b-fdca-4886-b2a7-a25aa89d0528 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:26.221404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc5f05b-fdca-4886-b2a7-a25aa89d0528 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:26.222799 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 701/1404] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:37:26.228801 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c36a7-0a30-4ba1-b94a-b31d2307d020 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:26.229324 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c36a7-0a30-4ba1-b94a-b31d2307d020 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:26.229324 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c36a7-0a30-4ba1-b94a-b31d2307d020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:26.303449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-271c36a7-0a30-4ba1-b94a-b31d2307d020 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:26.304730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-271c36a7-0a30-4ba1-b94a-b31d2307d020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:26.364053 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:26.418288 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 704/1405] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:37:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:37:26.711702 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5f05b-fdca-4886-b2a7-a25aa89d0528 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:26.716233 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-3cc5f05b-fdca-4886-b2a7-a25aa89d0528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:26.888283 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc5f05b-fdca-4886-b2a7-a25aa89d0528 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:26.891957 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:27.027714 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631c3a6-ce78-4151-811f-43fde31994f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:27.028715 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631c3a6-ce78-4151-811f-43fde31994f9 service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:27.028837 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631c3a6-ce78-4151-811f-43fde31994f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:27.029137 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631c3a6-ce78-4151-811f-43fde31994f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:27.030967 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-7631c3a6-ce78-4151-811f-43fde31994f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:27.138465 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631c3a6-ce78-4151-811f-43fde31994f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:27.140008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631c3a6-ce78-4151-811f-43fde31994f9 service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:27.161332 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 702/1406] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:37:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:37:29.380524 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0741d-5fb7-44e5-b1ca-cf47e2b5a25a None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:29.381237 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0741d-5fb7-44e5-b1ca-cf47e2b5a25a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:29.381237 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0741d-5fb7-44e5-b1ca-cf47e2b5a25a None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:29.382607 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 705/1407] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:37:29.390665 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fab21a-1104-4fee-8b73-1d564c75425e None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:29.390665 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fab21a-1104-4fee-8b73-1d564c75425e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:29.390665 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fab21a-1104-4fee-8b73-1d564c75425e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:29.401511 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:29.471144 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-15fab21a-1104-4fee-8b73-1d564c75425e None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:29.472396 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-15fab21a-1104-4fee-8b73-1d564c75425e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:29.579783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 703/1408] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:37:29.872190 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0741d-5fb7-44e5-b1ca-cf47e2b5a25a None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:29.873773 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d1a0741d-5fb7-44e5-b1ca-cf47e2b5a25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:30.053585 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0741d-5fb7-44e5-b1ca-cf47e2b5a25a None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:30.093480 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:30.191218 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50284333-bf57-4311-b6e0-b7c6afed9383 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:30.191852 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50284333-bf57-4311-b6e0-b7c6afed9383 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:30.192136 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50284333-bf57-4311-b6e0-b7c6afed9383 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:30.192402 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50284333-bf57-4311-b6e0-b7c6afed9383 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:30.194013 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-50284333-bf57-4311-b6e0-b7c6afed9383 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:30.295169 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50284333-bf57-4311-b6e0-b7c6afed9383 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:30.297018 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50284333-bf57-4311-b6e0-b7c6afed9383 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:30.318681 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 706/1409] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:37:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:37:39.578102 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=61 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:40.316364 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=83 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:42.802549 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6eb46-929c-467c-8ecc-afe04b4f78ba None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:42.803370 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6eb46-929c-467c-8ecc-afe04b4f78ba None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:42.803370 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6eb46-929c-467c-8ecc-afe04b4f78ba None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:42.804607 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 704/1410] 10.222.0.66 () {54 vars in 918 bytes} [Mon Sep 26 05:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:37:42.810875 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73eb01-cc43-4515-9d45-eb9b2e275434 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:42.811427 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73eb01-cc43-4515-9d45-eb9b2e275434 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:42.811427 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73eb01-cc43-4515-9d45-eb9b2e275434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:42.901376 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-0c73eb01-cc43-4515-9d45-eb9b2e275434 None None] MFA Rules not processed for user `895edcfb20484b188a3877c9de8b59c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:42.902599 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0c73eb01-cc43-4515-9d45-eb9b2e275434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:43.015395 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 707/1411] 10.222.0.66 () {58 vars in 1015 bytes} [Mon Sep 26 05:37:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:37:43.030081 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ab88b-b8ab-4487-8ef6-c6ca2d54cf73 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:43.030385 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ab88b-b8ab-4487-8ef6-c6ca2d54cf73 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:43.030653 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ab88b-b8ab-4487-8ef6-c6ca2d54cf73 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:43.032036 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 705/1412] 10.222.0.66 () {54 vars in 918 bytes} [Mon Sep 26 05:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:37:43.037194 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d64b0a-e6ba-4160-bb80-b747dc414dd6 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:43.037474 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d64b0a-e6ba-4160-bb80-b747dc414dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:43.037743 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d64b0a-e6ba-4160-bb80-b747dc414dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:43.112379 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:43.115784 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-a8d64b0a-e6ba-4160-bb80-b747dc414dd6 None None] MFA Rules not processed for user `c559a36836be411b9afd076f4c9a0655`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:43.117799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a8d64b0a-e6ba-4160-bb80-b747dc414dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:43.236704 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 708/1413] 10.222.0.66 () {58 vars in 1015 bytes} [Mon Sep 26 05:37:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:37:45.860638 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79079f50-3af9-4ede-bce8-dc458f6be57e None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:45.861234 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79079f50-3af9-4ede-bce8-dc458f6be57e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:45.861234 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79079f50-3af9-4ede-bce8-dc458f6be57e None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:45.862424 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 05:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:37:45.867887 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d2400-813a-4d38-b121-ce793da34a30 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:45.868354 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d2400-813a-4d38-b121-ce793da34a30 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:45.868451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d2400-813a-4d38-b121-ce793da34a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:45.941703 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-883d2400-813a-4d38-b121-ce793da34a30 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:45.943036 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-883d2400-813a-4d38-b121-ce793da34a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:46.002992 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:46.051266 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 05:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:37:46.339767 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79079f50-3af9-4ede-bce8-dc458f6be57e None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:46.341324 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-79079f50-3af9-4ede-bce8-dc458f6be57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:46.510201 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79079f50-3af9-4ede-bce8-dc458f6be57e None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:46.589426 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:46.630270 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499e115-0452-4481-83d7-7c048e367660 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:46.630874 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499e115-0452-4481-83d7-7c048e367660 service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:46.631137 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499e115-0452-4481-83d7-7c048e367660 service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:46.631400 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499e115-0452-4481-83d7-7c048e367660 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:46.632990 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2499e115-0452-4481-83d7-7c048e367660 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:46.729786 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499e115-0452-4481-83d7-7c048e367660 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:46.731397 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499e115-0452-4481-83d7-7c048e367660 service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:46.750657 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 707/1416] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:37:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:37:47.905370 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82160948-e219-44e4-9c9e-2abb8e8368be None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:47.905937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82160948-e219-44e4-9c9e-2abb8e8368be None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:47.905937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82160948-e219-44e4-9c9e-2abb8e8368be None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:47.907683 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 05:37:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:37:47.917116 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a21707-9b8c-456e-9f07-d40e1a85b868 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:47.917955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a21707-9b8c-456e-9f07-d40e1a85b868 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:47.917955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a21707-9b8c-456e-9f07-d40e1a85b868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:48.003845 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-99a21707-9b8c-456e-9f07-d40e1a85b868 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:48.005087 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-99a21707-9b8c-456e-9f07-d40e1a85b868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:48.032963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:48.125990 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 05:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:37:48.304907 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82160948-e219-44e4-9c9e-2abb8e8368be None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:48.306526 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-82160948-e219-44e4-9c9e-2abb8e8368be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:48.469683 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82160948-e219-44e4-9c9e-2abb8e8368be None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:48.515277 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:48.590763 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc17a1f-1c87-43af-b432-fcae3a7a21f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:48.591281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc17a1f-1c87-43af-b432-fcae3a7a21f3 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:48.591558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc17a1f-1c87-43af-b432-fcae3a7a21f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:48.591864 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc17a1f-1c87-43af-b432-fcae3a7a21f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:48.593469 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8cc17a1f-1c87-43af-b432-fcae3a7a21f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:48.687645 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc17a1f-1c87-43af-b432-fcae3a7a21f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:48.689650 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc17a1f-1c87-43af-b432-fcae3a7a21f3 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:48.709535 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 711/1419] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:37:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:37:49.848481 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857766aa-e2bd-4f9d-af28-7e6b32b86dbe None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:49.849040 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857766aa-e2bd-4f9d-af28-7e6b32b86dbe None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:49.849040 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857766aa-e2bd-4f9d-af28-7e6b32b86dbe None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:49.850427 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 05:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:37:49.857925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b20be-9c31-4256-a6fb-1a6f0e0c7c45 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:49.858455 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b20be-9c31-4256-a6fb-1a6f0e0c7c45 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:49.858455 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b20be-9c31-4256-a6fb-1a6f0e0c7c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:49.918337 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:49.942450 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-068b20be-9c31-4256-a6fb-1a6f0e0c7c45 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:49.943684 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-068b20be-9c31-4256-a6fb-1a6f0e0c7c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:50.046369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 05:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:37:50.199835 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857766aa-e2bd-4f9d-af28-7e6b32b86dbe None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:50.201418 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-857766aa-e2bd-4f9d-af28-7e6b32b86dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:50.362714 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857766aa-e2bd-4f9d-af28-7e6b32b86dbe None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:50.376754 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:50.499625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a1ffd-6a7f-4772-860d-303200ec999e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:50.500278 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a1ffd-6a7f-4772-860d-303200ec999e service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:50.500542 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a1ffd-6a7f-4772-860d-303200ec999e service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:50.500805 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a1ffd-6a7f-4772-860d-303200ec999e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:50.502495 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-369a1ffd-6a7f-4772-860d-303200ec999e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:50.607459 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a1ffd-6a7f-4772-860d-303200ec999e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:50.609094 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a1ffd-6a7f-4772-860d-303200ec999e service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:50.627815 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 710/1422] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:37:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:37:51.753860 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa1a96-eeae-4709-bccc-19ed02231273 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:51.754517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa1a96-eeae-4709-bccc-19ed02231273 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:51.754517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa1a96-eeae-4709-bccc-19ed02231273 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:51.755712 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 05:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:37:51.762626 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65c9a1-62cc-4143-9e42-a5bbed4017bc None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:51.763199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65c9a1-62cc-4143-9e42-a5bbed4017bc None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:51.763199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65c9a1-62cc-4143-9e42-a5bbed4017bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:51.784402 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:51.842990 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-5d65c9a1-62cc-4143-9e42-a5bbed4017bc None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:51.844233 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5d65c9a1-62cc-4143-9e42-a5bbed4017bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:51.948764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 05:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:37:52.098246 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa1a96-eeae-4709-bccc-19ed02231273 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:52.099833 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-46fa1a96-eeae-4709-bccc-19ed02231273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:52.218865 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:52.256320 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa1a96-eeae-4709-bccc-19ed02231273 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:52.379086 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4051363-a0f6-4a76-b174-b169ed61940e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:52.379697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4051363-a0f6-4a76-b174-b169ed61940e service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:52.380046 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4051363-a0f6-4a76-b174-b169ed61940e service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:52.380309 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4051363-a0f6-4a76-b174-b169ed61940e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:52.381893 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d4051363-a0f6-4a76-b174-b169ed61940e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:52.461984 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:52.477192 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4051363-a0f6-4a76-b174-b169ed61940e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:52.478730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4051363-a0f6-4a76-b174-b169ed61940e service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:52.497441 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 714/1425] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:37:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:37:53.614155 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e1b60-8856-4f54-b0c8-ac153e9d9270 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:53.614762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e1b60-8856-4f54-b0c8-ac153e9d9270 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:53.614762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e1b60-8856-4f54-b0c8-ac153e9d9270 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:53.616089 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 05:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:37:53.622974 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478cd83-decc-4a4e-828f-5ea72f8c4562 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:53.623543 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478cd83-decc-4a4e-828f-5ea72f8c4562 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:53.623543 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478cd83-decc-4a4e-828f-5ea72f8c4562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:53.704840 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-7478cd83-decc-4a4e-828f-5ea72f8c4562 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:53.706058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7478cd83-decc-4a4e-828f-5ea72f8c4562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:53.808653 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 05:37:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:37:53.958782 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e1b60-8856-4f54-b0c8-ac153e9d9270 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:53.960312 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-446e1b60-8856-4f54-b0c8-ac153e9d9270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:54.056365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:54.124098 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e1b60-8856-4f54-b0c8-ac153e9d9270 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:54.258051 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a7c0e-6168-46ad-8b74-31ef97d4f173 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:54.258608 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a7c0e-6168-46ad-8b74-31ef97d4f173 service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:54.258883 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a7c0e-6168-46ad-8b74-31ef97d4f173 service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:54.259239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a7c0e-6168-46ad-8b74-31ef97d4f173 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:54.260965 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d36a7c0e-6168-46ad-8b74-31ef97d4f173 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:54.316546 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:54.363627 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a7c0e-6168-46ad-8b74-31ef97d4f173 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:54.365281 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a7c0e-6168-46ad-8b74-31ef97d4f173 service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:54.383597 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 713/1428] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:37:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:37:55.455641 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e7640-ecfd-4a75-bfc9-5bc5e0e4a748 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:55.456298 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e7640-ecfd-4a75-bfc9-5bc5e0e4a748 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:55.456298 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e7640-ecfd-4a75-bfc9-5bc5e0e4a748 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:55.457619 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 05:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:37:55.464527 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e738cf3-b852-4ebf-bf5f-e4efc0d4161f None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:55.465064 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e738cf3-b852-4ebf-bf5f-e4efc0d4161f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:55.465064 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e738cf3-b852-4ebf-bf5f-e4efc0d4161f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:55.542805 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-7e738cf3-b852-4ebf-bf5f-e4efc0d4161f None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:55.544072 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-7e738cf3-b852-4ebf-bf5f-e4efc0d4161f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:55.648726 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 05:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:37:55.799402 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e7640-ecfd-4a75-bfc9-5bc5e0e4a748 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:55.800898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-487e7640-ecfd-4a75-bfc9-5bc5e0e4a748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:55.852183 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:55.953240 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e7640-ecfd-4a75-bfc9-5bc5e0e4a748 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:56.070990 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358b96e-0dfa-444d-8a14-520d57278108 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:56.071533 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358b96e-0dfa-444d-8a14-520d57278108 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:56.071808 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358b96e-0dfa-444d-8a14-520d57278108 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:56.072127 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358b96e-0dfa-444d-8a14-520d57278108 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:56.073701 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9358b96e-0dfa-444d-8a14-520d57278108 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:56.080767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:56.170193 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358b96e-0dfa-444d-8a14-520d57278108 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:56.171867 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358b96e-0dfa-444d-8a14-520d57278108 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:56.193228 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 717/1431] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:37:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:37:57.258827 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579892bf-1145-45fd-bb06-976f3b9fbb65 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:57.259437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579892bf-1145-45fd-bb06-976f3b9fbb65 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:57.259437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579892bf-1145-45fd-bb06-976f3b9fbb65 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:57.260883 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 05:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:37:57.267778 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c84a9-5f65-4d8c-adba-c06414d66fb5 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:57.268325 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c84a9-5f65-4d8c-adba-c06414d66fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:57.268325 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c84a9-5f65-4d8c-adba-c06414d66fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:57.349228 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-8b4c84a9-5f65-4d8c-adba-c06414d66fb5 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:57.350473 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8b4c84a9-5f65-4d8c-adba-c06414d66fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:57.423617 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:57.456561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 05:37:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:37:57.608337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579892bf-1145-45fd-bb06-976f3b9fbb65 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:57.609780 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-579892bf-1145-45fd-bb06-976f3b9fbb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:57.628248 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:57.768343 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579892bf-1145-45fd-bb06-976f3b9fbb65 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:57.867838 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:57.898321 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a063851-b3ed-4272-90d0-b4b71e29ed18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:57.898946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a063851-b3ed-4272-90d0-b4b71e29ed18 service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:57.899217 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a063851-b3ed-4272-90d0-b4b71e29ed18 service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:57.899899 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a063851-b3ed-4272-90d0-b4b71e29ed18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:57.901473 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5a063851-b3ed-4272-90d0-b4b71e29ed18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:58.007027 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a063851-b3ed-4272-90d0-b4b71e29ed18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:58.008695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a063851-b3ed-4272-90d0-b4b71e29ed18 service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:58.030207 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 716/1434] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:37:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:37:59.094205 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea6371-e41a-4528-af82-0b02f853e65e None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:59.094826 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea6371-e41a-4528-af82-0b02f853e65e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:59.094826 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ea6371-e41a-4528-af82-0b02f853e65e None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:59.096112 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 05:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:37:59.102960 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4918dcf-1f2b-4400-a30b-eff2a4d68b46 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:59.103604 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4918dcf-1f2b-4400-a30b-eff2a4d68b46 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:59.103604 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4918dcf-1f2b-4400-a30b-eff2a4d68b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:59.181898 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-b4918dcf-1f2b-4400-a30b-eff2a4d68b46 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:37:59.183121 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b4918dcf-1f2b-4400-a30b-eff2a4d68b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:59.233156 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:59.290897 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 05:37:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:37:59.440159 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea6371-e41a-4528-af82-0b02f853e65e None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:37:59.441809 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b8ea6371-e41a-4528-af82-0b02f853e65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:59.596032 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ea6371-e41a-4528-af82-0b02f853e65e None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:37:59.655327 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:37:59.719411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ab0b3-7479-4eb1-a750-e6926fcbba67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:37:59.720060 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ab0b3-7479-4eb1-a750-e6926fcbba67 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:37:59.720333 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ab0b3-7479-4eb1-a750-e6926fcbba67 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:37:59.720591 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ab0b3-7479-4eb1-a750-e6926fcbba67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:37:59.722199 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9a9ab0b3-7479-4eb1-a750-e6926fcbba67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:37:59.817233 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ab0b3-7479-4eb1-a750-e6926fcbba67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:37:59.818813 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ab0b3-7479-4eb1-a750-e6926fcbba67 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:37:59.838360 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 720/1437] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:37:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:38:00.902759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a581cd-a1eb-413b-994d-3bc19b1a3caa None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:00.903321 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a581cd-a1eb-413b-994d-3bc19b1a3caa None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:00.903321 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a581cd-a1eb-413b-994d-3bc19b1a3caa None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:00.904589 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 05:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:38:00.911419 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24feb5-a6c5-4f80-9f8d-41543b12e42f None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:00.912029 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24feb5-a6c5-4f80-9f8d-41543b12e42f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:00.912029 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24feb5-a6c5-4f80-9f8d-41543b12e42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:01.001320 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-eb24feb5-a6c5-4f80-9f8d-41543b12e42f None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:38:01.002543 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-eb24feb5-a6c5-4f80-9f8d-41543b12e42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:01.004948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:01.112264 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 05:38:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:38:01.260704 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a581cd-a1eb-413b-994d-3bc19b1a3caa None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:01.262239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a7a581cd-a1eb-413b-994d-3bc19b1a3caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:01.423985 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a581cd-a1eb-413b-994d-3bc19b1a3caa None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:01.453662 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:01.545608 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa0cc2-8fbd-476a-9e95-6f4ee930d4cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:01.546150 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa0cc2-8fbd-476a-9e95-6f4ee930d4cc service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:01.546415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa0cc2-8fbd-476a-9e95-6f4ee930d4cc service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:01.546654 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa0cc2-8fbd-476a-9e95-6f4ee930d4cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:01.548281 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-28fa0cc2-8fbd-476a-9e95-6f4ee930d4cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:01.644460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa0cc2-8fbd-476a-9e95-6f4ee930d4cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:01.646083 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa0cc2-8fbd-476a-9e95-6f4ee930d4cc service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:01.664782 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 719/1440] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:38:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:38:03.749418 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30eb390-809d-460e-9378-2612769a065b None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:03.750020 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30eb390-809d-460e-9378-2612769a065b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:03.750020 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30eb390-809d-460e-9378-2612769a065b None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:03.751286 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 05:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:38:03.757266 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350400e8-9196-475c-bcb9-a12c7a9cdb67 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:03.757794 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350400e8-9196-475c-bcb9-a12c7a9cdb67 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:03.757794 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350400e8-9196-475c-bcb9-a12c7a9cdb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:03.802261 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:03.831248 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-350400e8-9196-475c-bcb9-a12c7a9cdb67 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:38:03.832491 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-350400e8-9196-475c-bcb9-a12c7a9cdb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:03.940765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 05:38:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:38:04.258704 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30eb390-809d-460e-9378-2612769a065b None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:04.260297 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a30eb390-809d-460e-9378-2612769a065b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:04.373024 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30eb390-809d-460e-9378-2612769a065b None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:04.411496 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:04.456520 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a08ef-6a3c-4d02-9d72-728480d2e9de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:04.457134 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a08ef-6a3c-4d02-9d72-728480d2e9de service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:04.457406 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a08ef-6a3c-4d02-9d72-728480d2e9de service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:04.457677 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a08ef-6a3c-4d02-9d72-728480d2e9de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:04.459289 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-725a08ef-6a3c-4d02-9d72-728480d2e9de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:04.574592 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a08ef-6a3c-4d02-9d72-728480d2e9de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:04.576078 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a08ef-6a3c-4d02-9d72-728480d2e9de service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:04.598112 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 723/1443] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:38:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:38:06.921367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf67539-d337-4302-9331-deb6e0a31286 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:06.921976 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf67539-d337-4302-9331-deb6e0a31286 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:06.921976 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf67539-d337-4302-9331-deb6e0a31286 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:06.923272 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 05:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:38:06.929187 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082f6d8-62de-48af-a001-4d64351c2680 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:06.929672 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082f6d8-62de-48af-a001-4d64351c2680 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:06.929778 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082f6d8-62de-48af-a001-4d64351c2680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:07.003413 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-6082f6d8-62de-48af-a001-4d64351c2680 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:38:07.004670 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6082f6d8-62de-48af-a001-4d64351c2680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:07.018113 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:07.109296 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 05:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:38:07.392991 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf67539-d337-4302-9331-deb6e0a31286 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:07.394563 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-abf67539-d337-4302-9331-deb6e0a31286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:07.628150 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf67539-d337-4302-9331-deb6e0a31286 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:07.640729 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:07.705014 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45832955-f084-40e7-b444-f1950cbee2a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:07.705669 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45832955-f084-40e7-b444-f1950cbee2a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:07.705944 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45832955-f084-40e7-b444-f1950cbee2a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:07.706184 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45832955-f084-40e7-b444-f1950cbee2a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:07.707840 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-45832955-f084-40e7-b444-f1950cbee2a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:07.826512 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45832955-f084-40e7-b444-f1950cbee2a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:07.827992 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45832955-f084-40e7-b444-f1950cbee2a0 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:07.847771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 722/1446] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:38:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:38:10.445038 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393fc3f-ba30-4352-b695-54d85066efd9 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:10.445611 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393fc3f-ba30-4352-b695-54d85066efd9 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:10.445743 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393fc3f-ba30-4352-b695-54d85066efd9 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:10.447379 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 05:38:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:38:10.452981 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4f6ac-5aae-4be5-b617-a46bcee87ec1 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:10.453451 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4f6ac-5aae-4be5-b617-a46bcee87ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:10.453548 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4f6ac-5aae-4be5-b617-a46bcee87ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:10.503760 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:10.523251 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-c8d4f6ac-5aae-4be5-b617-a46bcee87ec1 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:38:10.524526 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c8d4f6ac-5aae-4be5-b617-a46bcee87ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:10.636722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 05:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:38:10.920992 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393fc3f-ba30-4352-b695-54d85066efd9 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:10.922557 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d393fc3f-ba30-4352-b695-54d85066efd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:11.031502 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393fc3f-ba30-4352-b695-54d85066efd9 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:11.075657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:11.112174 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca44e06-0426-45ee-8b6d-a93a342cc62b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:11.112797 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca44e06-0426-45ee-8b6d-a93a342cc62b service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:11.113075 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca44e06-0426-45ee-8b6d-a93a342cc62b service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:11.113345 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca44e06-0426-45ee-8b6d-a93a342cc62b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:11.114974 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5ca44e06-0426-45ee-8b6d-a93a342cc62b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:11.230124 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca44e06-0426-45ee-8b6d-a93a342cc62b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:11.231566 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca44e06-0426-45ee-8b6d-a93a342cc62b service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:11.250540 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 726/1449] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:38:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:38:13.556274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29146f67-50db-46b3-89e6-60c9fea1a043 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:13.556838 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29146f67-50db-46b3-89e6-60c9fea1a043 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:13.556838 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29146f67-50db-46b3-89e6-60c9fea1a043 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:13.558088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 05:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:38:13.564365 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33c06e-6609-4141-b747-d49adccda417 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:13.564828 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33c06e-6609-4141-b747-d49adccda417 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:13.564920 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e33c06e-6609-4141-b747-d49adccda417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:13.634809 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-5e33c06e-6609-4141-b747-d49adccda417 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:38:13.636059 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5e33c06e-6609-4141-b747-d49adccda417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:13.657271 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:13.737640 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 05:38:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:38:14.014475 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29146f67-50db-46b3-89e6-60c9fea1a043 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:14.016072 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-29146f67-50db-46b3-89e6-60c9fea1a043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:14.127298 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29146f67-50db-46b3-89e6-60c9fea1a043 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:14.156888 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:14.214540 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b14773-3127-40a5-9699-f940c60c99b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:14.215157 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b14773-3127-40a5-9699-f940c60c99b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:14.215411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b14773-3127-40a5-9699-f940c60c99b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:14.215661 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b14773-3127-40a5-9699-f940c60c99b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:14.217276 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-04b14773-3127-40a5-9699-f940c60c99b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:14.335845 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b14773-3127-40a5-9699-f940c60c99b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:14.337187 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b14773-3127-40a5-9699-f940c60c99b1 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:14.355684 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 725/1452] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:38:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:38:16.584665 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7c4a0-5ff1-49b0-99ad-d4d15495eb36 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:16.585236 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7c4a0-5ff1-49b0-99ad-d4d15495eb36 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:16.585236 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7c4a0-5ff1-49b0-99ad-d4d15495eb36 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:16.586546 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 05:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:38:16.592470 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0718b3-8e40-474d-8563-3b365524e1a1 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:16.592961 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0718b3-8e40-474d-8563-3b365524e1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:16.592961 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0718b3-8e40-474d-8563-3b365524e1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:16.661595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:16.664963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-ac0718b3-8e40-474d-8563-3b365524e1a1 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:38:16.667047 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ac0718b3-8e40-474d-8563-3b365524e1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:16.770190 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 05:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:38:17.051726 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7c4a0-5ff1-49b0-99ad-d4d15495eb36 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:17.053293 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-65e7c4a0-5ff1-49b0-99ad-d4d15495eb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:17.159663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7c4a0-5ff1-49b0-99ad-d4d15495eb36 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:17.214534 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:17.238999 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534da99-cad1-4a98-942a-224f3a2105f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:17.239596 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534da99-cad1-4a98-942a-224f3a2105f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:17.239896 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534da99-cad1-4a98-942a-224f3a2105f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:17.240158 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534da99-cad1-4a98-942a-224f3a2105f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:17.241735 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1534da99-cad1-4a98-942a-224f3a2105f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:17.354285 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534da99-cad1-4a98-942a-224f3a2105f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:17.355762 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534da99-cad1-4a98-942a-224f3a2105f1 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:17.374521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 729/1455] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:38:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:38:19.598503 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bf312-479e-472a-b220-4508aceffb05 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:19.599130 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bf312-479e-472a-b220-4508aceffb05 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:19.599130 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bf312-479e-472a-b220-4508aceffb05 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:19.600416 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 05:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:38:19.606160 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437cd67-bd67-434b-b8e1-ddc53f9412e1 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:19.606612 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437cd67-bd67-434b-b8e1-ddc53f9412e1 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:19.606733 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437cd67-bd67-434b-b8e1-ddc53f9412e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:19.675382 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-d437cd67-bd67-434b-b8e1-ddc53f9412e1 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:38:19.676609 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d437cd67-bd67-434b-b8e1-ddc53f9412e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:19.709343 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:19.779849 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 05:38:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:38:20.070610 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bf312-479e-472a-b220-4508aceffb05 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:20.072253 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f74bf312-479e-472a-b220-4508aceffb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:20.189384 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bf312-479e-472a-b220-4508aceffb05 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:20.220956 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:20.267615 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e6cbe-1250-4baf-870f-ce127943d1c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:20.268255 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e6cbe-1250-4baf-870f-ce127943d1c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:20.268530 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e6cbe-1250-4baf-870f-ce127943d1c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:20.268794 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e6cbe-1250-4baf-870f-ce127943d1c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:20.270376 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-dc3e6cbe-1250-4baf-870f-ce127943d1c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:20.382703 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e6cbe-1250-4baf-870f-ce127943d1c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:20.384252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e6cbe-1250-4baf-870f-ce127943d1c8 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:20.403543 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 728/1458] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:38:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:38:22.652729 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba165800-43e6-4347-9f30-ee9ee0a33c0e None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:22.653383 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba165800-43e6-4347-9f30-ee9ee0a33c0e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:22.653383 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba165800-43e6-4347-9f30-ee9ee0a33c0e None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:22.654690 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 05:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:38:22.660734 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e22f4e-b72a-42f8-8fe5-4eeee1d37115 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:22.661252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e22f4e-b72a-42f8-8fe5-4eeee1d37115 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:22.661367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e22f4e-b72a-42f8-8fe5-4eeee1d37115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:22.737363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-92e22f4e-b72a-42f8-8fe5-4eeee1d37115 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:38:22.738606 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-92e22f4e-b72a-42f8-8fe5-4eeee1d37115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:22.752948 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:22.857415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 05:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:38:23.141973 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba165800-43e6-4347-9f30-ee9ee0a33c0e None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:23.143534 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ba165800-43e6-4347-9f30-ee9ee0a33c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:23.253214 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba165800-43e6-4347-9f30-ee9ee0a33c0e None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:23.311792 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:23.331136 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a4149-47e6-4879-8ba9-d00da8e2f158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:23.331768 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a4149-47e6-4879-8ba9-d00da8e2f158 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:23.332061 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a4149-47e6-4879-8ba9-d00da8e2f158 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:23.332331 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a4149-47e6-4879-8ba9-d00da8e2f158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:23.333920 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1b5a4149-47e6-4879-8ba9-d00da8e2f158 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:23.445884 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a4149-47e6-4879-8ba9-d00da8e2f158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:23.447390 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a4149-47e6-4879-8ba9-d00da8e2f158 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:23.466899 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 732/1461] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:38:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:38:25.680802 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53232038-87c1-4c6c-9a30-4fea1f90e291 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:25.681419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53232038-87c1-4c6c-9a30-4fea1f90e291 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:25.681419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53232038-87c1-4c6c-9a30-4fea1f90e291 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:25.682734 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 05:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:38:25.689295 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e3ae4-a897-4c55-9e7e-96f99f7f99ea None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:25.689819 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e3ae4-a897-4c55-9e7e-96f99f7f99ea None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:25.689819 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e3ae4-a897-4c55-9e7e-96f99f7f99ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:25.762566 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-cb6e3ae4-a897-4c55-9e7e-96f99f7f99ea None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:38:25.763774 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-cb6e3ae4-a897-4c55-9e7e-96f99f7f99ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:25.804242 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:25.868448 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 05:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:38:26.163374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53232038-87c1-4c6c-9a30-4fea1f90e291 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:26.165121 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-53232038-87c1-4c6c-9a30-4fea1f90e291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:26.282727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53232038-87c1-4c6c-9a30-4fea1f90e291 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:26.325030 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:26.363147 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1b573d-0e67-4e81-b412-692bd2460599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:26.363777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b573d-0e67-4e81-b412-692bd2460599 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:26.364052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b573d-0e67-4e81-b412-692bd2460599 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:26.364313 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1b573d-0e67-4e81-b412-692bd2460599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:26.365884 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ec1b573d-0e67-4e81-b412-692bd2460599 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:26.476843 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b573d-0e67-4e81-b412-692bd2460599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:26.478332 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1b573d-0e67-4e81-b412-692bd2460599 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:26.496646 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 731/1464] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:38:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:38:28.717068 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74c43a-7342-44a1-a5ce-595252605a6d None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:28.717593 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74c43a-7342-44a1-a5ce-595252605a6d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:28.717697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74c43a-7342-44a1-a5ce-595252605a6d None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:28.719106 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 05:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:38:28.724900 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae530c25-27b2-4b4a-b329-8ffc6c50ac97 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:28.725317 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae530c25-27b2-4b4a-b329-8ffc6c50ac97 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:28.725417 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae530c25-27b2-4b4a-b329-8ffc6c50ac97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:28.794451 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-ae530c25-27b2-4b4a-b329-8ffc6c50ac97 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:38:28.795666 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ae530c25-27b2-4b4a-b329-8ffc6c50ac97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:28.814703 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:28.897159 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 05:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:38:29.175310 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff74c43a-7342-44a1-a5ce-595252605a6d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:29.176945 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ff74c43a-7342-44a1-a5ce-595252605a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:29.299292 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff74c43a-7342-44a1-a5ce-595252605a6d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:29.369269 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:29.377111 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f43580-51e1-48cd-a15a-648d64f242c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:29.377725 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f43580-51e1-48cd-a15a-648d64f242c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:29.377995 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f43580-51e1-48cd-a15a-648d64f242c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:29.378265 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f43580-51e1-48cd-a15a-648d64f242c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:29.379884 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-28f43580-51e1-48cd-a15a-648d64f242c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:29.493634 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f43580-51e1-48cd-a15a-648d64f242c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:29.494991 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f43580-51e1-48cd-a15a-648d64f242c9 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:29.514364 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 735/1467] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:38:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:38:31.700291 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc20794-c583-41d4-933f-d0bae028e72e None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:31.700906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc20794-c583-41d4-933f-d0bae028e72e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:31.700906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc20794-c583-41d4-933f-d0bae028e72e None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:31.702384 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 05:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:38:31.708128 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba70918-8abd-448a-9a4c-8762215147a0 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:31.708628 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba70918-8abd-448a-9a4c-8762215147a0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:31.708728 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba70918-8abd-448a-9a4c-8762215147a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:31.783768 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-3ba70918-8abd-448a-9a4c-8762215147a0 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:38:31.785336 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3ba70918-8abd-448a-9a4c-8762215147a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:31.837081 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:31.888268 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 05:38:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:38:32.169326 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc20794-c583-41d4-933f-d0bae028e72e None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:32.170898 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-cbc20794-c583-41d4-933f-d0bae028e72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:32.281393 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc20794-c583-41d4-933f-d0bae028e72e None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:32.334766 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:32.362131 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a08453-4ef1-428d-a61b-d61b66bfb5c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:32.362737 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a08453-4ef1-428d-a61b-d61b66bfb5c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:32.363016 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a08453-4ef1-428d-a61b-d61b66bfb5c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:32.363271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a08453-4ef1-428d-a61b-d61b66bfb5c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:32.364927 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c7a08453-4ef1-428d-a61b-d61b66bfb5c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:32.476552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a08453-4ef1-428d-a61b-d61b66bfb5c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:32.478043 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a08453-4ef1-428d-a61b-d61b66bfb5c7 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:32.497528 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 734/1470] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:38:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:38:41.886586 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=22 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:42.494859 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=66 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:52.587835 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bd32d-e731-4564-8c65-b9725ad1fe45 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:52.588288 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bd32d-e731-4564-8c65-b9725ad1fe45 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:52.588410 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bd32d-e731-4564-8c65-b9725ad1fe45 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:52.589717 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 737/1471] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:38:52.596388 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f05e0b-71d4-4fbb-a561-05756ea73eff None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:52.597146 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f05e0b-71d4-4fbb-a561-05756ea73eff None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:52.597332 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f05e0b-71d4-4fbb-a561-05756ea73eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:52.667306 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-22f05e0b-71d4-4fbb-a561-05756ea73eff None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:38:52.668563 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-22f05e0b-71d4-4fbb-a561-05756ea73eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:52.771884 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 735/1472] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:38:53.084450 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a8992-7e66-4140-8159-0b68cccf22ac None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:53.084726 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a8992-7e66-4140-8159-0b68cccf22ac None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:53.085006 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a8992-7e66-4140-8159-0b68cccf22ac None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:53.086386 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 738/1473] 10.222.0.66 () {54 vars in 962 bytes} [Mon Sep 26 05:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:38:53.091783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23284556-7604-4dbd-a314-675393aaa543 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:53.092057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23284556-7604-4dbd-a314-675393aaa543 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:53.092323 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23284556-7604-4dbd-a314-675393aaa543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:53.173106 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-23284556-7604-4dbd-a314-675393aaa543 None None] MFA Rules not processed for user `766ad3d6be374fc482a7c0bf6a1e56ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:38:53.174336 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-23284556-7604-4dbd-a314-675393aaa543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:53.197470 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:53.258847 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 736/1474] 10.222.0.66 () {58 vars in 1059 bytes} [Mon Sep 26 05:38:53 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:38:53.266827 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a8992-7e66-4140-8159-0b68cccf22ac None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:53.268416 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ce4a8992-7e66-4140-8159-0b68cccf22ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:53.382518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a8992-7e66-4140-8159-0b68cccf22ac None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:53.460117 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca467f-ccdc-4f41-96d7-dd4c982e3c54 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '766ad3d6be374fc482a7c0bf6a1e56ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:53.460721 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca467f-ccdc-4f41-96d7-dd4c982e3c54 service glance] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:53.460992 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca467f-ccdc-4f41-96d7-dd4c982e3c54 service glance] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:53.461263 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca467f-ccdc-4f41-96d7-dd4c982e3c54 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:53.462874 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a5ca467f-ccdc-4f41-96d7-dd4c982e3c54 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:53.517964 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:53.581152 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca467f-ccdc-4f41-96d7-dd4c982e3c54 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:53.582579 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca467f-ccdc-4f41-96d7-dd4c982e3c54 service glance] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:53.603153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 739/1475] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:38:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:38:55.848946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574621c3-dfb1-4d6e-8cb8-81be6926cd76 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:55.849578 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574621c3-dfb1-4d6e-8cb8-81be6926cd76 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:55.849578 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574621c3-dfb1-4d6e-8cb8-81be6926cd76 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:55.850853 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 737/1476] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:38:55.857208 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb1b42-34c4-4359-a27b-94acdf9bb12d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:55.858282 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb1b42-34c4-4359-a27b-94acdf9bb12d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:55.858282 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb1b42-34c4-4359-a27b-94acdf9bb12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:55.938018 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-3afb1b42-34c4-4359-a27b-94acdf9bb12d None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:38:55.939277 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3afb1b42-34c4-4359-a27b-94acdf9bb12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:56.055378 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 740/1477] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:38:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:38:56.329869 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574621c3-dfb1-4d6e-8cb8-81be6926cd76 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:56.331404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-574621c3-dfb1-4d6e-8cb8-81be6926cd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:56.461770 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574621c3-dfb1-4d6e-8cb8-81be6926cd76 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:56.512130 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:56.558454 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f91c93-ae6e-4b0c-b008-69392553b7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:56.559095 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f91c93-ae6e-4b0c-b008-69392553b7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:56.559368 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f91c93-ae6e-4b0c-b008-69392553b7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:56.559633 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f91c93-ae6e-4b0c-b008-69392553b7c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:56.560395 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f91c93-ae6e-4b0c-b008-69392553b7c6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:56.562162 dv-cinder-836083-14-smb devstack@keystone.service[81682]: WARNING py.warnings [None req-e6f91c93-ae6e-4b0c-b008-69392553b7c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 05:38:56.562162 dv-cinder-836083-14-smb devstack@keystone.service[81682]: warnings.warn(msg) Sep 26 05:38:56.562162 dv-cinder-836083-14-smb devstack@keystone.service[81682]: Sep 26 05:38:56.563700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f91c93-ae6e-4b0c-b008-69392553b7c6 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:56.585365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 738/1478] 10.222.0.66 () {56 vars in 1108 bytes} [Mon Sep 26 05:38:56 2022] GET /identity/v3/projects => generated 2553 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:38:58.782268 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d255de1-2994-446e-b9ab-153378cd7f08 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:58.782872 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d255de1-2994-446e-b9ab-153378cd7f08 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:58.782872 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d255de1-2994-446e-b9ab-153378cd7f08 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:58.784077 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 741/1479] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:38:58.790396 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f395fb0-f365-42f4-99d3-da9618485ac9 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:58.790900 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f395fb0-f365-42f4-99d3-da9618485ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:58.790900 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f395fb0-f365-42f4-99d3-da9618485ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:58.861386 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-0f395fb0-f365-42f4-99d3-da9618485ac9 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:38:58.862603 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0f395fb0-f365-42f4-99d3-da9618485ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:58.965599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 739/1480] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:38:59.265752 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d255de1-2994-446e-b9ab-153378cd7f08 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:38:59.267355 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7d255de1-2994-446e-b9ab-153378cd7f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:59.278893 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:59.432515 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d255de1-2994-446e-b9ab-153378cd7f08 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:38:59.530203 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:38:59.568886 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7356a-2514-46b7-81e9-16ab30c5cb32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:38:59.569508 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7356a-2514-46b7-81e9-16ab30c5cb32 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:38:59.569785 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7356a-2514-46b7-81e9-16ab30c5cb32 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:38:59.570055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7356a-2514-46b7-81e9-16ab30c5cb32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:38:59.571902 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c7a7356a-2514-46b7-81e9-16ab30c5cb32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:38:59.674917 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7356a-2514-46b7-81e9-16ab30c5cb32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:38:59.676604 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7356a-2514-46b7-81e9-16ab30c5cb32 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:38:59.699485 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 742/1481] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:38:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:39:02.151376 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a297b4-de50-4d5f-a88a-a0d48b4f2db5 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:02.151986 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a297b4-de50-4d5f-a88a-a0d48b4f2db5 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:02.151986 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a297b4-de50-4d5f-a88a-a0d48b4f2db5 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:02.153201 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 740/1482] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:39:02.159909 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe702557-dda6-4595-b8ff-caf77c4fb7bd None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:02.160383 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe702557-dda6-4595-b8ff-caf77c4fb7bd None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:02.160501 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe702557-dda6-4595-b8ff-caf77c4fb7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:02.234635 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-fe702557-dda6-4595-b8ff-caf77c4fb7bd None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:02.235914 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-fe702557-dda6-4595-b8ff-caf77c4fb7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:02.287048 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:02.347966 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 743/1483] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:39:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:02.630587 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a297b4-de50-4d5f-a88a-a0d48b4f2db5 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:02.633181 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-90a297b4-de50-4d5f-a88a-a0d48b4f2db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:02.657770 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:02.740304 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a297b4-de50-4d5f-a88a-a0d48b4f2db5 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:02.818690 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e05b40-f867-4131-bbf9-ecef03d69b40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:02.819175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e05b40-f867-4131-bbf9-ecef03d69b40 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:02.819446 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e05b40-f867-4131-bbf9-ecef03d69b40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:02.819760 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e05b40-f867-4131-bbf9-ecef03d69b40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:02.821329 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c1e05b40-f867-4131-bbf9-ecef03d69b40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:02.904469 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:02.942961 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e05b40-f867-4131-bbf9-ecef03d69b40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:02.944440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e05b40-f867-4131-bbf9-ecef03d69b40 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:02.963773 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 741/1484] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:39:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:39:05.236073 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe30677-8ace-4083-88ce-d9cf82f9ffc3 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:05.236677 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe30677-8ace-4083-88ce-d9cf82f9ffc3 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:05.236677 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe30677-8ace-4083-88ce-d9cf82f9ffc3 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:05.237942 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 744/1485] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:39:05.243984 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342eb2d-846f-4d70-9f35-4719ce1a85d7 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:05.244473 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342eb2d-846f-4d70-9f35-4719ce1a85d7 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:05.244473 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e342eb2d-846f-4d70-9f35-4719ce1a85d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:05.315144 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-e342eb2d-846f-4d70-9f35-4719ce1a85d7 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:05.316471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e342eb2d-846f-4d70-9f35-4719ce1a85d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:05.416940 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 742/1486] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:05.701225 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe30677-8ace-4083-88ce-d9cf82f9ffc3 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:05.702746 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-cfe30677-8ace-4083-88ce-d9cf82f9ffc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:05.816196 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe30677-8ace-4083-88ce-d9cf82f9ffc3 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:05.904792 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:05.906535 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c5e9a-e0a3-44cc-954a-180dcf828d29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:05.907102 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c5e9a-e0a3-44cc-954a-180dcf828d29 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:05.907387 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c5e9a-e0a3-44cc-954a-180dcf828d29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:05.907682 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c5e9a-e0a3-44cc-954a-180dcf828d29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:05.909985 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ec0c5e9a-e0a3-44cc-954a-180dcf828d29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:06.038468 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c5e9a-e0a3-44cc-954a-180dcf828d29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:06.039861 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c5e9a-e0a3-44cc-954a-180dcf828d29 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:06.059096 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 745/1487] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:39:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:39:08.353349 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b8ee0-b36b-4b57-bd8b-211d99439d21 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:08.353963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b8ee0-b36b-4b57-bd8b-211d99439d21 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:08.353963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b8ee0-b36b-4b57-bd8b-211d99439d21 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:08.355262 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 743/1488] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:39:08.360949 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9ee3b-4a52-4186-8f6d-d7048d79ba55 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:08.361429 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9ee3b-4a52-4186-8f6d-d7048d79ba55 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:08.361525 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9ee3b-4a52-4186-8f6d-d7048d79ba55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:08.434965 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-eec9ee3b-4a52-4186-8f6d-d7048d79ba55 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:08.436199 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-eec9ee3b-4a52-4186-8f6d-d7048d79ba55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:08.627007 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:08.688217 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 746/1489] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:39:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:08.984159 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b8ee0-b36b-4b57-bd8b-211d99439d21 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:08.985768 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-265b8ee0-b36b-4b57-bd8b-211d99439d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:09.025648 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:09.103448 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b8ee0-b36b-4b57-bd8b-211d99439d21 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:09.184853 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b96c61-ecdd-4005-8296-44c6d85ac186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:09.185462 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b96c61-ecdd-4005-8296-44c6d85ac186 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:09.185793 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b96c61-ecdd-4005-8296-44c6d85ac186 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:09.186013 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b96c61-ecdd-4005-8296-44c6d85ac186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:09.187971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d4b96c61-ecdd-4005-8296-44c6d85ac186 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:09.273585 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:09.304994 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b96c61-ecdd-4005-8296-44c6d85ac186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:09.306837 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b96c61-ecdd-4005-8296-44c6d85ac186 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:09.326848 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 744/1490] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:39:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:39:11.673047 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c71f0-0c20-4256-a08d-90e0d36dcbb7 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:11.673650 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c71f0-0c20-4256-a08d-90e0d36dcbb7 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:11.673650 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c71f0-0c20-4256-a08d-90e0d36dcbb7 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:11.674973 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 747/1491] 10.222.0.66 () {54 vars in 927 bytes} [Mon Sep 26 05:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:39:11.680686 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847232e-032b-43f5-8a94-e4fc262bbdd8 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:11.681129 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847232e-032b-43f5-8a94-e4fc262bbdd8 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:11.681225 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847232e-032b-43f5-8a94-e4fc262bbdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:11.752905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-9847232e-032b-43f5-8a94-e4fc262bbdd8 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:39:11.754195 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-9847232e-032b-43f5-8a94-e4fc262bbdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:11.856971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 745/1492] 10.222.0.66 () {58 vars in 1024 bytes} [Mon Sep 26 05:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:39:12.154567 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c71f0-0c20-4256-a08d-90e0d36dcbb7 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:39:12.156196 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ed2c71f0-0c20-4256-a08d-90e0d36dcbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:12.266423 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c71f0-0c20-4256-a08d-90e0d36dcbb7 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:39:12.353411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b76b4-1536-412a-be04-7c2b7a60f165 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:39:12.354016 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b76b4-1536-412a-be04-7c2b7a60f165 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:39:12.354283 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b76b4-1536-412a-be04-7c2b7a60f165 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:39:12.354546 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b76b4-1536-412a-be04-7c2b7a60f165 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:39:12.356133 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-fb5b76b4-1536-412a-be04-7c2b7a60f165 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:39:12.365606 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:12.494269 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b76b4-1536-412a-be04-7c2b7a60f165 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:39:12.495709 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5b76b4-1536-412a-be04-7c2b7a60f165 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:39:12.516222 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 748/1493] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:39:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:39:21.855527 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=82 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:39:22.513629 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=50 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:33.958110 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866a1e1-e009-48a4-936b-fd6128700b78 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:33.958701 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866a1e1-e009-48a4-936b-fd6128700b78 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:33.958701 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d866a1e1-e009-48a4-936b-fd6128700b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:34.043452 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-d866a1e1-e009-48a4-936b-fd6128700b78 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:34.044691 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d866a1e1-e009-48a4-936b-fd6128700b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:34.146675 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 746/1494] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:40:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:40:34.156222 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65a674-7550-48bf-b616-61a727b25955 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:34.157143 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65a674-7550-48bf-b616-61a727b25955 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:34.157413 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65a674-7550-48bf-b616-61a727b25955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:34.241586 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-fc65a674-7550-48bf-b616-61a727b25955 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:34.242835 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-fc65a674-7550-48bf-b616-61a727b25955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:34.362166 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 749/1495] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:40:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:40:34.367095 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866a1e1-e009-48a4-936b-fd6128700b78 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:34.368337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d866a1e1-e009-48a4-936b-fd6128700b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:34.379885 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d866a1e1-e009-48a4-936b-fd6128700b78 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:34.448039 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:34.484788 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eacbf4-26a8-4015-bcf5-23d006fc22db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:34.485393 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eacbf4-26a8-4015-bcf5-23d006fc22db admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:34.485661 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eacbf4-26a8-4015-bcf5-23d006fc22db admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:34.485923 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eacbf4-26a8-4015-bcf5-23d006fc22db admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:34.486562 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eacbf4-26a8-4015-bcf5-23d006fc22db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:40:34.486887 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eacbf4-26a8-4015-bcf5-23d006fc22db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:34.487922 dv-cinder-836083-14-smb devstack@keystone.service[81682]: WARNING py.warnings [None req-19eacbf4-26a8-4015-bcf5-23d006fc22db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 26 05:40:34.487922 dv-cinder-836083-14-smb devstack@keystone.service[81682]: warnings.warn(msg) Sep 26 05:40:34.487922 dv-cinder-836083-14-smb devstack@keystone.service[81682]: Sep 26 05:40:34.488797 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eacbf4-26a8-4015-bcf5-23d006fc22db admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:34.500613 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 747/1496] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:40:34.509009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65a674-7550-48bf-b616-61a727b25955 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:34.518432 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65a674-7550-48bf-b616-61a727b25955 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:34.583306 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:34.617632 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253cb7d-17e5-4f15-ae35-3c7c8745a96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:34.618267 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253cb7d-17e5-4f15-ae35-3c7c8745a96e admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:34.618531 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253cb7d-17e5-4f15-ae35-3c7c8745a96e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:34.618804 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a253cb7d-17e5-4f15-ae35-3c7c8745a96e admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:34.619435 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a253cb7d-17e5-4f15-ae35-3c7c8745a96e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:34.621291 dv-cinder-836083-14-smb devstack@keystone.service[81683]: WARNING py.warnings [None req-a253cb7d-17e5-4f15-ae35-3c7c8745a96e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 05:40:34.621291 dv-cinder-836083-14-smb devstack@keystone.service[81683]: warnings.warn(msg) Sep 26 05:40:34.621291 dv-cinder-836083-14-smb devstack@keystone.service[81683]: Sep 26 05:40:34.622498 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a253cb7d-17e5-4f15-ae35-3c7c8745a96e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:34.688915 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 750/1497] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:40:34 2022] POST /identity/v3/projects => generated 377 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:40:34.693475 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eacbf4-26a8-4015-bcf5-23d006fc22db admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:34.695346 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-19eacbf4-26a8-4015-bcf5-23d006fc22db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:34.733706 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eacbf4-26a8-4015-bcf5-23d006fc22db admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:34.837631 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abdc30-feb5-493a-a2de-e8a570105c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:34.838182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abdc30-feb5-493a-a2de-e8a570105c9e admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:34.838421 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abdc30-feb5-493a-a2de-e8a570105c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:34.838684 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abdc30-feb5-493a-a2de-e8a570105c9e admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:34.839322 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abdc30-feb5-493a-a2de-e8a570105c9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:34.840353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: WARNING py.warnings [None req-a4abdc30-feb5-493a-a2de-e8a570105c9e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 05:40:34.840353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: warnings.warn(msg) Sep 26 05:40:34.840353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: Sep 26 05:40:34.841558 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4abdc30-feb5-493a-a2de-e8a570105c9e admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:34.895402 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 748/1498] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:40:34 2022] POST /identity/v3/users => generated 289 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:40:34.901298 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253cb7d-17e5-4f15-ae35-3c7c8745a96e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:34.903822 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a253cb7d-17e5-4f15-ae35-3c7c8745a96e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:34.985213 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a253cb7d-17e5-4f15-ae35-3c7c8745a96e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:35.075228 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:35.087352 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705420a-573f-4b77-8ce0-0eb4eb93e468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:35.088056 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705420a-573f-4b77-8ce0-0eb4eb93e468 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:35.088274 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705420a-573f-4b77-8ce0-0eb4eb93e468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:35.088540 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705420a-573f-4b77-8ce0-0eb4eb93e468 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:35.089187 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705420a-573f-4b77-8ce0-0eb4eb93e468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:35.090214 dv-cinder-836083-14-smb devstack@keystone.service[81683]: WARNING py.warnings [None req-4705420a-573f-4b77-8ce0-0eb4eb93e468 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 26 05:40:35.090214 dv-cinder-836083-14-smb devstack@keystone.service[81683]: warnings.warn(msg) Sep 26 05:40:35.090214 dv-cinder-836083-14-smb devstack@keystone.service[81683]: Sep 26 05:40:35.091106 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705420a-573f-4b77-8ce0-0eb4eb93e468 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:35.104465 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 751/1499] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:40:34 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:40:35.109929 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abdc30-feb5-493a-a2de-e8a570105c9e admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:35.112431 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a4abdc30-feb5-493a-a2de-e8a570105c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:35.127308 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abdc30-feb5-493a-a2de-e8a570105c9e admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:35.157017 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:35.238626 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a79d9-fb0d-4f52-a3e1-92a70554ff95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:35.239225 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a79d9-fb0d-4f52-a3e1-92a70554ff95 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:35.239492 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a79d9-fb0d-4f52-a3e1-92a70554ff95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:35.239763 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a79d9-fb0d-4f52-a3e1-92a70554ff95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:35.240411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a79d9-fb0d-4f52-a3e1-92a70554ff95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:35.241420 dv-cinder-836083-14-smb devstack@keystone.service[81682]: WARNING py.warnings [None req-f93a79d9-fb0d-4f52-a3e1-92a70554ff95 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 26 05:40:35.241420 dv-cinder-836083-14-smb devstack@keystone.service[81682]: warnings.warn(msg) Sep 26 05:40:35.241420 dv-cinder-836083-14-smb devstack@keystone.service[81682]: Sep 26 05:40:35.242300 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a79d9-fb0d-4f52-a3e1-92a70554ff95 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:35.255824 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 749/1500] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:40:35 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:40:35.261120 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705420a-573f-4b77-8ce0-0eb4eb93e468 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:35.262724 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4705420a-573f-4b77-8ce0-0eb4eb93e468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:35.302809 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705420a-573f-4b77-8ce0-0eb4eb93e468 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:35.406260 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef13e1-2aa5-4c4a-9738-22a5f64d380c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:35.406834 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef13e1-2aa5-4c4a-9738-22a5f64d380c admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:35.407104 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef13e1-2aa5-4c4a-9738-22a5f64d380c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:35.407373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef13e1-2aa5-4c4a-9738-22a5f64d380c admin admin] PATH_INFO: `/v3/projects/674060c2ca964c199ab0568ceae5e6ed/users/f1d96f1245df415095e6be41b2681b41/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:35.432170 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef13e1-2aa5-4c4a-9738-22a5f64d380c admin admin] RBAC: Authorizing `identity:create_grant(project_id=674060c2ca964c199ab0568ceae5e6ed, user_id=f1d96f1245df415095e6be41b2681b41, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:35.433223 dv-cinder-836083-14-smb devstack@keystone.service[81683]: WARNING py.warnings [None req-3fef13e1-2aa5-4c4a-9738-22a5f64d380c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 05:40:35.433223 dv-cinder-836083-14-smb devstack@keystone.service[81683]: warnings.warn(msg) Sep 26 05:40:35.433223 dv-cinder-836083-14-smb devstack@keystone.service[81683]: Sep 26 05:40:35.435539 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef13e1-2aa5-4c4a-9738-22a5f64d380c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:35.463325 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 752/1501] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:40:35 2022] PUT /identity/v3/projects/674060c2ca964c199ab0568ceae5e6ed/users/f1d96f1245df415095e6be41b2681b41/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:40:35.476374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f887785-b5c5-4257-88f4-1366ed7bee1c None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:35.476670 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f887785-b5c5-4257-88f4-1366ed7bee1c None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:35.477083 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f887785-b5c5-4257-88f4-1366ed7bee1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:35.538291 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-8f887785-b5c5-4257-88f4-1366ed7bee1c None None] MFA Rules not processed for user `f1d96f1245df415095e6be41b2681b41`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:35.539542 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-8f887785-b5c5-4257-88f4-1366ed7bee1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:35.627809 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 750/1502] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:40:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:40:35.641755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db29723-bca3-48a4-b142-a39565de7e66 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:35.642032 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db29723-bca3-48a4-b142-a39565de7e66 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:35.642317 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db29723-bca3-48a4-b142-a39565de7e66 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:35.643681 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 753/1503] 10.222.0.66 () {54 vars in 963 bytes} [Mon Sep 26 05:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:40:35.649143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af8a44-2041-4790-8b8e-8cf43f651e5f None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:35.649426 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af8a44-2041-4790-8b8e-8cf43f651e5f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:35.649692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af8a44-2041-4790-8b8e-8cf43f651e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:35.686380 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:35.738205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-c2af8a44-2041-4790-8b8e-8cf43f651e5f None None] MFA Rules not processed for user `842ef2c8cd794023ac29bd03c768986b`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:35.739424 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c2af8a44-2041-4790-8b8e-8cf43f651e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:35.837624 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 751/1504] 10.222.0.66 () {58 vars in 1060 bytes} [Mon Sep 26 05:40:35 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:40:35.852941 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db29723-bca3-48a4-b142-a39565de7e66 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:35.854457 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2db29723-bca3-48a4-b142-a39565de7e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:35.908604 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:35.968785 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db29723-bca3-48a4-b142-a39565de7e66 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:36.054941 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba657a76-9827-4cc3-929f-6bd6f682379a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:36.055779 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba657a76-9827-4cc3-929f-6bd6f682379a service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:36.056228 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba657a76-9827-4cc3-929f-6bd6f682379a service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:36.056595 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba657a76-9827-4cc3-929f-6bd6f682379a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:36.058588 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ba657a76-9827-4cc3-929f-6bd6f682379a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:36.174478 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba657a76-9827-4cc3-929f-6bd6f682379a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:36.176138 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba657a76-9827-4cc3-929f-6bd6f682379a service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:36.180494 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:36.198088 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 754/1505] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:40:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:40:36.251572 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab4d0f-8a1b-4e76-abc0-2eaa8e3df5ea None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:36.252082 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab4d0f-8a1b-4e76-abc0-2eaa8e3df5ea None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:36.252204 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab4d0f-8a1b-4e76-abc0-2eaa8e3df5ea None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:36.253457 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 752/1506] 10.222.0.66 () {52 vars in 830 bytes} [Mon Sep 26 05:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:40:36.257413 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba657a76-9827-4cc3-929f-6bd6f682379a service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:36.258663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ba657a76-9827-4cc3-929f-6bd6f682379a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:36.371195 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba657a76-9827-4cc3-929f-6bd6f682379a service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:36.468359 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dddc40-f460-49e8-9699-f1c69b239431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:36.468986 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dddc40-f460-49e8-9699-f1c69b239431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:36.469252 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dddc40-f460-49e8-9699-f1c69b239431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:36.469517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dddc40-f460-49e8-9699-f1c69b239431 admin admin] PATH_INFO: `/v3/users/f1d96f1245df415095e6be41b2681b41` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:36.483590 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dddc40-f460-49e8-9699-f1c69b239431 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1d96f1245df415095e6be41b2681b41)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:36.484580 dv-cinder-836083-14-smb devstack@keystone.service[81683]: WARNING py.warnings [None req-b7dddc40-f460-49e8-9699-f1c69b239431 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 05:40:36.484580 dv-cinder-836083-14-smb devstack@keystone.service[81683]: warnings.warn(msg) Sep 26 05:40:36.484580 dv-cinder-836083-14-smb devstack@keystone.service[81683]: Sep 26 05:40:36.485792 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dddc40-f460-49e8-9699-f1c69b239431 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:36.496200 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:36.556674 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b7dddc40-f460-49e8-9699-f1c69b239431 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1d96f1245df415095e6be41b2681b41'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:36.567418 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b7dddc40-f460-49e8-9699-f1c69b239431 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1d96f1245df415095e6be41b2681b41'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:36.567858 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b7dddc40-f460-49e8-9699-f1c69b239431 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1d96f1245df415095e6be41b2681b41'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:36.594758 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b7dddc40-f460-49e8-9699-f1c69b239431 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1d96f1245df415095e6be41b2681b41'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:36.609920 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-b7dddc40-f460-49e8-9699-f1c69b239431 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1d96f1245df415095e6be41b2681b41'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:36.616342 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 755/1507] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:40:36 2022] DELETE /identity/v3/users/f1d96f1245df415095e6be41b2681b41 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:40:36.621009 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764fc0f-1376-4d97-8ae8-c110f9e36d1b None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:36.621285 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764fc0f-1376-4d97-8ae8-c110f9e36d1b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:36.621548 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1764fc0f-1376-4d97-8ae8-c110f9e36d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:36.683107 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-1764fc0f-1376-4d97-8ae8-c110f9e36d1b None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:40:36.684328 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1764fc0f-1376-4d97-8ae8-c110f9e36d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:36.768216 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:36.782444 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 753/1508] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:40:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:40:36.792564 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dddc40-f460-49e8-9699-f1c69b239431 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:36.793979 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b7dddc40-f460-49e8-9699-f1c69b239431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:36.900463 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dddc40-f460-49e8-9699-f1c69b239431 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:36.981491 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:37.004560 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18fe268-5a9b-4a08-b684-fcf01949d891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:37.005186 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fe268-5a9b-4a08-b684-fcf01949d891 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:37.005458 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fe268-5a9b-4a08-b684-fcf01949d891 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:37.005721 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fe268-5a9b-4a08-b684-fcf01949d891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:37.007374 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f18fe268-5a9b-4a08-b684-fcf01949d891 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:37.121288 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18fe268-5a9b-4a08-b684-fcf01949d891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:37.122645 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18fe268-5a9b-4a08-b684-fcf01949d891 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:37.141554 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 756/1509] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:40:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:40:37.515890 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764fc0f-1376-4d97-8ae8-c110f9e36d1b None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:40:37.517196 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1764fc0f-1376-4d97-8ae8-c110f9e36d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:40:37.528816 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1764fc0f-1376-4d97-8ae8-c110f9e36d1b None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:40:37.627985 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3142f-c5d9-42c1-8bdc-36637366fb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:40:37.628620 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3142f-c5d9-42c1-8bdc-36637366fb82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:40:37.628899 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3142f-c5d9-42c1-8bdc-36637366fb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:40:37.629169 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3142f-c5d9-42c1-8bdc-36637366fb82 admin admin] PATH_INFO: `/v3/projects/674060c2ca964c199ab0568ceae5e6ed` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:40:37.639162 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3142f-c5d9-42c1-8bdc-36637366fb82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=674060c2ca964c199ab0568ceae5e6ed)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:40:37.640223 dv-cinder-836083-14-smb devstack@keystone.service[81682]: WARNING py.warnings [None req-63b3142f-c5d9-42c1-8bdc-36637366fb82 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 05:40:37.640223 dv-cinder-836083-14-smb devstack@keystone.service[81682]: warnings.warn(msg) Sep 26 05:40:37.640223 dv-cinder-836083-14-smb devstack@keystone.service[81682]: Sep 26 05:40:37.641466 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3142f-c5d9-42c1-8bdc-36637366fb82 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:40:37.717639 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-63b3142f-c5d9-42c1-8bdc-36637366fb82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '674060c2ca964c199ab0568ceae5e6ed', 'request_id': 'req-63b3142f-c5d9-42c1-8bdc-36637366fb82'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:37.728389 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-63b3142f-c5d9-42c1-8bdc-36637366fb82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '674060c2ca964c199ab0568ceae5e6ed', 'request_id': 'req-63b3142f-c5d9-42c1-8bdc-36637366fb82'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:37.735775 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-63b3142f-c5d9-42c1-8bdc-36637366fb82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '674060c2ca964c199ab0568ceae5e6ed', 'request_id': 'req-63b3142f-c5d9-42c1-8bdc-36637366fb82'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:37.765961 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-63b3142f-c5d9-42c1-8bdc-36637366fb82 admin admin] The token cache is being invalidate because project 674060c2ca964c199ab0568ceae5e6ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:40:37.766221 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-63b3142f-c5d9-42c1-8bdc-36637366fb82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:37.766659 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-63b3142f-c5d9-42c1-8bdc-36637366fb82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:40:37.768111 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 754/1510] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:40:37 2022] DELETE /identity/v3/projects/674060c2ca964c199ab0568ceae5e6ed => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:40:47.139141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=62 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:40:47.764014 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:42:18.013156 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1c86f-2040-4d24-abae-834e34c3651f None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:42:18.013768 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1c86f-2040-4d24-abae-834e34c3651f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:42:18.013768 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1c86f-2040-4d24-abae-834e34c3651f None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:42:18.015110 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 05:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:42:18.021366 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb426336-4d44-44ff-8eee-d17114918c3e None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:42:18.021897 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb426336-4d44-44ff-8eee-d17114918c3e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:42:18.021897 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb426336-4d44-44ff-8eee-d17114918c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:42:18.114347 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-fb426336-4d44-44ff-8eee-d17114918c3e None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:42:18.115678 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-fb426336-4d44-44ff-8eee-d17114918c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:42:18.243656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 05:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:42:18.400212 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1c86f-2040-4d24-abae-834e34c3651f None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:42:18.403030 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-48d1c86f-2040-4d24-abae-834e34c3651f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:42:18.539939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1c86f-2040-4d24-abae-834e34c3651f None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:42:18.546989 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3a0b3-f312-46cd-90d7-079b70c2646b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:42:18.547660 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3a0b3-f312-46cd-90d7-079b70c2646b service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:42:18.547901 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3a0b3-f312-46cd-90d7-079b70c2646b service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:42:18.548168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3a0b3-f312-46cd-90d7-079b70c2646b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:42:18.557673 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d3a0b3-f312-46cd-90d7-079b70c2646b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:42:18.559354 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d3a0b3-f312-46cd-90d7-079b70c2646b service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:42:18.569658 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 758/1513] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:42:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:42:19.668304 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b9f49-37dd-4f61-86db-46130299716f None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:42:19.668915 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b9f49-37dd-4f61-86db-46130299716f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:42:19.668915 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b9f49-37dd-4f61-86db-46130299716f None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:42:19.670437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 05:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:42:19.677767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc300c1-eea2-478d-82bd-f55817fdae94 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:42:19.678354 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc300c1-eea2-478d-82bd-f55817fdae94 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:42:19.678354 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc300c1-eea2-478d-82bd-f55817fdae94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:42:19.699347 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-abc300c1-eea2-478d-82bd-f55817fdae94 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:42:19.700570 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-abc300c1-eea2-478d-82bd-f55817fdae94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:42:19.709577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 05:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:42:19.863201 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b9f49-37dd-4f61-86db-46130299716f None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:42:19.879257 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b9f49-37dd-4f61-86db-46130299716f None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:42:19.885243 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac657fcc-0ae5-4927-8796-25e8009f5f4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:42:19.885827 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac657fcc-0ae5-4927-8796-25e8009f5f4f service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:42:19.886116 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac657fcc-0ae5-4927-8796-25e8009f5f4f service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:42:19.886382 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac657fcc-0ae5-4927-8796-25e8009f5f4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:42:19.894873 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac657fcc-0ae5-4927-8796-25e8009f5f4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:42:19.896493 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac657fcc-0ae5-4927-8796-25e8009f5f4f service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:42:19.906324 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 757/1516] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:42:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:42:20.097337 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e295ac1-6998-4fc2-9f77-3e999533ae88 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:42:20.097616 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e295ac1-6998-4fc2-9f77-3e999533ae88 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:42:20.097864 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e295ac1-6998-4fc2-9f77-3e999533ae88 None None] PATH_INFO: `/v3` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:42:20.099150 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 760/1517] 10.222.0.26 () {54 vars in 925 bytes} [Mon Sep 26 05:42:20 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:42:20.105931 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85607dae-7402-450b-b817-32aab4e697dd None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:42:20.106211 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85607dae-7402-450b-b817-32aab4e697dd None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:42:20.106477 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85607dae-7402-450b-b817-32aab4e697dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:42:20.174197 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-85607dae-7402-450b-b817-32aab4e697dd None None] MFA Rules not processed for user `895edcfb20484b188a3877c9de8b59c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:42:20.175395 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-85607dae-7402-450b-b817-32aab4e697dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:42:20.194041 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:42:20.254123 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 758/1518] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Sep 26 05:42:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:42:29.694087 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=56 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:42:30.070425 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a34848-eef3-4638-9e3c-84a8c5124207 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:42:30.070716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a34848-eef3-4638-9e3c-84a8c5124207 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:42:30.071004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a34848-eef3-4638-9e3c-84a8c5124207 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:42:30.072475 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 761/1519] 10.222.0.66 () {54 vars in 961 bytes} [Mon Sep 26 05:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:42:30.077982 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7e850-0312-48a2-8e4f-f9b3faf05824 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:42:30.078571 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7e850-0312-48a2-8e4f-f9b3faf05824 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:42:30.078571 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d7e850-0312-48a2-8e4f-f9b3faf05824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:42:30.099840 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-f3d7e850-0312-48a2-8e4f-f9b3faf05824 None None] MFA Rules not processed for user `895edcfb20484b188a3877c9de8b59c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:42:30.101032 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f3d7e850-0312-48a2-8e4f-f9b3faf05824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:42:30.110502 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 759/1520] 10.222.0.66 () {58 vars in 1058 bytes} [Mon Sep 26 05:42:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:42:30.119010 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a34848-eef3-4638-9e3c-84a8c5124207 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:42:30.135584 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a34848-eef3-4638-9e3c-84a8c5124207 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:42:30.141368 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363bfd41-a1e2-4d7a-a186-50afc71fc0ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895edcfb20484b188a3877c9de8b59c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:42:30.141963 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bfd41-a1e2-4d7a-a186-50afc71fc0ad service placement] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:42:30.142221 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bfd41-a1e2-4d7a-a186-50afc71fc0ad service placement] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:42:30.142483 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bfd41-a1e2-4d7a-a186-50afc71fc0ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:42:30.151510 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363bfd41-a1e2-4d7a-a186-50afc71fc0ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:42:30.153151 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363bfd41-a1e2-4d7a-a186-50afc71fc0ad service placement] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:42:30.162630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 762/1521] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:42:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:42:31.439690 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b77a9-2403-4ed8-8f48-43bd3214af9f None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:42:31.440301 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b77a9-2403-4ed8-8f48-43bd3214af9f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:42:31.440301 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b77a9-2403-4ed8-8f48-43bd3214af9f None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:42:31.441651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 05:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:42:31.448922 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dcf34-46b3-4df8-bb1c-79e8520ecac0 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:42:31.449399 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dcf34-46b3-4df8-bb1c-79e8520ecac0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:42:31.449501 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0dcf34-46b3-4df8-bb1c-79e8520ecac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:42:31.469430 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-fb0dcf34-46b3-4df8-bb1c-79e8520ecac0 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:42:31.470626 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-fb0dcf34-46b3-4df8-bb1c-79e8520ecac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:42:31.478803 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 05:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:42:31.632901 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b77a9-2403-4ed8-8f48-43bd3214af9f None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:42:31.650355 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b77a9-2403-4ed8-8f48-43bd3214af9f None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:42:31.656391 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f3752-e123-481c-8f70-a463dba08cac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:42:31.657066 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f3752-e123-481c-8f70-a463dba08cac service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:42:31.657335 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f3752-e123-481c-8f70-a463dba08cac service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:42:31.657598 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f3752-e123-481c-8f70-a463dba08cac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:42:31.666320 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f3752-e123-481c-8f70-a463dba08cac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:42:31.667922 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f3752-e123-481c-8f70-a463dba08cac service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:42:31.677636 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 761/1524] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:42:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:42:32.776752 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43141f91-e75f-40d0-bc70-10781e9a9b0b None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:42:32.777294 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43141f91-e75f-40d0-bc70-10781e9a9b0b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:42:32.777294 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43141f91-e75f-40d0-bc70-10781e9a9b0b None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:42:32.778641 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Sep 26 05:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:42:32.785338 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e3538-58f4-43e9-8887-7117b1ea406e None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:42:32.785871 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e3538-58f4-43e9-8887-7117b1ea406e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:42:32.785871 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e3538-58f4-43e9-8887-7117b1ea406e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:42:32.809091 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-315e3538-58f4-43e9-8887-7117b1ea406e None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:42:32.810407 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-315e3538-58f4-43e9-8887-7117b1ea406e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:42:32.819979 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Sep 26 05:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:42:32.974976 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43141f91-e75f-40d0-bc70-10781e9a9b0b None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:42:32.991972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43141f91-e75f-40d0-bc70-10781e9a9b0b None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:42:32.999784 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d71f9-32bf-4942-ba74-38785c68bde6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:42:33.000417 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d71f9-32bf-4942-ba74-38785c68bde6 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:42:33.000687 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d71f9-32bf-4942-ba74-38785c68bde6 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:42:33.000961 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d71f9-32bf-4942-ba74-38785c68bde6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:42:33.010512 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d71f9-32bf-4942-ba74-38785c68bde6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:42:33.012161 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d71f9-32bf-4942-ba74-38785c68bde6 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:42:33.022884 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 765/1527] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:42:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:42:37.074574 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470442f-f6c3-494b-ad57-2c960bbd7637 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:42:37.075141 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470442f-f6c3-494b-ad57-2c960bbd7637 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:42:37.075141 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d470442f-f6c3-494b-ad57-2c960bbd7637 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:42:37.076438 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 05:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:42:37.081984 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b2c38-78d6-455b-86aa-30f9878a6e09 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:42:37.082447 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b2c38-78d6-455b-86aa-30f9878a6e09 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:42:37.082561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b2c38-78d6-455b-86aa-30f9878a6e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:42:37.102742 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-011b2c38-78d6-455b-86aa-30f9878a6e09 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:42:37.103967 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-011b2c38-78d6-455b-86aa-30f9878a6e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:42:37.112427 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 05:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:42:37.404997 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470442f-f6c3-494b-ad57-2c960bbd7637 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:42:37.408140 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d470442f-f6c3-494b-ad57-2c960bbd7637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:42:37.496337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d470442f-f6c3-494b-ad57-2c960bbd7637 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:42:37.502078 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0247106-1603-419c-bca0-5d20e3d49443 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:42:37.502892 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0247106-1603-419c-bca0-5d20e3d49443 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:42:37.503175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0247106-1603-419c-bca0-5d20e3d49443 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:42:37.503498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0247106-1603-419c-bca0-5d20e3d49443 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:42:37.514208 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0247106-1603-419c-bca0-5d20e3d49443 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:42:37.515676 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0247106-1603-419c-bca0-5d20e3d49443 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:42:37.525579 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 764/1530] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:42:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:42:39.656564 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d885f1a-339a-42ff-b4ed-189c7e9f1e79 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:42:39.657408 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d885f1a-339a-42ff-b4ed-189c7e9f1e79 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:42:39.657408 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d885f1a-339a-42ff-b4ed-189c7e9f1e79 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:42:39.659376 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 05:42:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:42:39.664923 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83c6d5-628d-45e4-86ae-a3090ccf075c None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:42:39.665379 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83c6d5-628d-45e4-86ae-a3090ccf075c None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:42:39.665507 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83c6d5-628d-45e4-86ae-a3090ccf075c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:42:39.686197 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-fe83c6d5-628d-45e4-86ae-a3090ccf075c None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:42:39.687381 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-fe83c6d5-628d-45e4-86ae-a3090ccf075c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:42:39.695492 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 05:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:42:39.982658 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d885f1a-339a-42ff-b4ed-189c7e9f1e79 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:42:40.001606 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d885f1a-339a-42ff-b4ed-189c7e9f1e79 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:42:40.007933 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d54470-a630-43e6-82f1-1a43df1e9050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:42:40.008827 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d54470-a630-43e6-82f1-1a43df1e9050 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:42:40.009178 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d54470-a630-43e6-82f1-1a43df1e9050 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:42:40.009528 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d54470-a630-43e6-82f1-1a43df1e9050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:42:40.021237 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d54470-a630-43e6-82f1-1a43df1e9050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:42:40.022673 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d54470-a630-43e6-82f1-1a43df1e9050 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:42:40.032832 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 768/1533] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:42:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:42:43.747511 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ecda7a-04eb-4175-aa77-b0bc01adf078 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:42:43.748175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ecda7a-04eb-4175-aa77-b0bc01adf078 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:42:43.748175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ecda7a-04eb-4175-aa77-b0bc01adf078 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:42:43.749409 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 05:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:42:43.755624 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf94aa2-aba9-4f0d-97b3-d858f7dd67e0 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:42:43.756123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf94aa2-aba9-4f0d-97b3-d858f7dd67e0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:42:43.756225 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf94aa2-aba9-4f0d-97b3-d858f7dd67e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:42:43.779620 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-dcf94aa2-aba9-4f0d-97b3-d858f7dd67e0 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:42:43.780871 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-dcf94aa2-aba9-4f0d-97b3-d858f7dd67e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:42:43.789541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 05:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:42:44.094182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ecda7a-04eb-4175-aa77-b0bc01adf078 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:42:44.096313 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-74ecda7a-04eb-4175-aa77-b0bc01adf078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:42:44.166886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:42:44.181125 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ecda7a-04eb-4175-aa77-b0bc01adf078 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:42:44.185177 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d175f-7689-48b6-b61d-45d8e3e48339 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:42:44.185799 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d175f-7689-48b6-b61d-45d8e3e48339 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:42:44.186068 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d175f-7689-48b6-b61d-45d8e3e48339 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:42:44.186329 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d175f-7689-48b6-b61d-45d8e3e48339 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:42:44.197398 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d175f-7689-48b6-b61d-45d8e3e48339 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:42:44.198824 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d175f-7689-48b6-b61d-45d8e3e48339 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:42:44.209537 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 767/1536] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:42:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:42:46.359414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea926a-5def-4351-a105-260a9e5f08ef None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:42:46.360063 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea926a-5def-4351-a105-260a9e5f08ef None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:42:46.360063 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea926a-5def-4351-a105-260a9e5f08ef None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:42:46.361336 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Sep 26 05:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:42:46.367461 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d16827-30a8-42bb-bdc9-ad1430e833b1 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:42:46.367949 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d16827-30a8-42bb-bdc9-ad1430e833b1 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:42:46.368063 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d16827-30a8-42bb-bdc9-ad1430e833b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:42:46.395784 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-92d16827-30a8-42bb-bdc9-ad1430e833b1 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:42:46.397005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-92d16827-30a8-42bb-bdc9-ad1430e833b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:42:46.406496 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Sep 26 05:42:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:42:46.709231 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea926a-5def-4351-a105-260a9e5f08ef None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:42:46.711545 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-aeea926a-5def-4351-a105-260a9e5f08ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:42:46.731360 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea926a-5def-4351-a105-260a9e5f08ef None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:42:46.735516 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb2ad0-f157-4e3c-bc9d-55db4932da9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:42:46.736155 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb2ad0-f157-4e3c-bc9d-55db4932da9d service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:42:46.736439 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb2ad0-f157-4e3c-bc9d-55db4932da9d service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:42:46.736704 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb2ad0-f157-4e3c-bc9d-55db4932da9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:42:46.746473 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb2ad0-f157-4e3c-bc9d-55db4932da9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:42:46.747927 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb2ad0-f157-4e3c-bc9d-55db4932da9d service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:42:46.758047 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 771/1539] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:42:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:42:56.390565 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=11 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:42:56.753421 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=33 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:25.534226 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c656d-68ed-4608-be64-351b74d9795a None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:25.535250 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c656d-68ed-4608-be64-351b74d9795a None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:25.535250 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c656d-68ed-4608-be64-351b74d9795a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:25.564341 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-a46c656d-68ed-4608-be64-351b74d9795a None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:25.565602 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a46c656d-68ed-4608-be64-351b74d9795a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:25.579032 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 769/1540] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:44:25.590378 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c365445-511f-4c31-8e00-ccaedb0b8311 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:25.592902 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c365445-511f-4c31-8e00-ccaedb0b8311 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:25.593495 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163c006-81ca-49f1-a675-0a576f3d239c None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:25.593798 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163c006-81ca-49f1-a675-0a576f3d239c None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:25.594124 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163c006-81ca-49f1-a675-0a576f3d239c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:25.594717 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c365445-511f-4c31-8e00-ccaedb0b8311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:25.633229 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-1163c006-81ca-49f1-a675-0a576f3d239c None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:25.634566 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1163c006-81ca-49f1-a675-0a576f3d239c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:25.648717 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-4c365445-511f-4c31-8e00-ccaedb0b8311 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:25.651612 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4c365445-511f-4c31-8e00-ccaedb0b8311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:25.656864 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 770/1541] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:44:25.663710 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f314b3-5f80-484b-971f-cab1f0ffb94f None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:25.664072 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f314b3-5f80-484b-971f-cab1f0ffb94f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:25.664393 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f314b3-5f80-484b-971f-cab1f0ffb94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:25.679638 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 772/1542] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:25.685024 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c365445-511f-4c31-8e00-ccaedb0b8311 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:25.715181 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c365445-511f-4c31-8e00-ccaedb0b8311 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:25.728195 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902845e-dacc-4eb8-b019-e05bbf46aa80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:25.729775 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902845e-dacc-4eb8-b019-e05bbf46aa80 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:25.730561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902845e-dacc-4eb8-b019-e05bbf46aa80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:25.731303 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902845e-dacc-4eb8-b019-e05bbf46aa80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:25.733035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7902845e-dacc-4eb8-b019-e05bbf46aa80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:44:25.733259 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-33f314b3-5f80-484b-971f-cab1f0ffb94f None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:25.734110 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7902845e-dacc-4eb8-b019-e05bbf46aa80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:25.735147 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-33f314b3-5f80-484b-971f-cab1f0ffb94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:25.736872 dv-cinder-836083-14-smb devstack@keystone.service[81683]: WARNING py.warnings [None req-7902845e-dacc-4eb8-b019-e05bbf46aa80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 26 05:44:25.736872 dv-cinder-836083-14-smb devstack@keystone.service[81683]: warnings.warn(msg) Sep 26 05:44:25.736872 dv-cinder-836083-14-smb devstack@keystone.service[81683]: Sep 26 05:44:25.739256 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7902845e-dacc-4eb8-b019-e05bbf46aa80 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:25.762939 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 771/1543] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:44:25.764668 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74208e4-e379-4066-b6ff-f7edfd9f4609 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:25.765044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74208e4-e379-4066-b6ff-f7edfd9f4609 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:25.765219 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74208e4-e379-4066-b6ff-f7edfd9f4609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:25.789286 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 773/1544] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:44:25.791466 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902845e-dacc-4eb8-b019-e05bbf46aa80 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:25.815587 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-d74208e4-e379-4066-b6ff-f7edfd9f4609 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:25.816992 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d74208e4-e379-4066-b6ff-f7edfd9f4609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:25.819583 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902845e-dacc-4eb8-b019-e05bbf46aa80 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:25.837778 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdeba4-9514-41aa-a032-4e00d3763ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:25.839605 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdeba4-9514-41aa-a032-4e00d3763ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:25.840406 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdeba4-9514-41aa-a032-4e00d3763ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:25.841191 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdeba4-9514-41aa-a032-4e00d3763ae6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:25.842708 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdeba4-9514-41aa-a032-4e00d3763ae6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:44:25.843579 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdeba4-9514-41aa-a032-4e00d3763ae6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:25.851782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdeba4-9514-41aa-a032-4e00d3763ae6 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:25.855557 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 772/1545] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:25.857956 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74208e4-e379-4066-b6ff-f7edfd9f4609 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:25.900232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74208e4-e379-4066-b6ff-f7edfd9f4609 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:25.902430 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 774/1546] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:44:25.907227 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdbc73-7f82-4651-8c1d-52916ac4b271 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:25.912414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdbc73-7f82-4651-8c1d-52916ac4b271 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:25.913354 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdbc73-7f82-4651-8c1d-52916ac4b271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:25.925036 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd0ad1-01f6-40d8-962e-848d57ad1d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:25.926182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd0ad1-01f6-40d8-962e-848d57ad1d7f admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:25.927211 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd0ad1-01f6-40d8-962e-848d57ad1d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:25.927699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd0ad1-01f6-40d8-962e-848d57ad1d7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:25.935335 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd0ad1-01f6-40d8-962e-848d57ad1d7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:25.935335 dv-cinder-836083-14-smb devstack@keystone.service[81682]: WARNING py.warnings [None req-51cd0ad1-01f6-40d8-962e-848d57ad1d7f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 05:44:25.935335 dv-cinder-836083-14-smb devstack@keystone.service[81682]: warnings.warn(msg) Sep 26 05:44:25.935335 dv-cinder-836083-14-smb devstack@keystone.service[81682]: Sep 26 05:44:25.935335 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd0ad1-01f6-40d8-962e-848d57ad1d7f admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:25.968506 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-becdbc73-7f82-4651-8c1d-52916ac4b271 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:25.975645 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-becdbc73-7f82-4651-8c1d-52916ac4b271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:26.005360 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 775/1547] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:26.007479 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becdbc73-7f82-4651-8c1d-52916ac4b271 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:26.034644 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becdbc73-7f82-4651-8c1d-52916ac4b271 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:26.047383 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456edd9e-4f50-46cc-b72d-8de09b6bc3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:26.048174 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456edd9e-4f50-46cc-b72d-8de09b6bc3b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:26.049472 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456edd9e-4f50-46cc-b72d-8de09b6bc3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:26.050141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456edd9e-4f50-46cc-b72d-8de09b6bc3b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:26.050566 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456edd9e-4f50-46cc-b72d-8de09b6bc3b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:26.054142 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456edd9e-4f50-46cc-b72d-8de09b6bc3b0 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:26.098963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 773/1548] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:44:25 2022] POST /identity/v3/projects => generated 379 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:44:26.100572 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd0ad1-01f6-40d8-962e-848d57ad1d7f admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:26.106899 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 776/1549] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:44:26 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:44:26.108715 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7914d-72f5-4a15-b013-ec222f779069 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:26.109058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7914d-72f5-4a15-b013-ec222f779069 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:26.109294 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7914d-72f5-4a15-b013-ec222f779069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:26.193782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-3fd7914d-72f5-4a15-b013-ec222f779069 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:26.195122 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3fd7914d-72f5-4a15-b013-ec222f779069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:26.283855 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 777/1550] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:26.284995 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300d051-6f42-42e5-bdf2-74fa97dd10a0 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:26.285462 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300d051-6f42-42e5-bdf2-74fa97dd10a0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:26.292319 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8300d051-6f42-42e5-bdf2-74fa97dd10a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:26.320445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-8300d051-6f42-42e5-bdf2-74fa97dd10a0 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:26.321703 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8300d051-6f42-42e5-bdf2-74fa97dd10a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:26.333558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 778/1551] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:26.334428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300d051-6f42-42e5-bdf2-74fa97dd10a0 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:26.345609 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd0ad1-01f6-40d8-962e-848d57ad1d7f admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:26.346627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8300d051-6f42-42e5-bdf2-74fa97dd10a0 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:26.352878 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f2690-a16c-4f4d-82a0-688eb0ab497c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:26.354257 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f2690-a16c-4f4d-82a0-688eb0ab497c admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:26.354546 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f2690-a16c-4f4d-82a0-688eb0ab497c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:26.354823 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f2690-a16c-4f4d-82a0-688eb0ab497c admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:26.355515 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f2690-a16c-4f4d-82a0-688eb0ab497c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:26.357193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604bc4ab-e7ff-4925-89c7-b2bdfca825d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:26.357442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: WARNING py.warnings [None req-738f2690-a16c-4f4d-82a0-688eb0ab497c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 05:44:26.357442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: warnings.warn(msg) Sep 26 05:44:26.357442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: Sep 26 05:44:26.358574 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f2690-a16c-4f4d-82a0-688eb0ab497c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:26.359425 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bc4ab-e7ff-4925-89c7-b2bdfca825d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:26.360301 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bc4ab-e7ff-4925-89c7-b2bdfca825d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:26.361112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604bc4ab-e7ff-4925-89c7-b2bdfca825d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:26.362663 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604bc4ab-e7ff-4925-89c7-b2bdfca825d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:44:26.363525 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604bc4ab-e7ff-4925-89c7-b2bdfca825d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:26.367026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604bc4ab-e7ff-4925-89c7-b2bdfca825d1 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:26.389875 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 779/1552] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:44:26 2022] POST /identity/v3/users => generated 287 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:44:26.390840 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f2690-a16c-4f4d-82a0-688eb0ab497c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:26.400599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 774/1553] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:44:26.405023 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c752c-d719-427b-8c27-f52169ed038c None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:26.406017 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c752c-d719-427b-8c27-f52169ed038c None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:26.406981 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c752c-d719-427b-8c27-f52169ed038c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:26.422136 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f2690-a16c-4f4d-82a0-688eb0ab497c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:26.429897 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bac57c-1da9-457f-869c-59a80882d796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:26.430546 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bac57c-1da9-457f-869c-59a80882d796 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:26.430824 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bac57c-1da9-457f-869c-59a80882d796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:26.431085 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bac57c-1da9-457f-869c-59a80882d796 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:26.431873 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bac57c-1da9-457f-869c-59a80882d796 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:26.433950 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bac57c-1da9-457f-869c-59a80882d796 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:26.445568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-169c752c-d719-427b-8c27-f52169ed038c None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:26.448833 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-169c752c-d719-427b-8c27-f52169ed038c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:26.465181 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 775/1554] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:26.467979 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae8890-c0a4-46f3-ba08-4b6e5884c809 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:26.469737 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae8890-c0a4-46f3-ba08-4b6e5884c809 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:26.470436 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae8890-c0a4-46f3-ba08-4b6e5884c809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:26.472525 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 780/1555] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:44:26 2022] POST /identity/v3/users => generated 290 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:44:26.478195 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d740f-ee3c-4f76-aad3-7de7a32c07dd None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:26.478506 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d740f-ee3c-4f76-aad3-7de7a32c07dd None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:26.478930 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d740f-ee3c-4f76-aad3-7de7a32c07dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:26.504946 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-726d740f-ee3c-4f76-aad3-7de7a32c07dd None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:26.506343 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-726d740f-ee3c-4f76-aad3-7de7a32c07dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:26.511274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-8fae8890-c0a4-46f3-ba08-4b6e5884c809 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:26.514614 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-8fae8890-c0a4-46f3-ba08-4b6e5884c809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:26.516456 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 781/1556] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:26.517748 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d740f-ee3c-4f76-aad3-7de7a32c07dd None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:26.531083 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d740f-ee3c-4f76-aad3-7de7a32c07dd None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:26.533440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 776/1557] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:26.535773 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae8890-c0a4-46f3-ba08-4b6e5884c809 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:26.542331 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a958a-54fd-4ebb-89b6-7bca581fc641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:26.543233 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a958a-54fd-4ebb-89b6-7bca581fc641 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:26.543554 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a958a-54fd-4ebb-89b6-7bca581fc641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:26.543937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a958a-54fd-4ebb-89b6-7bca581fc641 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:26.544511 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a958a-54fd-4ebb-89b6-7bca581fc641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:26.546417 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4a958a-54fd-4ebb-89b6-7bca581fc641 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:26.559858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae8890-c0a4-46f3-ba08-4b6e5884c809 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:26.566361 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 782/1558] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:44:26.567583 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a958a-54fd-4ebb-89b6-7bca581fc641 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:26.575196 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c7c66-02ae-4f4d-9d74-8cc958e6257a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:26.576886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c7c66-02ae-4f4d-9d74-8cc958e6257a admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:26.577711 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c7c66-02ae-4f4d-9d74-8cc958e6257a admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:26.578517 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c7c66-02ae-4f4d-9d74-8cc958e6257a admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:26.580068 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c7c66-02ae-4f4d-9d74-8cc958e6257a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:26.581660 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4a958a-54fd-4ebb-89b6-7bca581fc641 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:26.585407 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413c7c66-02ae-4f4d-9d74-8cc958e6257a admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:26.587890 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c6865-f123-450a-b887-5f724ba80981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:26.588544 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c6865-f123-450a-b887-5f724ba80981 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:26.588954 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c6865-f123-450a-b887-5f724ba80981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:26.589228 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c6865-f123-450a-b887-5f724ba80981 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:26.589899 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c6865-f123-450a-b887-5f724ba80981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:26.592150 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c6865-f123-450a-b887-5f724ba80981 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:26.605863 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 783/1559] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:44:26.611063 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56f573-545e-4e00-b754-6a406a2aacf2 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:26.611512 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56f573-545e-4e00-b754-6a406a2aacf2 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:26.611945 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56f573-545e-4e00-b754-6a406a2aacf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:26.640862 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-ff56f573-545e-4e00-b754-6a406a2aacf2 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:26.643229 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ff56f573-545e-4e00-b754-6a406a2aacf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:26.649833 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 777/1560] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:44:26 2022] POST /identity/v3/projects => generated 389 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:44:26.652267 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c7c66-02ae-4f4d-9d74-8cc958e6257a admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:26.657960 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 784/1561] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:26.658878 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56f573-545e-4e00-b754-6a406a2aacf2 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:26.670724 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56f573-545e-4e00-b754-6a406a2aacf2 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:26.698358 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:26.757726 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c34fee-2684-49e1-abe2-5a170b4b95e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:26.758827 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c34fee-2684-49e1-abe2-5a170b4b95e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:26.759263 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c34fee-2684-49e1-abe2-5a170b4b95e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:26.759685 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c34fee-2684-49e1-abe2-5a170b4b95e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:26.760834 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c34fee-2684-49e1-abe2-5a170b4b95e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:44:26.761305 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c34fee-2684-49e1-abe2-5a170b4b95e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:26.763282 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c34fee-2684-49e1-abe2-5a170b4b95e9 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:26.781217 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 785/1562] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:44:26.782679 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c34fee-2684-49e1-abe2-5a170b4b95e9 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:26.799181 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c34fee-2684-49e1-abe2-5a170b4b95e9 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:26.804897 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8d789-4798-490c-b3a8-d06562e6d9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:26.805611 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8d789-4798-490c-b3a8-d06562e6d9bd admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:26.805902 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8d789-4798-490c-b3a8-d06562e6d9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:26.806186 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8d789-4798-490c-b3a8-d06562e6d9bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:26.807216 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8d789-4798-490c-b3a8-d06562e6d9bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:26.808745 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8d789-4798-490c-b3a8-d06562e6d9bd admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:26.812706 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413c7c66-02ae-4f4d-9d74-8cc958e6257a admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:26.819599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ed64a-0d14-449b-b876-d98249d6a5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:26.820855 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ed64a-0d14-449b-b876-d98249d6a5cf admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:26.821304 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ed64a-0d14-449b-b876-d98249d6a5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:26.821766 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ed64a-0d14-449b-b876-d98249d6a5cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:26.821947 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 786/1563] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:44:26.822877 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ed64a-0d14-449b-b876-d98249d6a5cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:44:26.823457 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ed64a-0d14-449b-b876-d98249d6a5cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:26.825480 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356ed64a-0d14-449b-b876-d98249d6a5cf admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:26.825953 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8d789-4798-490c-b3a8-d06562e6d9bd admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:26.830009 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:26.837064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8d789-4798-490c-b3a8-d06562e6d9bd admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:26.843881 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03f30e-e6f7-4708-9c5c-030da55db059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:26.844575 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03f30e-e6f7-4708-9c5c-030da55db059 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:26.844903 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03f30e-e6f7-4708-9c5c-030da55db059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:26.845375 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03f30e-e6f7-4708-9c5c-030da55db059 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:26.846035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03f30e-e6f7-4708-9c5c-030da55db059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:26.847723 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03f30e-e6f7-4708-9c5c-030da55db059 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:26.857641 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 778/1564] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:44:26.858663 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ed64a-0d14-449b-b876-d98249d6a5cf admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:26.860650 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 787/1565] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:44:26.864726 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03f30e-e6f7-4708-9c5c-030da55db059 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:26.876557 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ed64a-0d14-449b-b876-d98249d6a5cf admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:26.878011 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03f30e-e6f7-4708-9c5c-030da55db059 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:26.885327 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae916bc-f4fa-4cbc-b481-e309c06be862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:26.886282 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdb2e3-e3ba-423e-b1d0-31b6f0f98e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:26.886416 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae916bc-f4fa-4cbc-b481-e309c06be862 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:26.886713 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae916bc-f4fa-4cbc-b481-e309c06be862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:26.887152 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae916bc-f4fa-4cbc-b481-e309c06be862 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:26.887332 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdb2e3-e3ba-423e-b1d0-31b6f0f98e69 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:26.887756 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdb2e3-e3ba-423e-b1d0-31b6f0f98e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:26.888191 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdb2e3-e3ba-423e-b1d0-31b6f0f98e69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:26.888314 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae916bc-f4fa-4cbc-b481-e309c06be862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:26.889277 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cdb2e3-e3ba-423e-b1d0-31b6f0f98e69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:44:26.889740 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cdb2e3-e3ba-423e-b1d0-31b6f0f98e69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:26.891929 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae916bc-f4fa-4cbc-b481-e309c06be862 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:26.892940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cdb2e3-e3ba-423e-b1d0-31b6f0f98e69 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:26.911642 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 788/1566] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:44:26.913692 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fba251-c41d-4779-a46a-4620eacdf2ff None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:26.914111 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fba251-c41d-4779-a46a-4620eacdf2ff None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:26.914518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fba251-c41d-4779-a46a-4620eacdf2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:26.926109 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 779/1567] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:44:26 2022] POST /identity/v3/users => generated 295 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:44:26.926109 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae916bc-f4fa-4cbc-b481-e309c06be862 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:26.939678 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae916bc-f4fa-4cbc-b481-e309c06be862 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:26.942963 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-69fba251-c41d-4779-a46a-4620eacdf2ff None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:26.944268 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-69fba251-c41d-4779-a46a-4620eacdf2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:26.945976 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32825509-fb8a-4026-89fc-a1d54d036ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:26.946719 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32825509-fb8a-4026-89fc-a1d54d036ffc admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:26.947155 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32825509-fb8a-4026-89fc-a1d54d036ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:26.947626 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32825509-fb8a-4026-89fc-a1d54d036ffc admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:26.948756 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32825509-fb8a-4026-89fc-a1d54d036ffc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:26.951145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32825509-fb8a-4026-89fc-a1d54d036ffc admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:26.954151 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 789/1568] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:26.954809 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fba251-c41d-4779-a46a-4620eacdf2ff None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:26.971936 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fba251-c41d-4779-a46a-4620eacdf2ff None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:26.978392 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78678bd-3135-419d-bcfa-fc8e0c345b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:26.979246 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78678bd-3135-419d-bcfa-fc8e0c345b18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:26.979638 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78678bd-3135-419d-bcfa-fc8e0c345b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:26.980050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78678bd-3135-419d-bcfa-fc8e0c345b18 admin admin] PATH_INFO: `/v3/projects/3d921aafe2a54f848df305fec51b6a25/users/984878e87a074edda728661916adddbd/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:26.998190 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 780/1569] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:44:26 2022] POST /identity/v3/projects => generated 393 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:44:26.999016 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32825509-fb8a-4026-89fc-a1d54d036ffc admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:27.012395 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78678bd-3135-419d-bcfa-fc8e0c345b18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d921aafe2a54f848df305fec51b6a25, user_id=984878e87a074edda728661916adddbd, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:27.017886 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78678bd-3135-419d-bcfa-fc8e0c345b18 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:27.040835 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 790/1570] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:44:26 2022] PUT /identity/v3/projects/3d921aafe2a54f848df305fec51b6a25/users/984878e87a074edda728661916adddbd/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:27.042318 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78678bd-3135-419d-bcfa-fc8e0c345b18 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:27.082603 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32825509-fb8a-4026-89fc-a1d54d036ffc admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:27.130639 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78678bd-3135-419d-bcfa-fc8e0c345b18 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:27.135479 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e5b7d-4408-4449-afe7-8bbf6f47085e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:27.137112 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e5b7d-4408-4449-afe7-8bbf6f47085e admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:27.137392 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e5b7d-4408-4449-afe7-8bbf6f47085e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:27.137664 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e5b7d-4408-4449-afe7-8bbf6f47085e admin admin] PATH_INFO: `/v3/projects/59d7d2da6d364c40984a6d95c87f35b6/users/31214da58fc3420393b0f5bd5df8e9d2/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:27.157446 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e5b7d-4408-4449-afe7-8bbf6f47085e admin admin] RBAC: Authorizing `identity:create_grant(project_id=59d7d2da6d364c40984a6d95c87f35b6, user_id=31214da58fc3420393b0f5bd5df8e9d2, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:27.162504 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e5b7d-4408-4449-afe7-8bbf6f47085e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:27.181472 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 791/1571] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:44:27 2022] PUT /identity/v3/projects/59d7d2da6d364c40984a6d95c87f35b6/users/31214da58fc3420393b0f5bd5df8e9d2/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:27.185975 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f844f-f27f-45d7-a082-6226cc6503ed None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:27.185975 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f844f-f27f-45d7-a082-6226cc6503ed None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:27.185975 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f844f-f27f-45d7-a082-6226cc6503ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:27.188476 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d84733-c6bd-4dad-92dc-c6a7d5145c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:27.189492 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d84733-c6bd-4dad-92dc-c6a7d5145c5b admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:27.190004 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d84733-c6bd-4dad-92dc-c6a7d5145c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:27.190439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d84733-c6bd-4dad-92dc-c6a7d5145c5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:27.191433 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d84733-c6bd-4dad-92dc-c6a7d5145c5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:27.194826 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d84733-c6bd-4dad-92dc-c6a7d5145c5b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:27.207789 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-970f844f-f27f-45d7-a082-6226cc6503ed None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:27.209047 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-970f844f-f27f-45d7-a082-6226cc6503ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:27.240259 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 781/1572] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:44:26 2022] POST /identity/v3/projects => generated 383 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:44:27.241482 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d84733-c6bd-4dad-92dc-c6a7d5145c5b admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:27.246633 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:27.300880 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 792/1573] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:27.305721 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:27.310795 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f844f-f27f-45d7-a082-6226cc6503ed None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:27.325472 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f844f-f27f-45d7-a082-6226cc6503ed None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:27.325817 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d84733-c6bd-4dad-92dc-c6a7d5145c5b admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:27.331293 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d8086-7838-4a5d-83fc-74cd2cf5dab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:27.331985 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d8086-7838-4a5d-83fc-74cd2cf5dab1 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:27.332259 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d8086-7838-4a5d-83fc-74cd2cf5dab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:27.332533 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d8086-7838-4a5d-83fc-74cd2cf5dab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:27.333255 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d8086-7838-4a5d-83fc-74cd2cf5dab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:27.333497 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c378b9-e0cb-47e8-bc44-478d9f18117d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:27.334535 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c378b9-e0cb-47e8-bc44-478d9f18117d admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:27.334864 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d8086-7838-4a5d-83fc-74cd2cf5dab1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:27.335046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c378b9-e0cb-47e8-bc44-478d9f18117d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:27.335462 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c378b9-e0cb-47e8-bc44-478d9f18117d admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:27.336703 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c378b9-e0cb-47e8-bc44-478d9f18117d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:27.340472 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c378b9-e0cb-47e8-bc44-478d9f18117d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:27.347349 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 793/1574] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:44:27.348739 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd93447-0a53-4268-b5e7-5faa44431104 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:27.349077 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd93447-0a53-4268-b5e7-5faa44431104 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:27.349349 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd93447-0a53-4268-b5e7-5faa44431104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:27.373398 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-efd93447-0a53-4268-b5e7-5faa44431104 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:27.374648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-efd93447-0a53-4268-b5e7-5faa44431104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:27.383383 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 794/1575] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:27.384284 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd93447-0a53-4268-b5e7-5faa44431104 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:27.391286 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 782/1576] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:44:27 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:44:27.391286 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53cb2b-9b60-433b-9cc5-5553ac344234 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:27.391286 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53cb2b-9b60-433b-9cc5-5553ac344234 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:27.391286 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d53cb2b-9b60-433b-9cc5-5553ac344234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:27.397278 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd93447-0a53-4268-b5e7-5faa44431104 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:27.434219 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-5d53cb2b-9b60-433b-9cc5-5553ac344234 None None] MFA Rules not processed for user `984878e87a074edda728661916adddbd`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:27.436597 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5d53cb2b-9b60-433b-9cc5-5553ac344234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:27.470033 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb482c7c-df12-4bef-835d-9df0ed1b25cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:27.470680 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb482c7c-df12-4bef-835d-9df0ed1b25cc admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:27.470955 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb482c7c-df12-4bef-835d-9df0ed1b25cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:27.471222 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb482c7c-df12-4bef-835d-9df0ed1b25cc admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:27.471912 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb482c7c-df12-4bef-835d-9df0ed1b25cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:27.474025 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb482c7c-df12-4bef-835d-9df0ed1b25cc admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:27.505066 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 795/1577] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:44:27 2022] POST /identity/v3/users => generated 297 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:44:27.505066 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2153184-cfcb-4987-86ad-72efb33d52dc None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:27.505066 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2153184-cfcb-4987-86ad-72efb33d52dc None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:27.505066 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2153184-cfcb-4987-86ad-72efb33d52dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:27.527496 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c2153184-cfcb-4987-86ad-72efb33d52dc None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:27.530523 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c2153184-cfcb-4987-86ad-72efb33d52dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:27.544162 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 796/1578] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:27.545464 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2153184-cfcb-4987-86ad-72efb33d52dc None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:27.561262 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2153184-cfcb-4987-86ad-72efb33d52dc None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:27.565900 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 783/1579] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:27.568277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd88ed-9dd6-4225-adef-cbb0050dbba6 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:27.568605 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd88ed-9dd6-4225-adef-cbb0050dbba6 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:27.568883 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acd88ed-9dd6-4225-adef-cbb0050dbba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:27.574863 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4d674-440b-42e4-9407-56ace1d26589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:27.576018 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4d674-440b-42e4-9407-56ace1d26589 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:27.576579 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4d674-440b-42e4-9407-56ace1d26589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:27.576982 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb4d674-440b-42e4-9407-56ace1d26589 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:27.578304 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4d674-440b-42e4-9407-56ace1d26589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:27.581022 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb4d674-440b-42e4-9407-56ace1d26589 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:27.602263 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-4acd88ed-9dd6-4225-adef-cbb0050dbba6 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:27.604257 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4acd88ed-9dd6-4225-adef-cbb0050dbba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:27.619610 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 797/1580] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:44:27 2022] POST /identity/v3/users => generated 292 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:44:27.620425 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 784/1581] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:27.621598 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd88ed-9dd6-4225-adef-cbb0050dbba6 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:27.622200 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4d674-440b-42e4-9407-56ace1d26589 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:27.640698 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acd88ed-9dd6-4225-adef-cbb0050dbba6 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:27.641787 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb4d674-440b-42e4-9407-56ace1d26589 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:27.648277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb30667-0ea1-4a96-81a6-2ed4ed2fa685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:27.649317 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb30667-0ea1-4a96-81a6-2ed4ed2fa685 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:27.649600 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c86d6b-b00e-44e8-9260-f7223513e449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:27.649748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb30667-0ea1-4a96-81a6-2ed4ed2fa685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:27.650187 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb30667-0ea1-4a96-81a6-2ed4ed2fa685 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:27.650551 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c86d6b-b00e-44e8-9260-f7223513e449 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:27.650979 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c86d6b-b00e-44e8-9260-f7223513e449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:27.651332 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb30667-0ea1-4a96-81a6-2ed4ed2fa685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:27.651461 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c86d6b-b00e-44e8-9260-f7223513e449 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:27.652471 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c86d6b-b00e-44e8-9260-f7223513e449 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:44:27.652939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c86d6b-b00e-44e8-9260-f7223513e449 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:27.654229 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb30667-0ea1-4a96-81a6-2ed4ed2fa685 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:27.655667 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c86d6b-b00e-44e8-9260-f7223513e449 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:27.672155 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 785/1582] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:44:27.673427 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb30667-0ea1-4a96-81a6-2ed4ed2fa685 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:27.678762 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 798/1583] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:44:27.680149 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c86d6b-b00e-44e8-9260-f7223513e449 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:27.694661 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb30667-0ea1-4a96-81a6-2ed4ed2fa685 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:27.695497 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c86d6b-b00e-44e8-9260-f7223513e449 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:27.702296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22530eb7-f8a0-46d2-8324-a5198457bda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:27.703348 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22530eb7-f8a0-46d2-8324-a5198457bda1 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:27.711044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22530eb7-f8a0-46d2-8324-a5198457bda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:27.712322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65f8e0-930c-417d-93ee-fb299a9a9660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:27.712550 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22530eb7-f8a0-46d2-8324-a5198457bda1 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:27.712730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65f8e0-930c-417d-93ee-fb299a9a9660 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:27.712900 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22530eb7-f8a0-46d2-8324-a5198457bda1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:27.713057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65f8e0-930c-417d-93ee-fb299a9a9660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:27.713057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65f8e0-930c-417d-93ee-fb299a9a9660 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:27.713057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65f8e0-930c-417d-93ee-fb299a9a9660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:27.713502 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22530eb7-f8a0-46d2-8324-a5198457bda1 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:27.714627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65f8e0-930c-417d-93ee-fb299a9a9660 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:27.737807 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 799/1584] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:44:27.737807 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65f8e0-930c-417d-93ee-fb299a9a9660 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:27.740873 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ab65f8e0-930c-417d-93ee-fb299a9a9660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:27.748514 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 786/1585] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:44:27 2022] POST /identity/v3/users => generated 293 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:44:27.750773 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a6de7-8de3-4dfc-a38f-22bcb95ec668 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:27.751223 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a6de7-8de3-4dfc-a38f-22bcb95ec668 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:27.751638 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a6de7-8de3-4dfc-a38f-22bcb95ec668 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:27.754184 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 787/1586] 10.222.0.66 () {54 vars in 961 bytes} [Mon Sep 26 05:44:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:44:27.755560 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a6de7-8de3-4dfc-a38f-22bcb95ec668 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:27.775209 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a6de7-8de3-4dfc-a38f-22bcb95ec668 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:27.783211 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfdd9e0-ddff-4d99-b30c-7b4ef4d27d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:27.784164 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdd9e0-ddff-4d99-b30c-7b4ef4d27d55 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:27.784617 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdd9e0-ddff-4d99-b30c-7b4ef4d27d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:27.785070 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdd9e0-ddff-4d99-b30c-7b4ef4d27d55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:27.786093 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfdd9e0-ddff-4d99-b30c-7b4ef4d27d55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:27.789071 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfdd9e0-ddff-4d99-b30c-7b4ef4d27d55 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:27.804005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 788/1587] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:44:27.805377 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfdd9e0-ddff-4d99-b30c-7b4ef4d27d55 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:27.818746 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfdd9e0-ddff-4d99-b30c-7b4ef4d27d55 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:27.826524 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c6943-212b-4352-ad53-9fdc095204ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:27.827596 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c6943-212b-4352-ad53-9fdc095204ee admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:27.828084 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c6943-212b-4352-ad53-9fdc095204ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:27.828559 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c6943-212b-4352-ad53-9fdc095204ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:27.829402 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c6943-212b-4352-ad53-9fdc095204ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:44:27.829878 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c6943-212b-4352-ad53-9fdc095204ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:27.830251 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65f8e0-930c-417d-93ee-fb299a9a9660 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:27.832052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c6943-212b-4352-ad53-9fdc095204ee admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:27.835385 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426220b-76e0-4155-acb4-f84d00dbfdcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:27.836350 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426220b-76e0-4155-acb4-f84d00dbfdcc service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:27.836761 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426220b-76e0-4155-acb4-f84d00dbfdcc service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:27.837282 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426220b-76e0-4155-acb4-f84d00dbfdcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:27.853034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426220b-76e0-4155-acb4-f84d00dbfdcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:27.853366 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 789/1588] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:44:27.854405 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c6943-212b-4352-ad53-9fdc095204ee admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:27.855648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426220b-76e0-4155-acb4-f84d00dbfdcc service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:27.864984 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:27.871923 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c6943-212b-4352-ad53-9fdc095204ee admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:27.874606 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 800/1589] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:44:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:44:27.875955 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426220b-76e0-4155-acb4-f84d00dbfdcc service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:27.880119 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3211e1-4b0a-4c19-932e-2daabe33c424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:27.882033 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3211e1-4b0a-4c19-932e-2daabe33c424 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:27.882311 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3211e1-4b0a-4c19-932e-2daabe33c424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:27.882678 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3211e1-4b0a-4c19-932e-2daabe33c424 admin admin] PATH_INFO: `/v3/projects/e7e20c936b544041946c36379012278d/users/1aebaf488289488387d0b9efa7818285/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:27.893565 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426220b-76e0-4155-acb4-f84d00dbfdcc service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:27.901650 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea3c30-bb20-4ebc-996a-1b477dce5e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:27.902460 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea3c30-bb20-4ebc-996a-1b477dce5e60 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:27.902867 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea3c30-bb20-4ebc-996a-1b477dce5e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:27.903322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea3c30-bb20-4ebc-996a-1b477dce5e60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:27.904412 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea3c30-bb20-4ebc-996a-1b477dce5e60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:27.907848 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea3c30-bb20-4ebc-996a-1b477dce5e60 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:27.915130 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3211e1-4b0a-4c19-932e-2daabe33c424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7e20c936b544041946c36379012278d, user_id=1aebaf488289488387d0b9efa7818285, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:27.916985 dv-cinder-836083-14-smb devstack@keystone.service[81682]: WARNING py.warnings [None req-3d3211e1-4b0a-4c19-932e-2daabe33c424 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 05:44:27.916985 dv-cinder-836083-14-smb devstack@keystone.service[81682]: warnings.warn(msg) Sep 26 05:44:27.916985 dv-cinder-836083-14-smb devstack@keystone.service[81682]: Sep 26 05:44:27.920455 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3211e1-4b0a-4c19-932e-2daabe33c424 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:27.947618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 790/1590] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:44:27 2022] PUT /identity/v3/projects/e7e20c936b544041946c36379012278d/users/1aebaf488289488387d0b9efa7818285/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:27.955574 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3211e1-4b0a-4c19-932e-2daabe33c424 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:27.955884 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 801/1591] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:44:27 2022] POST /identity/v3/projects => generated 373 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:44:27.957556 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea3c30-bb20-4ebc-996a-1b477dce5e60 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:28.049920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:28.074676 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea3c30-bb20-4ebc-996a-1b477dce5e60 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:28.081115 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f7d84-a438-413f-9544-f34833ed7a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:28.082015 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f7d84-a438-413f-9544-f34833ed7a4c admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:28.082436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f7d84-a438-413f-9544-f34833ed7a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:28.082830 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f7d84-a438-413f-9544-f34833ed7a4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:28.084521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f7d84-a438-413f-9544-f34833ed7a4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:28.086433 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f7d84-a438-413f-9544-f34833ed7a4c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:28.095299 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3211e1-4b0a-4c19-932e-2daabe33c424 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:28.106647 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 802/1592] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:44:28.106647 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ab043-6d47-4a30-b2c8-4f2819da2014 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:28.106647 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ab043-6d47-4a30-b2c8-4f2819da2014 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:28.106647 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ab043-6d47-4a30-b2c8-4f2819da2014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:28.109889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf275ea0-66b6-41c8-86bb-9054f772cbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:28.111411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf275ea0-66b6-41c8-86bb-9054f772cbee admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:28.112038 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf275ea0-66b6-41c8-86bb-9054f772cbee admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:28.112668 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf275ea0-66b6-41c8-86bb-9054f772cbee admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:28.113982 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf275ea0-66b6-41c8-86bb-9054f772cbee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:28.117955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf275ea0-66b6-41c8-86bb-9054f772cbee admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:28.147036 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 791/1593] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:44:28.147036 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf275ea0-66b6-41c8-86bb-9054f772cbee admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:28.168215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf275ea0-66b6-41c8-86bb-9054f772cbee admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:28.169085 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-244ab043-6d47-4a30-b2c8-4f2819da2014 None None] MFA Rules not processed for user `c559a36836be411b9afd076f4c9a0655`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:28.172278 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-244ab043-6d47-4a30-b2c8-4f2819da2014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:28.178192 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b730ab-d906-4f4c-9ae6-a72304f39654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:28.179376 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b730ab-d906-4f4c-9ae6-a72304f39654 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:28.179891 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b730ab-d906-4f4c-9ae6-a72304f39654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:28.180514 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b730ab-d906-4f4c-9ae6-a72304f39654 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:28.181908 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b730ab-d906-4f4c-9ae6-a72304f39654 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:28.187372 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b730ab-d906-4f4c-9ae6-a72304f39654 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:28.206955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 792/1594] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:44:28.208165 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b730ab-d906-4f4c-9ae6-a72304f39654 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:28.229572 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b730ab-d906-4f4c-9ae6-a72304f39654 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:28.239777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793369d-2c32-4bb1-932b-21c563b0afce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:28.241484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793369d-2c32-4bb1-932b-21c563b0afce admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:28.242329 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793369d-2c32-4bb1-932b-21c563b0afce admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:28.242980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793369d-2c32-4bb1-932b-21c563b0afce admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:28.244217 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e793369d-2c32-4bb1-932b-21c563b0afce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:28.247674 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e793369d-2c32-4bb1-932b-21c563b0afce admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:28.298594 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 793/1595] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:44:28 2022] POST /identity/v3/projects => generated 403 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:44:28.299992 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800b562-21af-436e-a442-473cc4dd4f41 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:28.300351 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800b562-21af-436e-a442-473cc4dd4f41 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:28.300813 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e800b562-21af-436e-a442-473cc4dd4f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:28.317292 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 803/1596] 10.222.0.66 () {58 vars in 1058 bytes} [Mon Sep 26 05:44:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:28.319014 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ab043-6d47-4a30-b2c8-4f2819da2014 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:28.325979 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-e800b562-21af-436e-a442-473cc4dd4f41 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:28.327248 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e800b562-21af-436e-a442-473cc4dd4f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:28.339683 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ab043-6d47-4a30-b2c8-4f2819da2014 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:28.431124 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:28.433750 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 794/1597] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:28.435425 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800b562-21af-436e-a442-473cc4dd4f41 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:28.451478 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e800b562-21af-436e-a442-473cc4dd4f41 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:28.452395 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbb6da-50da-4345-86e2-464850a3faba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:28.454454 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbb6da-50da-4345-86e2-464850a3faba admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:28.455244 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbb6da-50da-4345-86e2-464850a3faba admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:28.459684 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14bd0f-71cb-489a-a06a-4dbfbf34ff5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:28.460752 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14bd0f-71cb-489a-a06a-4dbfbf34ff5b admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:28.461268 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14bd0f-71cb-489a-a06a-4dbfbf34ff5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:28.461744 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14bd0f-71cb-489a-a06a-4dbfbf34ff5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:28.462699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14bd0f-71cb-489a-a06a-4dbfbf34ff5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:28.464933 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd14bd0f-71cb-489a-a06a-4dbfbf34ff5b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:28.465476 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbb6da-50da-4345-86e2-464850a3faba admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:28.466645 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbb6da-50da-4345-86e2-464850a3faba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:28.470637 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbb6da-50da-4345-86e2-464850a3faba admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:28.480241 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 795/1598] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:44:28.481358 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14bd0f-71cb-489a-a06a-4dbfbf34ff5b admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:28.503252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd14bd0f-71cb-489a-a06a-4dbfbf34ff5b admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:28.509752 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ad078-89f7-4a7f-af93-25fde1da7a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:28.512496 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 804/1599] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:44:28 2022] POST /identity/v3/users => generated 287 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:44:28.513390 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ad078-89f7-4a7f-af93-25fde1da7a90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:28.514094 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ad078-89f7-4a7f-af93-25fde1da7a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:28.514739 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ad078-89f7-4a7f-af93-25fde1da7a90 admin admin] PATH_INFO: `/v3/projects/1046a4541e884c7b869d8f4830e58a6c/users/5224b2ba12d54146855fe3a993dc0915/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:28.516881 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbb6da-50da-4345-86e2-464850a3faba admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:28.528247 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbb6da-50da-4345-86e2-464850a3faba admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:28.533514 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032d518-674b-4e06-8392-e1116359a19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:28.534224 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032d518-674b-4e06-8392-e1116359a19b admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:28.534499 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032d518-674b-4e06-8392-e1116359a19b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:28.534775 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e032d518-674b-4e06-8392-e1116359a19b admin admin] PATH_INFO: `/v3/projects/6cf774a8d43c4eb3b52fc817a7517a28/users/9b19bf41fdb74cc4a8e0e048f86bf3c8/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:28.551214 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ad078-89f7-4a7f-af93-25fde1da7a90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1046a4541e884c7b869d8f4830e58a6c, user_id=5224b2ba12d54146855fe3a993dc0915, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:28.557025 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ad078-89f7-4a7f-af93-25fde1da7a90 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:28.574885 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032d518-674b-4e06-8392-e1116359a19b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cf774a8d43c4eb3b52fc817a7517a28, user_id=9b19bf41fdb74cc4a8e0e048f86bf3c8, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:28.582272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e032d518-674b-4e06-8392-e1116359a19b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:28.595271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 796/1600] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:44:28 2022] PUT /identity/v3/projects/1046a4541e884c7b869d8f4830e58a6c/users/5224b2ba12d54146855fe3a993dc0915/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:28.597770 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ad078-89f7-4a7f-af93-25fde1da7a90 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:28.623900 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 805/1601] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:44:28 2022] PUT /identity/v3/projects/6cf774a8d43c4eb3b52fc817a7517a28/users/9b19bf41fdb74cc4a8e0e048f86bf3c8/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:28.623900 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032d518-674b-4e06-8392-e1116359a19b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:28.728724 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ad078-89f7-4a7f-af93-25fde1da7a90 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:28.751613 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:28.793767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e032d518-674b-4e06-8392-e1116359a19b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:28.807333 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e1a03-8587-4a09-9582-0a9c397a27a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:28.809429 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e1a03-8587-4a09-9582-0a9c397a27a6 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:28.810987 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e1a03-8587-4a09-9582-0a9c397a27a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:28.812261 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e1a03-8587-4a09-9582-0a9c397a27a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:28.835386 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becab7e4-ede0-4c27-882c-0561173ff66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:28.836524 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becab7e4-ede0-4c27-882c-0561173ff66e admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:28.836977 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becab7e4-ede0-4c27-882c-0561173ff66e admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:28.837663 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becab7e4-ede0-4c27-882c-0561173ff66e admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:28.838662 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becab7e4-ede0-4c27-882c-0561173ff66e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:28.843231 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becab7e4-ede0-4c27-882c-0561173ff66e admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:28.893087 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 797/1602] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:44:28 2022] POST /identity/v3/users => generated 302 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:44:28.895232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becab7e4-ede0-4c27-882c-0561173ff66e admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:28.913687 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e1a03-8587-4a09-9582-0a9c397a27a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:28.916065 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e1a03-8587-4a09-9582-0a9c397a27a6 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:28.928212 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 806/1603] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:44:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:44:28.929094 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e1a03-8587-4a09-9582-0a9c397a27a6 service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:28.940981 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e1a03-8587-4a09-9582-0a9c397a27a6 service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:28.952461 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f92a1-49b5-4764-baa9-ab544c231e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:28.953178 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f92a1-49b5-4764-baa9-ab544c231e66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:28.953477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f92a1-49b5-4764-baa9-ab544c231e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:28.953954 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f92a1-49b5-4764-baa9-ab544c231e66 admin admin] PATH_INFO: `/v3/projects/0d6af1f8b0874b3282db6468f80e0c08/users/066b5424bd294c30b78768e1da57ba4f/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:28.981923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f92a1-49b5-4764-baa9-ab544c231e66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d6af1f8b0874b3282db6468f80e0c08, user_id=066b5424bd294c30b78768e1da57ba4f, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:28.992020 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f92a1-49b5-4764-baa9-ab544c231e66 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:29.023667 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 807/1604] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:44:28 2022] PUT /identity/v3/projects/0d6af1f8b0874b3282db6468f80e0c08/users/066b5424bd294c30b78768e1da57ba4f/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:29.025252 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f92a1-49b5-4764-baa9-ab544c231e66 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:29.052120 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becab7e4-ede0-4c27-882c-0561173ff66e admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:29.099710 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:29.168954 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f92a1-49b5-4764-baa9-ab544c231e66 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:29.179555 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70860ae-6002-4c01-acc2-6f3c1554ebd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:29.180864 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70860ae-6002-4c01-acc2-6f3c1554ebd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:29.181589 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70860ae-6002-4c01-acc2-6f3c1554ebd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:29.182126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70860ae-6002-4c01-acc2-6f3c1554ebd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:29.183502 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70860ae-6002-4c01-acc2-6f3c1554ebd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:29.187041 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70860ae-6002-4c01-acc2-6f3c1554ebd9 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:29.207882 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96f1335-2a7e-4a92-baa1-bebbcccdb2fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:29.208921 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f1335-2a7e-4a92-baa1-bebbcccdb2fa service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:29.210030 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f1335-2a7e-4a92-baa1-bebbcccdb2fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:29.210030 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f1335-2a7e-4a92-baa1-bebbcccdb2fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:29.220269 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 808/1605] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:44:29.222000 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df1873-7873-4294-a43b-754e48995b76 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:29.222551 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df1873-7873-4294-a43b-754e48995b76 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:29.223142 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df1873-7873-4294-a43b-754e48995b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:29.242138 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f1335-2a7e-4a92-baa1-bebbcccdb2fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:29.243611 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96f1335-2a7e-4a92-baa1-bebbcccdb2fa service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:29.258868 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-07df1873-7873-4294-a43b-754e48995b76 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:29.261158 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-07df1873-7873-4294-a43b-754e48995b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:29.266351 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 798/1606] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:44:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:44:29.270689 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744d849-125d-4ffd-8de0-2ea8731ee337 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:29.270982 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744d849-125d-4ffd-8de0-2ea8731ee337 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:29.271257 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a744d849-125d-4ffd-8de0-2ea8731ee337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:29.281623 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 809/1607] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:29.284148 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df1873-7873-4294-a43b-754e48995b76 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:29.307689 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df1873-7873-4294-a43b-754e48995b76 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:29.316412 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9432f5e5-6e3f-4ffe-bcc2-741f8b844223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:29.318485 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432f5e5-6e3f-4ffe-bcc2-741f8b844223 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:29.319162 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432f5e5-6e3f-4ffe-bcc2-741f8b844223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:29.319720 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9432f5e5-6e3f-4ffe-bcc2-741f8b844223 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:29.321353 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9432f5e5-6e3f-4ffe-bcc2-741f8b844223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:29.321729 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-a744d849-125d-4ffd-8de0-2ea8731ee337 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:29.325212 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9432f5e5-6e3f-4ffe-bcc2-741f8b844223 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:29.326445 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a744d849-125d-4ffd-8de0-2ea8731ee337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:29.351311 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 810/1608] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:44:29.351934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 799/1609] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:29.353633 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eabbed-527c-481b-ae21-6dda8773d1e1 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:29.353879 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744d849-125d-4ffd-8de0-2ea8731ee337 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:29.354259 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eabbed-527c-481b-ae21-6dda8773d1e1 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:29.354936 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eabbed-527c-481b-ae21-6dda8773d1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:29.379968 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a744d849-125d-4ffd-8de0-2ea8731ee337 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:29.390855 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983269c-e880-4a8a-9dd3-a3629e3ced90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:29.391450 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983269c-e880-4a8a-9dd3-a3629e3ced90 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:29.391758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983269c-e880-4a8a-9dd3-a3629e3ced90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:29.392044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983269c-e880-4a8a-9dd3-a3629e3ced90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:29.395084 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e983269c-e880-4a8a-9dd3-a3629e3ced90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:29.397591 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e983269c-e880-4a8a-9dd3-a3629e3ced90 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:29.407569 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c0eabbed-527c-481b-ae21-6dda8773d1e1 None None] MFA Rules not processed for user `066b5424bd294c30b78768e1da57ba4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:29.409234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c0eabbed-527c-481b-ae21-6dda8773d1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:29.410802 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 800/1610] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:44:29.412083 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983269c-e880-4a8a-9dd3-a3629e3ced90 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:29.425981 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983269c-e880-4a8a-9dd3-a3629e3ced90 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:29.433146 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d90a2-ab84-4243-90bb-9c84efb2bd0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:29.433790 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d90a2-ab84-4243-90bb-9c84efb2bd0a service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:29.434068 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d90a2-ab84-4243-90bb-9c84efb2bd0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:29.434338 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d90a2-ab84-4243-90bb-9c84efb2bd0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:29.447345 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d90a2-ab84-4243-90bb-9c84efb2bd0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:29.450457 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d90a2-ab84-4243-90bb-9c84efb2bd0a service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:29.463798 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 801/1611] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:44:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:44:29.465061 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d90a2-ab84-4243-90bb-9c84efb2bd0a service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:29.476951 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d90a2-ab84-4243-90bb-9c84efb2bd0a service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:29.482751 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee42f7-ae32-4686-9d02-02565a5762e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:29.483385 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee42f7-ae32-4686-9d02-02565a5762e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:29.483662 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee42f7-ae32-4686-9d02-02565a5762e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:29.483982 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee42f7-ae32-4686-9d02-02565a5762e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:29.484697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee42f7-ae32-4686-9d02-02565a5762e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:29.486458 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee42f7-ae32-4686-9d02-02565a5762e0 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:29.498796 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 811/1612] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:29.500952 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eabbed-527c-481b-ae21-6dda8773d1e1 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:29.509346 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 802/1613] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:44:29.509346 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48095ec8-084e-4ea8-af21-5975bd354812 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:29.509346 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48095ec8-084e-4ea8-af21-5975bd354812 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:29.509346 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48095ec8-084e-4ea8-af21-5975bd354812 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:29.510895 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 803/1614] 10.222.0.66 () {54 vars in 912 bytes} [Mon Sep 26 05:44:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:44:29.520080 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48095ec8-084e-4ea8-af21-5975bd354812 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:29.544714 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eabbed-527c-481b-ae21-6dda8773d1e1 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:29.557410 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04181153-a827-4ca2-9f0a-8da92eb4287b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:29.557941 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48095ec8-084e-4ea8-af21-5975bd354812 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:29.559475 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04181153-a827-4ca2-9f0a-8da92eb4287b service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:29.560348 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04181153-a827-4ca2-9f0a-8da92eb4287b service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:29.561028 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04181153-a827-4ca2-9f0a-8da92eb4287b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:29.572388 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634c238-67ba-42f9-93f6-3f749afcfed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:29.573088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634c238-67ba-42f9-93f6-3f749afcfed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:29.573456 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634c238-67ba-42f9-93f6-3f749afcfed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:29.573776 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634c238-67ba-42f9-93f6-3f749afcfed4 admin admin] PATH_INFO: `/v3/projects/d4ab480e6ccc4b1ea8e509e606edf09b/users/394965567ac24e5790720c4542540c13/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:29.592099 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04181153-a827-4ca2-9f0a-8da92eb4287b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:29.598962 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04181153-a827-4ca2-9f0a-8da92eb4287b service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:29.605925 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9634c238-67ba-42f9-93f6-3f749afcfed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ab480e6ccc4b1ea8e509e606edf09b, user_id=394965567ac24e5790720c4542540c13, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:29.611226 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9634c238-67ba-42f9-93f6-3f749afcfed4 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:29.617766 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 812/1615] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:44:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:44:29.619670 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04181153-a827-4ca2-9f0a-8da92eb4287b service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:29.626066 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:29.633925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04181153-a827-4ca2-9f0a-8da92eb4287b service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:29.639616 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 804/1616] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:44:29 2022] PUT /identity/v3/projects/d4ab480e6ccc4b1ea8e509e606edf09b/users/394965567ac24e5790720c4542540c13/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:29.642772 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010905f-fcc1-4637-8237-b23297545d18 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:29.643794 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010905f-fcc1-4637-8237-b23297545d18 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:29.644283 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010905f-fcc1-4637-8237-b23297545d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:29.687404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-7010905f-fcc1-4637-8237-b23297545d18 None None] MFA Rules not processed for user `c559a36836be411b9afd076f4c9a0655`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:29.689760 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-7010905f-fcc1-4637-8237-b23297545d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:29.783628 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b0e29-25e0-44cf-afc9-87e4dfebd132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:29.785134 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b0e29-25e0-44cf-afc9-87e4dfebd132 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:29.785583 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b0e29-25e0-44cf-afc9-87e4dfebd132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:29.786032 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b0e29-25e0-44cf-afc9-87e4dfebd132 admin admin] PATH_INFO: `/v3/projects/8f6d83a5a22341079d52c5d6ef166969/users/8be632b76e16422f9d3030cb9d03bd26/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:29.814301 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b0e29-25e0-44cf-afc9-87e4dfebd132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f6d83a5a22341079d52c5d6ef166969, user_id=8be632b76e16422f9d3030cb9d03bd26, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:29.820131 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b0e29-25e0-44cf-afc9-87e4dfebd132 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:29.845392 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 813/1617] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:44:29 2022] PUT /identity/v3/projects/8f6d83a5a22341079d52c5d6ef166969/users/8be632b76e16422f9d3030cb9d03bd26/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:29.848342 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc2e04-e4bd-4aa8-aa06-8b7494bf263d None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:29.857003 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc2e04-e4bd-4aa8-aa06-8b7494bf263d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:29.857003 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc2e04-e4bd-4aa8-aa06-8b7494bf263d None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:29.858007 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 805/1618] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Sep 26 05:44:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:29.858462 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 814/1619] 10.222.0.66 () {54 vars in 961 bytes} [Mon Sep 26 05:44:29 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:44:29.859528 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603cd64-6f9a-46ee-a2cb-4fa678f6616a None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:29.859883 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603cd64-6f9a-46ee-a2cb-4fa678f6616a None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:29.860155 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603cd64-6f9a-46ee-a2cb-4fa678f6616a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:29.860906 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc2e04-e4bd-4aa8-aa06-8b7494bf263d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:29.881488 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:29.939126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-4603cd64-6f9a-46ee-a2cb-4fa678f6616a None None] MFA Rules not processed for user `394965567ac24e5790720c4542540c13`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:29.940487 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4603cd64-6f9a-46ee-a2cb-4fa678f6616a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:29.995306 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc2e04-e4bd-4aa8-aa06-8b7494bf263d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:30.005650 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9ee41-777f-4d3b-a86a-c553798b1500 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:30.007237 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9ee41-777f-4d3b-a86a-c553798b1500 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:30.009001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9ee41-777f-4d3b-a86a-c553798b1500 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:30.009765 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9ee41-777f-4d3b-a86a-c553798b1500 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:30.147461 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 806/1620] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:30.149686 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451771d5-15f3-441b-8606-5a64d0f4aa3c None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:30.150247 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451771d5-15f3-441b-8606-5a64d0f4aa3c None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:30.150775 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451771d5-15f3-441b-8606-5a64d0f4aa3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:30.220049 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-451771d5-15f3-441b-8606-5a64d0f4aa3c None None] MFA Rules not processed for user `8be632b76e16422f9d3030cb9d03bd26`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:30.222364 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-451771d5-15f3-441b-8606-5a64d0f4aa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:30.245257 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a9ee41-777f-4d3b-a86a-c553798b1500 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:30.249710 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a9ee41-777f-4d3b-a86a-c553798b1500 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:30.274330 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 815/1621] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:44:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:44:30.276824 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545ed81-66cf-448d-9735-46722c05d7a9 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:30.277315 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545ed81-66cf-448d-9735-46722c05d7a9 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:30.277688 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545ed81-66cf-448d-9735-46722c05d7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:30.324548 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-6545ed81-66cf-448d-9735-46722c05d7a9 None None] MFA Rules not processed for user `c559a36836be411b9afd076f4c9a0655`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:30.326904 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6545ed81-66cf-448d-9735-46722c05d7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:30.356272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 816/1622] 10.222.0.66 () {58 vars in 1058 bytes} [Mon Sep 26 05:44:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:30.371263 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545ed81-66cf-448d-9735-46722c05d7a9 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:30.418902 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545ed81-66cf-448d-9735-46722c05d7a9 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:30.429023 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 807/1623] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:30 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:30.433968 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451771d5-15f3-441b-8606-5a64d0f4aa3c None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:30.444932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d5baa-0335-4b3b-a7f8-499127c581b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:30.446084 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d5baa-0335-4b3b-a7f8-499127c581b2 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:30.446558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d5baa-0335-4b3b-a7f8-499127c581b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:30.447037 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d5baa-0335-4b3b-a7f8-499127c581b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:30.451045 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:30.574384 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451771d5-15f3-441b-8606-5a64d0f4aa3c None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:30.581542 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee833d5-7296-441e-b1fc-82a1f44727f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:30.582979 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee833d5-7296-441e-b1fc-82a1f44727f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:30.583242 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee833d5-7296-441e-b1fc-82a1f44727f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:30.584371 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee833d5-7296-441e-b1fc-82a1f44727f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:30.584623 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee833d5-7296-441e-b1fc-82a1f44727f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:30.586998 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee833d5-7296-441e-b1fc-82a1f44727f4 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:30.644679 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 808/1624] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:44:30 2022] POST /identity/v3/projects => generated 403 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:44:30.648433 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee833d5-7296-441e-b1fc-82a1f44727f4 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:30.728949 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d5baa-0335-4b3b-a7f8-499127c581b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:30.733449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d5baa-0335-4b3b-a7f8-499127c581b2 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:30.770272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 817/1625] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:44:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:44:30.807702 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee833d5-7296-441e-b1fc-82a1f44727f4 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:30.819056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a1912-4fe0-4955-a54b-54c614cc0289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:30.820728 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a1912-4fe0-4955-a54b-54c614cc0289 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:30.821406 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a1912-4fe0-4955-a54b-54c614cc0289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:30.822286 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a1912-4fe0-4955-a54b-54c614cc0289 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:30.824906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a1912-4fe0-4955-a54b-54c614cc0289 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:30.830975 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a1912-4fe0-4955-a54b-54c614cc0289 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:30.913084 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 809/1626] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:44:30 2022] POST /identity/v3/users => generated 308 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:44:30.918373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d5baa-0335-4b3b-a7f8-499127c581b2 service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:30.970530 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d5baa-0335-4b3b-a7f8-499127c581b2 service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:30.998988 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a6ff1-1af4-4c9f-a6ba-5427fd6ee78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:31.004617 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a6ff1-1af4-4c9f-a6ba-5427fd6ee78b admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:31.004903 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a6ff1-1af4-4c9f-a6ba-5427fd6ee78b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:31.006579 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a6ff1-1af4-4c9f-a6ba-5427fd6ee78b admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:31.013375 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8a6ff1-1af4-4c9f-a6ba-5427fd6ee78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:31.024705 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8a6ff1-1af4-4c9f-a6ba-5427fd6ee78b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:31.058596 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 818/1627] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:44:31.063983 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a1912-4fe0-4955-a54b-54c614cc0289 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:31.107113 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a1912-4fe0-4955-a54b-54c614cc0289 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:31.134434 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bda5a-5d9f-4c18-8f1e-6f3f3cacdb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:31.135439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bda5a-5d9f-4c18-8f1e-6f3f3cacdb64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:31.135960 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bda5a-5d9f-4c18-8f1e-6f3f3cacdb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:31.136435 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bda5a-5d9f-4c18-8f1e-6f3f3cacdb64 admin admin] PATH_INFO: `/v3/projects/20b72a0ec63a4529ab2d7cb85d9dcd79/users/948db27ebf6b43129f5ac74f15e06c5f/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:31.211057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23bda5a-5d9f-4c18-8f1e-6f3f3cacdb64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b72a0ec63a4529ab2d7cb85d9dcd79, user_id=948db27ebf6b43129f5ac74f15e06c5f, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:31.233334 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23bda5a-5d9f-4c18-8f1e-6f3f3cacdb64 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:31.283041 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 810/1628] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:44:31 2022] PUT /identity/v3/projects/20b72a0ec63a4529ab2d7cb85d9dcd79/users/948db27ebf6b43129f5ac74f15e06c5f/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:31.288603 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a6ff1-1af4-4c9f-a6ba-5427fd6ee78b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:31.460397 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a6ff1-1af4-4c9f-a6ba-5427fd6ee78b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:31.464826 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07a22e-48eb-4a00-8ac6-53026922cfa1 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:31.464826 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07a22e-48eb-4a00-8ac6-53026922cfa1 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:31.464826 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07a22e-48eb-4a00-8ac6-53026922cfa1 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:31.464826 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 811/1629] 10.222.0.66 () {54 vars in 912 bytes} [Mon Sep 26 05:44:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:44:31.464826 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97aeaa4-f6c5-441e-808e-29e281b7d484 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:31.464826 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97aeaa4-f6c5-441e-808e-29e281b7d484 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:31.466991 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97aeaa4-f6c5-441e-808e-29e281b7d484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:31.581819 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-a97aeaa4-f6c5-441e-808e-29e281b7d484 None None] MFA Rules not processed for user `c559a36836be411b9afd076f4c9a0655`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:31.584662 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a97aeaa4-f6c5-441e-808e-29e281b7d484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:31.603564 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:31.661736 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a7431-c844-4b9a-9715-16dd5007b267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:31.662693 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a7431-c844-4b9a-9715-16dd5007b267 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:31.663142 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a7431-c844-4b9a-9715-16dd5007b267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:31.663633 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88a7431-c844-4b9a-9715-16dd5007b267 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:31.664499 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a7431-c844-4b9a-9715-16dd5007b267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:31.666771 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88a7431-c844-4b9a-9715-16dd5007b267 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:31.682251 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 819/1630] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:44:31.683571 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a7431-c844-4b9a-9715-16dd5007b267 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:31.804811 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:31.883880 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88a7431-c844-4b9a-9715-16dd5007b267 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:31.891884 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 812/1631] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Sep 26 05:44:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:31.893428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97aeaa4-f6c5-441e-808e-29e281b7d484 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:31.913186 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ab0b0-8647-434d-a49f-bfd15fd3dbd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:31.914252 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ab0b0-8647-434d-a49f-bfd15fd3dbd2 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:31.914731 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ab0b0-8647-434d-a49f-bfd15fd3dbd2 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:31.915437 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ab0b0-8647-434d-a49f-bfd15fd3dbd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:31.942385 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97aeaa4-f6c5-441e-808e-29e281b7d484 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:31.961550 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3f048-576b-4084-abc6-bf23532d039b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:31.962804 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3f048-576b-4084-abc6-bf23532d039b admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:31.963285 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3f048-576b-4084-abc6-bf23532d039b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:31.963770 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3f048-576b-4084-abc6-bf23532d039b admin admin] PATH_INFO: `/v3/projects/20b72a0ec63a4529ab2d7cb85d9dcd79/users/948db27ebf6b43129f5ac74f15e06c5f/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:31.972607 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3f048-576b-4084-abc6-bf23532d039b admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b72a0ec63a4529ab2d7cb85d9dcd79, user_id=948db27ebf6b43129f5ac74f15e06c5f, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:31.987773 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3f048-576b-4084-abc6-bf23532d039b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:32.041693 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 813/1632] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:44:31 2022] PUT /identity/v3/projects/20b72a0ec63a4529ab2d7cb85d9dcd79/users/948db27ebf6b43129f5ac74f15e06c5f/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:32.041693 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3f048-576b-4084-abc6-bf23532d039b admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:32.176695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ab0b0-8647-434d-a49f-bfd15fd3dbd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:32.180507 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ab0b0-8647-434d-a49f-bfd15fd3dbd2 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:32.212421 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 820/1633] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:44:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:44:32.217213 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0c96e-95d7-46b5-b0c5-b5b766af0e98 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:32.217703 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0c96e-95d7-46b5-b0c5-b5b766af0e98 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:32.218128 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0c96e-95d7-46b5-b0c5-b5b766af0e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:32.265112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3f048-576b-4084-abc6-bf23532d039b admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:32.287376 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e95514-8f41-4e50-b98e-5467738ce5ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:32.290058 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e95514-8f41-4e50-b98e-5467738ce5ca service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:32.291189 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e95514-8f41-4e50-b98e-5467738ce5ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:32.292146 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e95514-8f41-4e50-b98e-5467738ce5ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:32.419335 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-73f0c96e-95d7-46b5-b0c5-b5b766af0e98 None None] MFA Rules not processed for user `948db27ebf6b43129f5ac74f15e06c5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:32.440264 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-73f0c96e-95d7-46b5-b0c5-b5b766af0e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:32.688395 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e95514-8f41-4e50-b98e-5467738ce5ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:32.690087 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e95514-8f41-4e50-b98e-5467738ce5ca service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:32.749953 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 814/1634] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:44:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 717 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:44:32.810384 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:32.901149 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 821/1635] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:32 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 688 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:32.923724 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e95514-8f41-4e50-b98e-5467738ce5ca service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:32.953645 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e95514-8f41-4e50-b98e-5467738ce5ca service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:32.977220 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b38b75-51d1-4f30-9bc5-401e5c3f21b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:32.978113 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b38b75-51d1-4f30-9bc5-401e5c3f21b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:32.979432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b38b75-51d1-4f30-9bc5-401e5c3f21b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:32.985053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b38b75-51d1-4f30-9bc5-401e5c3f21b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:33.044527 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b38b75-51d1-4f30-9bc5-401e5c3f21b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:33.046077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b38b75-51d1-4f30-9bc5-401e5c3f21b8 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:33.065415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 815/1636] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:44:32 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:44:33.796539 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0c96e-95d7-46b5-b0c5-b5b766af0e98 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:33.861728 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b38b75-51d1-4f30-9bc5-401e5c3f21b8 service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:33.973136 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0c96e-95d7-46b5-b0c5-b5b766af0e98 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:33.979036 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bc2ba7-2e8d-4be4-8cf1-b27f8d7e0ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:33.979984 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc2ba7-2e8d-4be4-8cf1-b27f8d7e0ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:33.980426 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc2ba7-2e8d-4be4-8cf1-b27f8d7e0ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:33.980842 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bc2ba7-2e8d-4be4-8cf1-b27f8d7e0ccb admin admin] PATH_INFO: `/v3/users/8be632b76e16422f9d3030cb9d03bd26` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:33.988177 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b38b75-51d1-4f30-9bc5-401e5c3f21b8 service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:33.992776 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc2ba7-2e8d-4be4-8cf1-b27f8d7e0ccb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8be632b76e16422f9d3030cb9d03bd26)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:33.994769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bc2ba7-2e8d-4be4-8cf1-b27f8d7e0ccb admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:34.010755 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6182efb5-8fe8-422f-aa7b-5d96d3a9dd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:34.011454 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182efb5-8fe8-422f-aa7b-5d96d3a9dd03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:34.011780 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182efb5-8fe8-422f-aa7b-5d96d3a9dd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:34.012121 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182efb5-8fe8-422f-aa7b-5d96d3a9dd03 admin admin] PATH_INFO: `/v3/users/394965567ac24e5790720c4542540c13` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:34.013447 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6182efb5-8fe8-422f-aa7b-5d96d3a9dd03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=394965567ac24e5790720c4542540c13)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:34.014624 dv-cinder-836083-14-smb devstack@keystone.service[81682]: WARNING py.warnings [None req-6182efb5-8fe8-422f-aa7b-5d96d3a9dd03 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 05:44:34.014624 dv-cinder-836083-14-smb devstack@keystone.service[81682]: warnings.warn(msg) Sep 26 05:44:34.014624 dv-cinder-836083-14-smb devstack@keystone.service[81682]: Sep 26 05:44:34.016255 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6182efb5-8fe8-422f-aa7b-5d96d3a9dd03 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:34.063169 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:34.208447 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-60bc2ba7-2e8d-4be4-8cf1-b27f8d7e0ccb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8be632b76e16422f9d3030cb9d03bd26'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:34.234402 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-60bc2ba7-2e8d-4be4-8cf1-b27f8d7e0ccb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8be632b76e16422f9d3030cb9d03bd26'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:34.237750 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-60bc2ba7-2e8d-4be4-8cf1-b27f8d7e0ccb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8be632b76e16422f9d3030cb9d03bd26'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:34.258211 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6182efb5-8fe8-422f-aa7b-5d96d3a9dd03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '394965567ac24e5790720c4542540c13'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:34.284284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6182efb5-8fe8-422f-aa7b-5d96d3a9dd03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '394965567ac24e5790720c4542540c13'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:34.296019 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-60bc2ba7-2e8d-4be4-8cf1-b27f8d7e0ccb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8be632b76e16422f9d3030cb9d03bd26'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:34.325849 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-60bc2ba7-2e8d-4be4-8cf1-b27f8d7e0ccb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8be632b76e16422f9d3030cb9d03bd26'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:34.345079 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 822/1637] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:44:33 2022] DELETE /identity/v3/users/8be632b76e16422f9d3030cb9d03bd26 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:34.352243 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4d9ce-52d2-4a79-83c6-c2a2ead82912 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:34.353011 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4d9ce-52d2-4a79-83c6-c2a2ead82912 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:34.353534 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab4d9ce-52d2-4a79-83c6-c2a2ead82912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:34.363878 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6182efb5-8fe8-422f-aa7b-5d96d3a9dd03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '394965567ac24e5790720c4542540c13'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:34.364784 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6182efb5-8fe8-422f-aa7b-5d96d3a9dd03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '394965567ac24e5790720c4542540c13'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:34.408868 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-dab4d9ce-52d2-4a79-83c6-c2a2ead82912 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:34.412069 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-dab4d9ce-52d2-4a79-83c6-c2a2ead82912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:34.412372 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6182efb5-8fe8-422f-aa7b-5d96d3a9dd03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '394965567ac24e5790720c4542540c13'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:34.440777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 816/1638] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:44:33 2022] DELETE /identity/v3/users/394965567ac24e5790720c4542540c13 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:34.447107 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b374c94-7720-4cde-88ee-182fdb0b7e56 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:34.447399 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b374c94-7720-4cde-88ee-182fdb0b7e56 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:34.447675 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b374c94-7720-4cde-88ee-182fdb0b7e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:34.488976 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-1b374c94-7720-4cde-88ee-182fdb0b7e56 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:34.490499 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1b374c94-7720-4cde-88ee-182fdb0b7e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:34.562485 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 823/1639] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:44:34.616227 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 817/1640] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:34.624697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4d9ce-52d2-4a79-83c6-c2a2ead82912 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:34.628060 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-dab4d9ce-52d2-4a79-83c6-c2a2ead82912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:34.651754 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:34.742509 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b374c94-7720-4cde-88ee-182fdb0b7e56 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:34.745157 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1b374c94-7720-4cde-88ee-182fdb0b7e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:34.855273 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab4d9ce-52d2-4a79-83c6-c2a2ead82912 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:34.992467 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8794b6d-4b5d-46c2-892c-6716265252fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:34.993800 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8794b6d-4b5d-46c2-892c-6716265252fa service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:34.994276 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8794b6d-4b5d-46c2-892c-6716265252fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:34.994721 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8794b6d-4b5d-46c2-892c-6716265252fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:35.009312 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b374c94-7720-4cde-88ee-182fdb0b7e56 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:35.020793 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8794b6d-4b5d-46c2-892c-6716265252fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:35.022823 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8794b6d-4b5d-46c2-892c-6716265252fa service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:35.023937 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046c746-abc8-49c0-b7c4-db0b9a5dba3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:35.024627 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046c746-abc8-49c0-b7c4-db0b9a5dba3a service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:35.024908 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046c746-abc8-49c0-b7c4-db0b9a5dba3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:35.025419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046c746-abc8-49c0-b7c4-db0b9a5dba3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:35.047684 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6046c746-abc8-49c0-b7c4-db0b9a5dba3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:35.049331 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6046c746-abc8-49c0-b7c4-db0b9a5dba3a service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:35.049541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 824/1641] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:44:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:44:35.050484 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8794b6d-4b5d-46c2-892c-6716265252fa service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:35.052486 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b8794b6d-4b5d-46c2-892c-6716265252fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:35.065972 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 818/1642] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:44:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:44:35.080021 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8794b6d-4b5d-46c2-892c-6716265252fa service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:35.092718 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88889fe2-1e22-4c7a-b87c-c67d9c234439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:35.097842 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88889fe2-1e22-4c7a-b87c-c67d9c234439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:35.098966 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88889fe2-1e22-4c7a-b87c-c67d9c234439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:35.099418 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88889fe2-1e22-4c7a-b87c-c67d9c234439 admin admin] PATH_INFO: `/v3/users/984878e87a074edda728661916adddbd` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:35.103907 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88889fe2-1e22-4c7a-b87c-c67d9c234439 admin admin] RBAC: Authorizing `identity:delete_user(user_id=984878e87a074edda728661916adddbd)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:35.109570 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88889fe2-1e22-4c7a-b87c-c67d9c234439 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:35.248711 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-88889fe2-1e22-4c7a-b87c-c67d9c234439 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '984878e87a074edda728661916adddbd'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:35.276277 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-88889fe2-1e22-4c7a-b87c-c67d9c234439 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '984878e87a074edda728661916adddbd'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:35.279346 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-88889fe2-1e22-4c7a-b87c-c67d9c234439 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '984878e87a074edda728661916adddbd'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:35.344073 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-88889fe2-1e22-4c7a-b87c-c67d9c234439 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '984878e87a074edda728661916adddbd'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:35.389558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-88889fe2-1e22-4c7a-b87c-c67d9c234439 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '984878e87a074edda728661916adddbd'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:35.423357 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 825/1643] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:44:35 2022] DELETE /identity/v3/users/984878e87a074edda728661916adddbd => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:35.424412 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab69bf1-c394-4ad5-9d51-39863173c828 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:35.424735 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab69bf1-c394-4ad5-9d51-39863173c828 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:35.425035 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab69bf1-c394-4ad5-9d51-39863173c828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:35.472449 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-1ab69bf1-c394-4ad5-9d51-39863173c828 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:35.473791 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1ab69bf1-c394-4ad5-9d51-39863173c828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:35.542528 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:35.606784 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 819/1644] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:35.666298 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88889fe2-1e22-4c7a-b87c-c67d9c234439 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:35.667945 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-88889fe2-1e22-4c7a-b87c-c67d9c234439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:35.798837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:35.841390 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88889fe2-1e22-4c7a-b87c-c67d9c234439 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:35.846330 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a1e79-16c3-4530-a06a-34c9c4bf1066 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:35.847061 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a1e79-16c3-4530-a06a-34c9c4bf1066 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:35.847341 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a1e79-16c3-4530-a06a-34c9c4bf1066 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:35.847613 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a1e79-16c3-4530-a06a-34c9c4bf1066 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:35.867792 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a1e79-16c3-4530-a06a-34c9c4bf1066 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:35.870845 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a1e79-16c3-4530-a06a-34c9c4bf1066 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:35.893372 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 826/1645] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:44:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:44:38.302573 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab69bf1-c394-4ad5-9d51-39863173c828 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:38.305479 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1ab69bf1-c394-4ad5-9d51-39863173c828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:38.346909 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a1e79-16c3-4530-a06a-34c9c4bf1066 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:38.353600 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-245a1e79-16c3-4530-a06a-34c9c4bf1066 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:38.361688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab69bf1-c394-4ad5-9d51-39863173c828 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:38.394437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2ba9c-722c-4105-9bac-8a7adf0340c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:38.395299 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a1e79-16c3-4530-a06a-34c9c4bf1066 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:38.396659 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2ba9c-722c-4105-9bac-8a7adf0340c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:38.397524 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2ba9c-722c-4105-9bac-8a7adf0340c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:38.401274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2ba9c-722c-4105-9bac-8a7adf0340c6 admin admin] PATH_INFO: `/v3/projects/d4ab480e6ccc4b1ea8e509e606edf09b` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:38.408980 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35539f3-0081-4430-b57f-37b0aad325b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:38.410950 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35539f3-0081-4430-b57f-37b0aad325b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:38.411272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35539f3-0081-4430-b57f-37b0aad325b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:38.411495 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35539f3-0081-4430-b57f-37b0aad325b8 admin admin] PATH_INFO: `/v3/projects/8f6d83a5a22341079d52c5d6ef166969` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:38.416298 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35539f3-0081-4430-b57f-37b0aad325b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f6d83a5a22341079d52c5d6ef166969)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:38.419470 dv-cinder-836083-14-smb devstack@keystone.service[81683]: WARNING py.warnings [None req-f35539f3-0081-4430-b57f-37b0aad325b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 26 05:44:38.419470 dv-cinder-836083-14-smb devstack@keystone.service[81683]: warnings.warn(msg) Sep 26 05:44:38.419470 dv-cinder-836083-14-smb devstack@keystone.service[81683]: Sep 26 05:44:38.421556 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35539f3-0081-4430-b57f-37b0aad325b8 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:38.443586 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e2ba9c-722c-4105-9bac-8a7adf0340c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4ab480e6ccc4b1ea8e509e606edf09b)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:38.459483 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e2ba9c-722c-4105-9bac-8a7adf0340c6 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:38.662329 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f35539f3-0081-4430-b57f-37b0aad325b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f6d83a5a22341079d52c5d6ef166969', 'request_id': 'req-f35539f3-0081-4430-b57f-37b0aad325b8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:38.688371 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f35539f3-0081-4430-b57f-37b0aad325b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f6d83a5a22341079d52c5d6ef166969', 'request_id': 'req-f35539f3-0081-4430-b57f-37b0aad325b8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:38.730086 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d6e2ba9c-722c-4105-9bac-8a7adf0340c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4ab480e6ccc4b1ea8e509e606edf09b', 'request_id': 'req-d6e2ba9c-722c-4105-9bac-8a7adf0340c6'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:38.755134 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d6e2ba9c-722c-4105-9bac-8a7adf0340c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4ab480e6ccc4b1ea8e509e606edf09b', 'request_id': 'req-d6e2ba9c-722c-4105-9bac-8a7adf0340c6'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:38.780754 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f35539f3-0081-4430-b57f-37b0aad325b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f6d83a5a22341079d52c5d6ef166969', 'request_id': 'req-f35539f3-0081-4430-b57f-37b0aad325b8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:38.782520 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d6e2ba9c-722c-4105-9bac-8a7adf0340c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4ab480e6ccc4b1ea8e509e606edf09b', 'request_id': 'req-d6e2ba9c-722c-4105-9bac-8a7adf0340c6'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:38.819967 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f35539f3-0081-4430-b57f-37b0aad325b8 admin admin] The token cache is being invalidate because project 8f6d83a5a22341079d52c5d6ef166969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:44:38.820468 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f35539f3-0081-4430-b57f-37b0aad325b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:38.821415 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f35539f3-0081-4430-b57f-37b0aad325b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:38.825950 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 827/1646] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:44:38 2022] DELETE /identity/v3/projects/8f6d83a5a22341079d52c5d6ef166969 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:38.830749 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35539f3-0081-4430-b57f-37b0aad325b8 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:38.833388 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f35539f3-0081-4430-b57f-37b0aad325b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:38.866541 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d6e2ba9c-722c-4105-9bac-8a7adf0340c6 admin admin] The token cache is being invalidate because project d4ab480e6ccc4b1ea8e509e606edf09b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:44:38.867041 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d6e2ba9c-722c-4105-9bac-8a7adf0340c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:38.873902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d6e2ba9c-722c-4105-9bac-8a7adf0340c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:38.887290 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 820/1647] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:44:38 2022] DELETE /identity/v3/projects/d4ab480e6ccc4b1ea8e509e606edf09b => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:38.888486 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2ba9c-722c-4105-9bac-8a7adf0340c6 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:38.894639 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d6e2ba9c-722c-4105-9bac-8a7adf0340c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:39.067314 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35539f3-0081-4430-b57f-37b0aad325b8 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:39.186105 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2ba9c-722c-4105-9bac-8a7adf0340c6 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:39.234951 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad7fcf-a6d7-40b5-951a-b36cb8307b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:39.236243 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad7fcf-a6d7-40b5-951a-b36cb8307b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:39.236737 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad7fcf-a6d7-40b5-951a-b36cb8307b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:39.244756 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad7fcf-a6d7-40b5-951a-b36cb8307b9c admin admin] PATH_INFO: `/v3/users/948db27ebf6b43129f5ac74f15e06c5f` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:39.255202 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad7fcf-a6d7-40b5-951a-b36cb8307b9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=948db27ebf6b43129f5ac74f15e06c5f)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:39.267228 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad7fcf-a6d7-40b5-951a-b36cb8307b9c admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:39.322168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826aa8d8-7a99-470d-8907-34fd811b98ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:39.322945 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826aa8d8-7a99-470d-8907-34fd811b98ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:39.340147 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826aa8d8-7a99-470d-8907-34fd811b98ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:39.340508 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826aa8d8-7a99-470d-8907-34fd811b98ae admin admin] PATH_INFO: `/v3/projects/3d921aafe2a54f848df305fec51b6a25` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:39.348253 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826aa8d8-7a99-470d-8907-34fd811b98ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d921aafe2a54f848df305fec51b6a25)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:39.358562 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826aa8d8-7a99-470d-8907-34fd811b98ae admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:39.472705 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:39.579879 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1dad7fcf-a6d7-40b5-951a-b36cb8307b9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '948db27ebf6b43129f5ac74f15e06c5f'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:39.626160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1dad7fcf-a6d7-40b5-951a-b36cb8307b9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '948db27ebf6b43129f5ac74f15e06c5f'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:39.637720 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:39.693902 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-826aa8d8-7a99-470d-8907-34fd811b98ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d921aafe2a54f848df305fec51b6a25', 'request_id': 'req-826aa8d8-7a99-470d-8907-34fd811b98ae'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:39.753096 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-826aa8d8-7a99-470d-8907-34fd811b98ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d921aafe2a54f848df305fec51b6a25', 'request_id': 'req-826aa8d8-7a99-470d-8907-34fd811b98ae'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:39.761439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1dad7fcf-a6d7-40b5-951a-b36cb8307b9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '948db27ebf6b43129f5ac74f15e06c5f'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:39.765674 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1dad7fcf-a6d7-40b5-951a-b36cb8307b9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '948db27ebf6b43129f5ac74f15e06c5f'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:39.785752 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-826aa8d8-7a99-470d-8907-34fd811b98ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d921aafe2a54f848df305fec51b6a25', 'request_id': 'req-826aa8d8-7a99-470d-8907-34fd811b98ae'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:39.828278 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-826aa8d8-7a99-470d-8907-34fd811b98ae admin admin] The token cache is being invalidate because project 3d921aafe2a54f848df305fec51b6a25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:44:39.828554 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-826aa8d8-7a99-470d-8907-34fd811b98ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:39.830062 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-826aa8d8-7a99-470d-8907-34fd811b98ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:39.835297 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 828/1648] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:44:38 2022] DELETE /identity/v3/projects/3d921aafe2a54f848df305fec51b6a25 => generated 0 bytes in 1009 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:39.838620 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb12908-c853-449f-943a-1d415eec07d1 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:39.841854 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb12908-c853-449f-943a-1d415eec07d1 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:39.842542 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb12908-c853-449f-943a-1d415eec07d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:39.844097 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1dad7fcf-a6d7-40b5-951a-b36cb8307b9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '948db27ebf6b43129f5ac74f15e06c5f'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:39.901363 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-0cb12908-c853-449f-943a-1d415eec07d1 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:39.903057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0cb12908-c853-449f-943a-1d415eec07d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:39.924771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 821/1649] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:44:38 2022] DELETE /identity/v3/users/948db27ebf6b43129f5ac74f15e06c5f => generated 0 bytes in 1037 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:39.943089 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6145c-3d93-438d-a238-3f9089dd92c7 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:39.943909 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6145c-3d93-438d-a238-3f9089dd92c7 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:39.945504 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6145c-3d93-438d-a238-3f9089dd92c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:40.063887 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 829/1650] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:40.081922 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfdf41-cb59-4574-a757-38673f84b1e8 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:40.082381 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfdf41-cb59-4574-a757-38673f84b1e8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:40.083163 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfdf41-cb59-4574-a757-38673f84b1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:40.109318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-82a6145c-3d93-438d-a238-3f9089dd92c7 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:40.112647 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-82a6145c-3d93-438d-a238-3f9089dd92c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:40.133118 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 822/1651] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:40.145912 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8736946-6d16-41fa-859f-bb4243473cff None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:40.153124 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8736946-6d16-41fa-859f-bb4243473cff None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:40.156197 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8736946-6d16-41fa-859f-bb4243473cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:40.206632 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-dccfdf41-cb59-4574-a757-38673f84b1e8 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:40.213591 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-dccfdf41-cb59-4574-a757-38673f84b1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:40.241291 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-d8736946-6d16-41fa-859f-bb4243473cff None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:40.246342 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d8736946-6d16-41fa-859f-bb4243473cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:40.259113 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 830/1652] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:40.260492 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfdf41-cb59-4574-a757-38673f84b1e8 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:40.280711 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 823/1653] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:44:40.283638 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8736946-6d16-41fa-859f-bb4243473cff None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:40.286276 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfdf41-cb59-4574-a757-38673f84b1e8 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:40.309333 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8736946-6d16-41fa-859f-bb4243473cff None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:40.309733 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d1823-b644-4a96-9370-90d3a41d5561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:40.310888 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d1823-b644-4a96-9370-90d3a41d5561 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:40.311352 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d1823-b644-4a96-9370-90d3a41d5561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:40.312150 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d1823-b644-4a96-9370-90d3a41d5561 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:40.313708 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d1823-b644-4a96-9370-90d3a41d5561 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:44:40.314247 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d1823-b644-4a96-9370-90d3a41d5561 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:40.318134 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d1823-b644-4a96-9370-90d3a41d5561 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:40.330124 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b779f4-9f46-45fb-a135-6444ff5d9149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:40.331950 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b779f4-9f46-45fb-a135-6444ff5d9149 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:40.332881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b779f4-9f46-45fb-a135-6444ff5d9149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:40.333499 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b779f4-9f46-45fb-a135-6444ff5d9149 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:40.336343 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b779f4-9f46-45fb-a135-6444ff5d9149 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:44:40.337768 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b779f4-9f46-45fb-a135-6444ff5d9149 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:40.344595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b779f4-9f46-45fb-a135-6444ff5d9149 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:40.352799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 831/1654] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:44:40.359863 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d1823-b644-4a96-9370-90d3a41d5561 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:40.387594 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d1823-b644-4a96-9370-90d3a41d5561 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:40.397671 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 824/1655] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:44:40.401049 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b779f4-9f46-45fb-a135-6444ff5d9149 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:40.408343 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a8ac4-bc36-4299-be77-4016c2ea71c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:40.411354 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a8ac4-bc36-4299-be77-4016c2ea71c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:40.412382 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a8ac4-bc36-4299-be77-4016c2ea71c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:40.413761 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a8ac4-bc36-4299-be77-4016c2ea71c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:40.416695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a8ac4-bc36-4299-be77-4016c2ea71c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:40.425795 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a8ac4-bc36-4299-be77-4016c2ea71c3 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:40.444080 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b779f4-9f46-45fb-a135-6444ff5d9149 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:40.463680 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf7054-ae64-4f90-a5ad-c3bdbe23fa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:40.465005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf7054-ae64-4f90-a5ad-c3bdbe23fa62 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:40.465612 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf7054-ae64-4f90-a5ad-c3bdbe23fa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:40.466220 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf7054-ae64-4f90-a5ad-c3bdbe23fa62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:40.467547 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf7054-ae64-4f90-a5ad-c3bdbe23fa62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:40.472036 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf7054-ae64-4f90-a5ad-c3bdbe23fa62 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:40.499345 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 832/1656] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:44:40 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:44:40.508584 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a8ac4-bc36-4299-be77-4016c2ea71c3 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:40.611424 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 825/1657] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:44:40 2022] POST /identity/v3/projects => generated 379 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:44:40.618493 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf7054-ae64-4f90-a5ad-c3bdbe23fa62 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:40.792277 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a8ac4-bc36-4299-be77-4016c2ea71c3 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:40.812382 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:40.916984 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf7054-ae64-4f90-a5ad-c3bdbe23fa62 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:40.967013 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a5f29-c6d1-4533-be7f-154a8fd25d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:40.979501 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a5f29-c6d1-4533-be7f-154a8fd25d56 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:40.979501 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a5f29-c6d1-4533-be7f-154a8fd25d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:40.982850 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a5f29-c6d1-4533-be7f-154a8fd25d56 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:40.987084 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a5f29-c6d1-4533-be7f-154a8fd25d56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:41.005369 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820a5f29-c6d1-4533-be7f-154a8fd25d56 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:41.051453 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cd3df-81a2-4729-9d18-faec03dd9656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:41.052832 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cd3df-81a2-4729-9d18-faec03dd9656 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:41.055209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cd3df-81a2-4729-9d18-faec03dd9656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:41.068643 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cd3df-81a2-4729-9d18-faec03dd9656 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:41.069473 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11cd3df-81a2-4729-9d18-faec03dd9656 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:41.076522 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11cd3df-81a2-4729-9d18-faec03dd9656 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:41.151822 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 826/1658] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:44:40 2022] POST /identity/v3/users => generated 290 bytes in 534 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:44:41.156910 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 833/1659] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:44:40 2022] POST /identity/v3/users => generated 291 bytes in 653 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:44:41.163013 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a5f29-c6d1-4533-be7f-154a8fd25d56 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:41.163258 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cd3df-81a2-4729-9d18-faec03dd9656 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:41.200611 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cd3df-81a2-4729-9d18-faec03dd9656 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:41.211995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820a5f29-c6d1-4533-be7f-154a8fd25d56 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:41.234594 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecbf6d6-0e36-45a5-b178-90980b307b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:41.235800 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecbf6d6-0e36-45a5-b178-90980b307b77 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:41.236418 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecbf6d6-0e36-45a5-b178-90980b307b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:41.240278 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecbf6d6-0e36-45a5-b178-90980b307b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:41.240855 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db83c70-66de-4c7a-8432-b3b478012291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:41.241978 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db83c70-66de-4c7a-8432-b3b478012291 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:41.242296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db83c70-66de-4c7a-8432-b3b478012291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:41.242531 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db83c70-66de-4c7a-8432-b3b478012291 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:41.243202 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db83c70-66de-4c7a-8432-b3b478012291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:41.248063 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecbf6d6-0e36-45a5-b178-90980b307b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:41.248586 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db83c70-66de-4c7a-8432-b3b478012291 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:41.252472 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecbf6d6-0e36-45a5-b178-90980b307b77 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:41.290185 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 827/1660] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:44:41.291542 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db83c70-66de-4c7a-8432-b3b478012291 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:41.301818 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 834/1661] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:44:41.304240 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecbf6d6-0e36-45a5-b178-90980b307b77 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:41.324242 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db83c70-66de-4c7a-8432-b3b478012291 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:41.347429 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecbf6d6-0e36-45a5-b178-90980b307b77 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:41.355533 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464d78b-2182-48e4-86ee-702ce48fa1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:41.356124 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464d78b-2182-48e4-86ee-702ce48fa1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:41.356688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464d78b-2182-48e4-86ee-702ce48fa1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:41.357265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464d78b-2182-48e4-86ee-702ce48fa1b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:41.358086 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464d78b-2182-48e4-86ee-702ce48fa1b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:41.360121 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464d78b-2182-48e4-86ee-702ce48fa1b7 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:41.369045 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0a4d7-0c30-43bd-a4b4-8b39ef442e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:41.370245 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0a4d7-0c30-43bd-a4b4-8b39ef442e2d admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:41.370813 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0a4d7-0c30-43bd-a4b4-8b39ef442e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:41.372279 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d0a4d7-0c30-43bd-a4b4-8b39ef442e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:41.375900 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0a4d7-0c30-43bd-a4b4-8b39ef442e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:41.379215 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d0a4d7-0c30-43bd-a4b4-8b39ef442e2d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:41.424915 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 828/1662] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:44:41.427133 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464d78b-2182-48e4-86ee-702ce48fa1b7 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:41.449273 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5464d78b-2182-48e4-86ee-702ce48fa1b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:41.457484 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 835/1663] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:44:41.458429 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0a4d7-0c30-43bd-a4b4-8b39ef442e2d admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:41.486503 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d0a4d7-0c30-43bd-a4b4-8b39ef442e2d admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:41.498670 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912ef5e-9e9a-4eaa-9f9d-cc8c9460de5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:41.501769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912ef5e-9e9a-4eaa-9f9d-cc8c9460de5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:41.502654 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912ef5e-9e9a-4eaa-9f9d-cc8c9460de5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:41.505661 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464d78b-2182-48e4-86ee-702ce48fa1b7 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:41.509943 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912ef5e-9e9a-4eaa-9f9d-cc8c9460de5f admin admin] PATH_INFO: `/v3/projects/75ff01eb83f049c688ecb757a690958b/users/1f551f069a5c4fff9b7c75e28f27b1f5/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:41.532670 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfaae12-a91c-4a67-94a8-e8ea07c413d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:41.534313 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfaae12-a91c-4a67-94a8-e8ea07c413d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:41.535099 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfaae12-a91c-4a67-94a8-e8ea07c413d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:41.536213 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfaae12-a91c-4a67-94a8-e8ea07c413d9 admin admin] PATH_INFO: `/v3/users/066b5424bd294c30b78768e1da57ba4f` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:41.542814 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfaae12-a91c-4a67-94a8-e8ea07c413d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=066b5424bd294c30b78768e1da57ba4f)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:41.547301 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfaae12-a91c-4a67-94a8-e8ea07c413d9 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:41.612644 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912ef5e-9e9a-4eaa-9f9d-cc8c9460de5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=75ff01eb83f049c688ecb757a690958b, user_id=1f551f069a5c4fff9b7c75e28f27b1f5, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:41.621639 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912ef5e-9e9a-4eaa-9f9d-cc8c9460de5f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:41.672826 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 836/1664] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:44:41 2022] PUT /identity/v3/projects/75ff01eb83f049c688ecb757a690958b/users/1f551f069a5c4fff9b7c75e28f27b1f5/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:41.677652 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912ef5e-9e9a-4eaa-9f9d-cc8c9460de5f admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:41.778487 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:41.785068 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-2bfaae12-a91c-4a67-94a8-e8ea07c413d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '066b5424bd294c30b78768e1da57ba4f'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:41.819830 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-2bfaae12-a91c-4a67-94a8-e8ea07c413d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '066b5424bd294c30b78768e1da57ba4f'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:41.877253 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-2bfaae12-a91c-4a67-94a8-e8ea07c413d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '066b5424bd294c30b78768e1da57ba4f'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:41.878573 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-2bfaae12-a91c-4a67-94a8-e8ea07c413d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '066b5424bd294c30b78768e1da57ba4f'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:41.922713 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-2bfaae12-a91c-4a67-94a8-e8ea07c413d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '066b5424bd294c30b78768e1da57ba4f'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:41.959664 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 829/1665] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:44:41 2022] DELETE /identity/v3/users/066b5424bd294c30b78768e1da57ba4f => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:41.962126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b457f-d4db-448e-b83d-2db0f6f5794b None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:41.962597 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b457f-d4db-448e-b83d-2db0f6f5794b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:41.963878 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b457f-d4db-448e-b83d-2db0f6f5794b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:42.095593 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-ea6b457f-d4db-448e-b83d-2db0f6f5794b None None] MFA Rules not processed for user `1f551f069a5c4fff9b7c75e28f27b1f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:42.098024 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ea6b457f-d4db-448e-b83d-2db0f6f5794b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:42.106214 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912ef5e-9e9a-4eaa-9f9d-cc8c9460de5f admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:42.244275 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0954c45-d30f-4b4e-9eaf-11405088f105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:42.246635 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0954c45-d30f-4b4e-9eaf-11405088f105 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:42.247114 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0954c45-d30f-4b4e-9eaf-11405088f105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:42.247530 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0954c45-d30f-4b4e-9eaf-11405088f105 admin admin] PATH_INFO: `/v3/projects/f3822d3cf1954b5abd7102948c801bff/users/c727373260864e158451642496b83957/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:42.254210 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:42.288215 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0954c45-d30f-4b4e-9eaf-11405088f105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3822d3cf1954b5abd7102948c801bff, user_id=c727373260864e158451642496b83957, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:42.290610 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0954c45-d30f-4b4e-9eaf-11405088f105 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:42.311375 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 837/1666] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:44:41 2022] PUT /identity/v3/projects/f3822d3cf1954b5abd7102948c801bff/users/c727373260864e158451642496b83957/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:42.324326 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c36179-cc5e-474e-999b-9708abda2f1f None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:42.324326 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c36179-cc5e-474e-999b-9708abda2f1f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:42.324326 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c36179-cc5e-474e-999b-9708abda2f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:42.350272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-18c36179-cc5e-474e-999b-9708abda2f1f None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:42.351553 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-18c36179-cc5e-474e-999b-9708abda2f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:42.467680 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 838/1667] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:42.467680 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87577bc3-c514-4d0e-b653-8809fb2da572 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:42.467680 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87577bc3-c514-4d0e-b653-8809fb2da572 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:42.467680 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87577bc3-c514-4d0e-b653-8809fb2da572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:42.479336 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 830/1668] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 519 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:42.486875 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b457f-d4db-448e-b83d-2db0f6f5794b None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:42.489960 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ea6b457f-d4db-448e-b83d-2db0f6f5794b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:42.510220 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-87577bc3-c514-4d0e-b653-8809fb2da572 None None] MFA Rules not processed for user `c727373260864e158451642496b83957`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:42.511770 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-87577bc3-c514-4d0e-b653-8809fb2da572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:42.558160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b457f-d4db-448e-b83d-2db0f6f5794b None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:42.589483 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d554e54-bc8f-4c98-ac7b-9796d9d13304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:42.591504 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d554e54-bc8f-4c98-ac7b-9796d9d13304 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:42.598305 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d554e54-bc8f-4c98-ac7b-9796d9d13304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:42.599218 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d554e54-bc8f-4c98-ac7b-9796d9d13304 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:42.604263 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d554e54-bc8f-4c98-ac7b-9796d9d13304 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:42.606321 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d554e54-bc8f-4c98-ac7b-9796d9d13304 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:42.701980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 831/1669] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:44:42 2022] POST /identity/v3/projects => generated 381 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:44:42.703165 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d554e54-bc8f-4c98-ac7b-9796d9d13304 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:42.705129 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-3d554e54-bc8f-4c98-ac7b-9796d9d13304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:42.738337 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 839/1670] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:42.738337 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87577bc3-c514-4d0e-b653-8809fb2da572 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:42.743397 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-87577bc3-c514-4d0e-b653-8809fb2da572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:42.779975 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87577bc3-c514-4d0e-b653-8809fb2da572 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:42.852666 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d554e54-bc8f-4c98-ac7b-9796d9d13304 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:42.870969 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98a778-8be6-4eae-8d1c-0139d8820638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:42.871995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98a778-8be6-4eae-8d1c-0139d8820638 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:42.872464 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98a778-8be6-4eae-8d1c-0139d8820638 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:42.873088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98a778-8be6-4eae-8d1c-0139d8820638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:42.983123 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:43.028909 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98a778-8be6-4eae-8d1c-0139d8820638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:43.030802 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a98a778-8be6-4eae-8d1c-0139d8820638 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:43.057502 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8de614-3c87-4012-9ed0-34b70d3a6b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:43.058062 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 832/1671] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:44:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:44:43.058968 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98a778-8be6-4eae-8d1c-0139d8820638 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:43.063661 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8de614-3c87-4012-9ed0-34b70d3a6b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:43.064310 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8de614-3c87-4012-9ed0-34b70d3a6b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:43.064857 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8de614-3c87-4012-9ed0-34b70d3a6b94 admin admin] PATH_INFO: `/v3/projects/20b72a0ec63a4529ab2d7cb85d9dcd79` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:43.070882 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8de614-3c87-4012-9ed0-34b70d3a6b94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20b72a0ec63a4529ab2d7cb85d9dcd79)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:43.079311 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8de614-3c87-4012-9ed0-34b70d3a6b94 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:43.080638 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a98a778-8be6-4eae-8d1c-0139d8820638 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:43.097151 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a49734-33dc-4ddc-8c45-4ff6677c3ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:43.097689 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a49734-33dc-4ddc-8c45-4ff6677c3ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:43.097965 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a49734-33dc-4ddc-8c45-4ff6677c3ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:43.098233 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a49734-33dc-4ddc-8c45-4ff6677c3ef6 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:43.098892 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a49734-33dc-4ddc-8c45-4ff6677c3ef6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:43.100998 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a49734-33dc-4ddc-8c45-4ff6677c3ef6 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:43.159639 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 833/1672] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:44:43 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:44:43.159639 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a49734-33dc-4ddc-8c45-4ff6677c3ef6 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:43.160373 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-29a49734-33dc-4ddc-8c45-4ff6677c3ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:43.161254 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:43.195155 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a49734-33dc-4ddc-8c45-4ff6677c3ef6 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:43.207683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ca100-e1fe-4f22-8c42-b6699105e73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:43.208359 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ca100-e1fe-4f22-8c42-b6699105e73e admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:43.208640 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ca100-e1fe-4f22-8c42-b6699105e73e admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:43.208917 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ca100-e1fe-4f22-8c42-b6699105e73e admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:43.209699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ca100-e1fe-4f22-8c42-b6699105e73e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:43.211598 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ca100-e1fe-4f22-8c42-b6699105e73e admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:43.290330 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8f8de614-3c87-4012-9ed0-34b70d3a6b94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20b72a0ec63a4529ab2d7cb85d9dcd79', 'request_id': 'req-8f8de614-3c87-4012-9ed0-34b70d3a6b94'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:43.303492 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 834/1673] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:44:43 2022] POST /identity/v3/projects => generated 379 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:44:43.304256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ca100-e1fe-4f22-8c42-b6699105e73e admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:43.308643 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8f8de614-3c87-4012-9ed0-34b70d3a6b94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20b72a0ec63a4529ab2d7cb85d9dcd79', 'request_id': 'req-8f8de614-3c87-4012-9ed0-34b70d3a6b94'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:43.328485 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8f8de614-3c87-4012-9ed0-34b70d3a6b94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20b72a0ec63a4529ab2d7cb85d9dcd79', 'request_id': 'req-8f8de614-3c87-4012-9ed0-34b70d3a6b94'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:43.359618 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8f8de614-3c87-4012-9ed0-34b70d3a6b94 admin admin] The token cache is being invalidate because project 20b72a0ec63a4529ab2d7cb85d9dcd79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:44:43.359922 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8f8de614-3c87-4012-9ed0-34b70d3a6b94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:43.360852 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8f8de614-3c87-4012-9ed0-34b70d3a6b94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:43.369017 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 840/1674] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:44:42 2022] DELETE /identity/v3/projects/20b72a0ec63a4529ab2d7cb85d9dcd79 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:43.370127 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8de614-3c87-4012-9ed0-34b70d3a6b94 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:43.373396 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8f8de614-3c87-4012-9ed0-34b70d3a6b94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:43.446281 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ca100-e1fe-4f22-8c42-b6699105e73e admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:43.453244 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a90a27-04e2-413d-9536-3f471aea26ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:43.454003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a90a27-04e2-413d-9536-3f471aea26ad admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:43.454374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a90a27-04e2-413d-9536-3f471aea26ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:43.454738 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a90a27-04e2-413d-9536-3f471aea26ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:43.455514 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a90a27-04e2-413d-9536-3f471aea26ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:43.459176 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a90a27-04e2-413d-9536-3f471aea26ad admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:43.477366 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 835/1675] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:44:43.477366 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75529a70-9e5d-4542-bda0-07efac1e62b9 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:43.477366 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75529a70-9e5d-4542-bda0-07efac1e62b9 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:43.477366 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75529a70-9e5d-4542-bda0-07efac1e62b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:43.509477 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-75529a70-9e5d-4542-bda0-07efac1e62b9 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:43.511008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-75529a70-9e5d-4542-bda0-07efac1e62b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:43.532401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 836/1676] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:43.535511 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75529a70-9e5d-4542-bda0-07efac1e62b9 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:43.543703 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-75529a70-9e5d-4542-bda0-07efac1e62b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:43.595249 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8de614-3c87-4012-9ed0-34b70d3a6b94 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:43.600271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75529a70-9e5d-4542-bda0-07efac1e62b9 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:43.619193 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0d144-2050-400f-8e5a-f2c744b06348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:43.620273 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0d144-2050-400f-8e5a-f2c744b06348 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:43.620764 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0d144-2050-400f-8e5a-f2c744b06348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:43.621371 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0d144-2050-400f-8e5a-f2c744b06348 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:43.622297 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0d144-2050-400f-8e5a-f2c744b06348 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:43.625290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0d144-2050-400f-8e5a-f2c744b06348 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:43.630116 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb2731-30f8-40aa-a063-7205f6dc47af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:43.631225 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb2731-30f8-40aa-a063-7205f6dc47af admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:43.631688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb2731-30f8-40aa-a063-7205f6dc47af admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:43.632187 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb2731-30f8-40aa-a063-7205f6dc47af admin admin] PATH_INFO: `/v3/projects/a887e75fff7c43b48a88b5e03068c4bc/users/a86cda49549c4cd2ab20315c81a27955/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:43.661162 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 841/1677] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:44:43 2022] POST /identity/v3/users => generated 296 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:44:43.663198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcddd1-146f-428e-a57a-383ca1e3b1b2 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:43.663997 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcddd1-146f-428e-a57a-383ca1e3b1b2 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:43.676352 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcddd1-146f-428e-a57a-383ca1e3b1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:43.693624 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb2731-30f8-40aa-a063-7205f6dc47af admin admin] RBAC: Authorizing `identity:create_grant(project_id=a887e75fff7c43b48a88b5e03068c4bc, user_id=a86cda49549c4cd2ab20315c81a27955, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:43.706067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb2731-30f8-40aa-a063-7205f6dc47af admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:43.715376 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-93bcddd1-146f-428e-a57a-383ca1e3b1b2 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:43.726661 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-93bcddd1-146f-428e-a57a-383ca1e3b1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:43.750258 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 837/1678] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:44:43 2022] PUT /identity/v3/projects/a887e75fff7c43b48a88b5e03068c4bc/users/a86cda49549c4cd2ab20315c81a27955/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:43.761354 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb2731-30f8-40aa-a063-7205f6dc47af admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:43.922055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 842/1679] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:43.922055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bcddd1-146f-428e-a57a-383ca1e3b1b2 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:43.950613 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bcddd1-146f-428e-a57a-383ca1e3b1b2 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:43.963101 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e74f00-eba3-4592-ad91-f1935fd6020f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:43.963767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e74f00-eba3-4592-ad91-f1935fd6020f admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:43.967033 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e74f00-eba3-4592-ad91-f1935fd6020f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:43.967533 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e74f00-eba3-4592-ad91-f1935fd6020f admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:43.968532 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e74f00-eba3-4592-ad91-f1935fd6020f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:43.971017 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e74f00-eba3-4592-ad91-f1935fd6020f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:43.996549 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 843/1680] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:44:43.996549 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e74f00-eba3-4592-ad91-f1935fd6020f admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:44.002320 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb2731-30f8-40aa-a063-7205f6dc47af admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:44.011021 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e74f00-eba3-4592-ad91-f1935fd6020f admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:44.018501 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1101290-5404-4b34-a723-ebfaf4214473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:44.021365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1101290-5404-4b34-a723-ebfaf4214473 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:44.021762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1101290-5404-4b34-a723-ebfaf4214473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:44.021930 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1101290-5404-4b34-a723-ebfaf4214473 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:44.022658 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1101290-5404-4b34-a723-ebfaf4214473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:44.026353 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037cd72-1504-4a3c-a6d7-0ce459086a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:44.028211 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037cd72-1504-4a3c-a6d7-0ce459086a90 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:44.029454 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1101290-5404-4b34-a723-ebfaf4214473 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:44.029622 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037cd72-1504-4a3c-a6d7-0ce459086a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:44.031386 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037cd72-1504-4a3c-a6d7-0ce459086a90 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:44.033312 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037cd72-1504-4a3c-a6d7-0ce459086a90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:44:44.033682 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037cd72-1504-4a3c-a6d7-0ce459086a90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:44.039380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037cd72-1504-4a3c-a6d7-0ce459086a90 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:44.069372 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 844/1681] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:44:44.070988 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037cd72-1504-4a3c-a6d7-0ce459086a90 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:44.085153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037cd72-1504-4a3c-a6d7-0ce459086a90 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:44.091493 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 838/1682] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:44:44.093227 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1101290-5404-4b34-a723-ebfaf4214473 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:44.102175 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010ef83-53fb-4cc6-9258-9d04f94b1f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:44.103459 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010ef83-53fb-4cc6-9258-9d04f94b1f4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:44.104027 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010ef83-53fb-4cc6-9258-9d04f94b1f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:44.104682 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010ef83-53fb-4cc6-9258-9d04f94b1f4b admin admin] PATH_INFO: `/v3/projects/a887e75fff7c43b48a88b5e03068c4bc/users/a86cda49549c4cd2ab20315c81a27955/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:44.111944 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010ef83-53fb-4cc6-9258-9d04f94b1f4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a887e75fff7c43b48a88b5e03068c4bc, user_id=a86cda49549c4cd2ab20315c81a27955, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:44.115873 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010ef83-53fb-4cc6-9258-9d04f94b1f4b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:44.118034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:44.124392 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:44.136269 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1101290-5404-4b34-a723-ebfaf4214473 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:44.142014 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 845/1683] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:44:44 2022] PUT /identity/v3/projects/a887e75fff7c43b48a88b5e03068c4bc/users/a86cda49549c4cd2ab20315c81a27955/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:44.146591 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010ef83-53fb-4cc6-9258-9d04f94b1f4b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:44.336246 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d9440-25ac-4ad9-a378-6a2560dff58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:44.337352 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d9440-25ac-4ad9-a378-6a2560dff58b admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:44.337850 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d9440-25ac-4ad9-a378-6a2560dff58b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:44.338288 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d9440-25ac-4ad9-a378-6a2560dff58b admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:44.339474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d9440-25ac-4ad9-a378-6a2560dff58b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:44.342489 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010ef83-53fb-4cc6-9258-9d04f94b1f4b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:44.343142 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d9440-25ac-4ad9-a378-6a2560dff58b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:44.351378 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa25bcf2-64bb-4ea9-a0a6-95b05fa250ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:44.363838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25bcf2-64bb-4ea9-a0a6-95b05fa250ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:44.364283 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25bcf2-64bb-4ea9-a0a6-95b05fa250ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:44.367191 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa25bcf2-64bb-4ea9-a0a6-95b05fa250ed admin admin] PATH_INFO: `/v3/projects/c3c65a13597b4ba89ddc2c4411fcf89e/users/5e5f211de9f84b0aa02269b565b77c9d/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:44.401570 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25bcf2-64bb-4ea9-a0a6-95b05fa250ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c65a13597b4ba89ddc2c4411fcf89e, user_id=5e5f211de9f84b0aa02269b565b77c9d, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:44.406874 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa25bcf2-64bb-4ea9-a0a6-95b05fa250ed admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:44.433100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 846/1684] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:44:44 2022] PUT /identity/v3/projects/c3c65a13597b4ba89ddc2c4411fcf89e/users/5e5f211de9f84b0aa02269b565b77c9d/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:44.434332 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a42c5-b12d-4dfc-8dc3-b72c5ffdab34 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:44.434721 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a42c5-b12d-4dfc-8dc3-b72c5ffdab34 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:44.435023 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a42c5-b12d-4dfc-8dc3-b72c5ffdab34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:44.452976 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 839/1685] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:44:44 2022] POST /identity/v3/projects => generated 371 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:44:44.454605 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d9440-25ac-4ad9-a378-6a2560dff58b admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:44.482608 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-3a6a42c5-b12d-4dfc-8dc3-b72c5ffdab34 None None] MFA Rules not processed for user `a86cda49549c4cd2ab20315c81a27955`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:44.486741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3a6a42c5-b12d-4dfc-8dc3-b72c5ffdab34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:44.632084 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d9440-25ac-4ad9-a378-6a2560dff58b admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:44.639019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698a175-24af-4e08-98fa-2d375eff3055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:44.640290 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698a175-24af-4e08-98fa-2d375eff3055 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:44.640868 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698a175-24af-4e08-98fa-2d375eff3055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:44.641515 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698a175-24af-4e08-98fa-2d375eff3055 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:44.642607 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698a175-24af-4e08-98fa-2d375eff3055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:44.644841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6698a175-24af-4e08-98fa-2d375eff3055 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:44.660884 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 840/1686] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:44:44.662507 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698a175-24af-4e08-98fa-2d375eff3055 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:44.676641 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698a175-24af-4e08-98fa-2d375eff3055 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:44.685455 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d17d59-6536-48a2-b9fc-7aff460c72bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:44.687772 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d17d59-6536-48a2-b9fc-7aff460c72bf admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:44.689357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d17d59-6536-48a2-b9fc-7aff460c72bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:44.689948 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d17d59-6536-48a2-b9fc-7aff460c72bf admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:44.692661 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d17d59-6536-48a2-b9fc-7aff460c72bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:44.698676 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d17d59-6536-48a2-b9fc-7aff460c72bf admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:44.737703 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 847/1687] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:44 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:44.738395 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a42c5-b12d-4dfc-8dc3-b72c5ffdab34 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:44.757346 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 841/1688] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:44:44 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:44:44.762231 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d17d59-6536-48a2-b9fc-7aff460c72bf admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:44.769139 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a42c5-b12d-4dfc-8dc3-b72c5ffdab34 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:44.784194 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e05272-9fbd-4b3d-9c21-9fa7495a1863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:44.784980 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e05272-9fbd-4b3d-9c21-9fa7495a1863 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:44.785144 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d17d59-6536-48a2-b9fc-7aff460c72bf admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:44.785331 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e05272-9fbd-4b3d-9c21-9fa7495a1863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:44.785553 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e05272-9fbd-4b3d-9c21-9fa7495a1863 admin admin] PATH_INFO: `/v3/projects/c3c65a13597b4ba89ddc2c4411fcf89e/users/5e5f211de9f84b0aa02269b565b77c9d/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:44.792838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e05272-9fbd-4b3d-9c21-9fa7495a1863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c65a13597b4ba89ddc2c4411fcf89e, user_id=5e5f211de9f84b0aa02269b565b77c9d, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:44.795789 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e05272-9fbd-4b3d-9c21-9fa7495a1863 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:44.804571 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bd36b-16e7-4ecd-b778-76b19a77c7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:44.806014 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bd36b-16e7-4ecd-b778-76b19a77c7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:44.806685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bd36b-16e7-4ecd-b778-76b19a77c7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:44.808216 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bd36b-16e7-4ecd-b778-76b19a77c7b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:44.809952 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421bd36b-16e7-4ecd-b778-76b19a77c7b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:44.815338 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421bd36b-16e7-4ecd-b778-76b19a77c7b5 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:44.839773 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 848/1689] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:44:44 2022] PUT /identity/v3/projects/c3c65a13597b4ba89ddc2c4411fcf89e/users/5e5f211de9f84b0aa02269b565b77c9d/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:44.839773 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e05272-9fbd-4b3d-9c21-9fa7495a1863 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:44.839773 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-99e05272-9fbd-4b3d-9c21-9fa7495a1863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:44.865680 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 842/1690] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:44:44.875599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b361b-5a34-4308-b0c3-083dd1b1de00 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:44.875892 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b361b-5a34-4308-b0c3-083dd1b1de00 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:44.876179 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648b361b-5a34-4308-b0c3-083dd1b1de00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:44.979780 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-648b361b-5a34-4308-b0c3-083dd1b1de00 None None] MFA Rules not processed for user `5e5f211de9f84b0aa02269b565b77c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:44.983238 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-648b361b-5a34-4308-b0c3-083dd1b1de00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:45.093470 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e05272-9fbd-4b3d-9c21-9fa7495a1863 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:45.095506 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:45.110306 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824befd-c17a-413a-bc33-aaacd8591c4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:45.111521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824befd-c17a-413a-bc33-aaacd8591c4d service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:45.112270 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824befd-c17a-413a-bc33-aaacd8591c4d service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:45.112681 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824befd-c17a-413a-bc33-aaacd8591c4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:45.130573 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:45.157262 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 843/1691] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:44 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:45.158650 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b361b-5a34-4308-b0c3-083dd1b1de00 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:45.299464 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824befd-c17a-413a-bc33-aaacd8591c4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:45.303418 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824befd-c17a-413a-bc33-aaacd8591c4d service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:45.342450 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 849/1692] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:44:44 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:44:45.344978 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648b361b-5a34-4308-b0c3-083dd1b1de00 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:45.345804 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824befd-c17a-413a-bc33-aaacd8591c4d service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:45.349962 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6824befd-c17a-413a-bc33-aaacd8591c4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:45.354447 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5ee2c-2406-4623-9e74-d51b9b29da51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:45.361728 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5ee2c-2406-4623-9e74-d51b9b29da51 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:45.362011 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5ee2c-2406-4623-9e74-d51b9b29da51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:45.362286 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5ee2c-2406-4623-9e74-d51b9b29da51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:45.362972 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5ee2c-2406-4623-9e74-d51b9b29da51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:45.377366 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5ee2c-2406-4623-9e74-d51b9b29da51 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:45.389786 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824befd-c17a-413a-bc33-aaacd8591c4d service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:45.399454 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 844/1693] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:44:45.400277 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74060a3d-0406-432a-85f0-d5c6df02ce6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:45.401219 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74060a3d-0406-432a-85f0-d5c6df02ce6a service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:45.401531 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74060a3d-0406-432a-85f0-d5c6df02ce6a service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:45.401818 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74060a3d-0406-432a-85f0-d5c6df02ce6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:45.412566 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5ee2c-2406-4623-9e74-d51b9b29da51 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:45.415803 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-74060a3d-0406-432a-85f0-d5c6df02ce6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:45.428364 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5ee2c-2406-4623-9e74-d51b9b29da51 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:45.435513 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bbecb9-b6e0-43b0-9177-3cc82e43eda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:45.436380 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbecb9-b6e0-43b0-9177-3cc82e43eda4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:45.436662 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbecb9-b6e0-43b0-9177-3cc82e43eda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:45.437093 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bbecb9-b6e0-43b0-9177-3cc82e43eda4 admin admin] PATH_INFO: `/v3/projects/90bd5d04f6ff466c9cf7c55f7f8784a3/users/d69e005f799b4a74946aa34729825c09/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:45.476440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bbecb9-b6e0-43b0-9177-3cc82e43eda4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90bd5d04f6ff466c9cf7c55f7f8784a3, user_id=d69e005f799b4a74946aa34729825c09, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:45.479768 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bbecb9-b6e0-43b0-9177-3cc82e43eda4 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:45.538252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 845/1694] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:44:45 2022] PUT /identity/v3/projects/90bd5d04f6ff466c9cf7c55f7f8784a3/users/d69e005f799b4a74946aa34729825c09/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:45.540727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab479bc-9957-4a06-bc19-7c9705cd185e None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:45.541087 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab479bc-9957-4a06-bc19-7c9705cd185e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:45.541432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab479bc-9957-4a06-bc19-7c9705cd185e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:45.625016 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-1ab479bc-9957-4a06-bc19-7c9705cd185e None None] MFA Rules not processed for user `d69e005f799b4a74946aa34729825c09`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:45.626742 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1ab479bc-9957-4a06-bc19-7c9705cd185e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:45.730703 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74060a3d-0406-432a-85f0-d5c6df02ce6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:45.736372 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74060a3d-0406-432a-85f0-d5c6df02ce6a service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:45.778332 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 850/1695] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:44:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:44:45.781938 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74060a3d-0406-432a-85f0-d5c6df02ce6a service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:45.824052 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74060a3d-0406-432a-85f0-d5c6df02ce6a service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:45.875793 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 846/1696] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:44:45.879031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab479bc-9957-4a06-bc19-7c9705cd185e None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:45.968100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6529659-63bf-4e73-9237-b04ac0005c92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:45.969582 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6529659-63bf-4e73-9237-b04ac0005c92 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:45.970201 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6529659-63bf-4e73-9237-b04ac0005c92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:45.970729 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6529659-63bf-4e73-9237-b04ac0005c92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:45.986657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b6529659-63bf-4e73-9237-b04ac0005c92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:46.010565 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:46.052104 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab479bc-9957-4a06-bc19-7c9705cd185e None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:46.066470 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d85afe-8843-4f39-9582-19436918a705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:46.067125 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d85afe-8843-4f39-9582-19436918a705 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:46.067399 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d85afe-8843-4f39-9582-19436918a705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:46.067667 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d85afe-8843-4f39-9582-19436918a705 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:46.068358 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d85afe-8843-4f39-9582-19436918a705 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:46.075963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d85afe-8843-4f39-9582-19436918a705 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:46.092909 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:46.099805 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6529659-63bf-4e73-9237-b04ac0005c92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:46.101985 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6529659-63bf-4e73-9237-b04ac0005c92 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:46.148310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 847/1697] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:44:45 2022] POST /identity/v3/projects => generated 373 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:44:46.153940 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d85afe-8843-4f39-9582-19436918a705 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:46.156601 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 851/1698] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:44:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:44:46.277611 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea65b2d-eb32-47da-8459-e5fe0c33abf2 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:46.278374 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea65b2d-eb32-47da-8459-e5fe0c33abf2 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:46.278856 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea65b2d-eb32-47da-8459-e5fe0c33abf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:46.368620 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-9ea65b2d-eb32-47da-8459-e5fe0c33abf2 None None] MFA Rules not processed for user `1aebaf488289488387d0b9efa7818285`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:46.369945 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9ea65b2d-eb32-47da-8459-e5fe0c33abf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:46.419718 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d85afe-8843-4f39-9582-19436918a705 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:46.440437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cee23d-f59e-4fd7-9437-1f99a939685d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:46.441101 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cee23d-f59e-4fd7-9437-1f99a939685d admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:46.441365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cee23d-f59e-4fd7-9437-1f99a939685d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:46.441723 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cee23d-f59e-4fd7-9437-1f99a939685d admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:46.442326 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cee23d-f59e-4fd7-9437-1f99a939685d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:46.444362 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cee23d-f59e-4fd7-9437-1f99a939685d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:46.543431 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 848/1699] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:44:46 2022] POST /identity/v3/users => generated 293 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:44:46.545920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cee23d-f59e-4fd7-9437-1f99a939685d admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:46.580357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cee23d-f59e-4fd7-9437-1f99a939685d admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:46.604499 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19bc00-81bf-4675-b82e-d38dca39359e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:46.607067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19bc00-81bf-4675-b82e-d38dca39359e admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:46.607433 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19bc00-81bf-4675-b82e-d38dca39359e admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:46.607698 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19bc00-81bf-4675-b82e-d38dca39359e admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:46.616428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19bc00-81bf-4675-b82e-d38dca39359e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:46.622095 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19bc00-81bf-4675-b82e-d38dca39359e admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:46.663895 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 852/1700] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:46.674815 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea65b2d-eb32-47da-8459-e5fe0c33abf2 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:46.676524 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9ea65b2d-eb32-47da-8459-e5fe0c33abf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:46.679522 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 849/1701] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:44:46.680953 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19bc00-81bf-4675-b82e-d38dca39359e admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:46.711549 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19bc00-81bf-4675-b82e-d38dca39359e admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:46.737877 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d0419-e57e-4630-b9ba-9ccae92c3fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:46.738610 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d0419-e57e-4630-b9ba-9ccae92c3fb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:46.738925 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d0419-e57e-4630-b9ba-9ccae92c3fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:46.741742 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d0419-e57e-4630-b9ba-9ccae92c3fb4 admin admin] PATH_INFO: `/v3/projects/ada8e3ede4f14d33b1adb62b804c16fd/users/004555d591dd4f13a5ee4656e5016873/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:46.784302 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d0419-e57e-4630-b9ba-9ccae92c3fb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ada8e3ede4f14d33b1adb62b804c16fd, user_id=004555d591dd4f13a5ee4656e5016873, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:46.788580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d0419-e57e-4630-b9ba-9ccae92c3fb4 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:46.830577 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 850/1702] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:44:46 2022] PUT /identity/v3/projects/ada8e3ede4f14d33b1adb62b804c16fd/users/004555d591dd4f13a5ee4656e5016873/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:46.835497 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d0419-e57e-4630-b9ba-9ccae92c3fb4 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:46.919149 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea65b2d-eb32-47da-8459-e5fe0c33abf2 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:47.105350 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d0419-e57e-4630-b9ba-9ccae92c3fb4 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:47.123236 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67f432-dc4a-4348-91e6-f2e3723e2725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:47.125129 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67f432-dc4a-4348-91e6-f2e3723e2725 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:47.127114 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67f432-dc4a-4348-91e6-f2e3723e2725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:47.128373 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67f432-dc4a-4348-91e6-f2e3723e2725 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:47.131176 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67f432-dc4a-4348-91e6-f2e3723e2725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:47.147632 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67f432-dc4a-4348-91e6-f2e3723e2725 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:47.163876 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042c58e-8035-4066-b25d-bd51a6194c3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:47.164713 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042c58e-8035-4066-b25d-bd51a6194c3f service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:47.164998 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042c58e-8035-4066-b25d-bd51a6194c3f service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:47.165610 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042c58e-8035-4066-b25d-bd51a6194c3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:47.173720 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 851/1703] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:44:47.177046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67f432-dc4a-4348-91e6-f2e3723e2725 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:47.181591 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1b67f432-dc4a-4348-91e6-f2e3723e2725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:47.201352 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:47.226295 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67f432-dc4a-4348-91e6-f2e3723e2725 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:47.239238 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da03129-79a0-496b-919a-b4a69510ae26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:47.242730 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da03129-79a0-496b-919a-b4a69510ae26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:47.244142 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da03129-79a0-496b-919a-b4a69510ae26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:47.244834 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da03129-79a0-496b-919a-b4a69510ae26 admin admin] PATH_INFO: `/v3/projects/0d6af1f8b0874b3282db6468f80e0c08` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:47.247631 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da03129-79a0-496b-919a-b4a69510ae26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d6af1f8b0874b3282db6468f80e0c08)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:47.252692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da03129-79a0-496b-919a-b4a69510ae26 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:47.303327 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042c58e-8035-4066-b25d-bd51a6194c3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:47.311695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c042c58e-8035-4066-b25d-bd51a6194c3f service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:47.339141 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:47.347839 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 853/1704] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:44:46 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 673 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:44:47.349070 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042c58e-8035-4066-b25d-bd51a6194c3f service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:47.374452 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042c58e-8035-4066-b25d-bd51a6194c3f service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:47.384495 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9f262-f40c-411a-a157-6d3cf24e8d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:47.391928 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9f262-f40c-411a-a157-6d3cf24e8d30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:47.393321 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9f262-f40c-411a-a157-6d3cf24e8d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:47.395496 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9f262-f40c-411a-a157-6d3cf24e8d30 admin admin] PATH_INFO: `/v3/projects/ada8e3ede4f14d33b1adb62b804c16fd/users/004555d591dd4f13a5ee4656e5016873/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:47.403084 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9f262-f40c-411a-a157-6d3cf24e8d30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ada8e3ede4f14d33b1adb62b804c16fd, user_id=004555d591dd4f13a5ee4656e5016873, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:47.407274 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9f262-f40c-411a-a157-6d3cf24e8d30 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:47.442373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 854/1705] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:44:47 2022] PUT /identity/v3/projects/ada8e3ede4f14d33b1adb62b804c16fd/users/004555d591dd4f13a5ee4656e5016873/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:47.455444 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf89843-84b2-42f9-9a51-f59a8a2cf29b None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:47.455684 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6da03129-79a0-496b-919a-b4a69510ae26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d6af1f8b0874b3282db6468f80e0c08', 'request_id': 'req-6da03129-79a0-496b-919a-b4a69510ae26'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:47.456346 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf89843-84b2-42f9-9a51-f59a8a2cf29b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:47.456944 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf89843-84b2-42f9-9a51-f59a8a2cf29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:47.473112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6da03129-79a0-496b-919a-b4a69510ae26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d6af1f8b0874b3282db6468f80e0c08', 'request_id': 'req-6da03129-79a0-496b-919a-b4a69510ae26'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:47.486152 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6da03129-79a0-496b-919a-b4a69510ae26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d6af1f8b0874b3282db6468f80e0c08', 'request_id': 'req-6da03129-79a0-496b-919a-b4a69510ae26'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:47.522805 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6da03129-79a0-496b-919a-b4a69510ae26 admin admin] The token cache is being invalidate because project 0d6af1f8b0874b3282db6468f80e0c08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:44:47.523008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6da03129-79a0-496b-919a-b4a69510ae26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:47.528549 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6da03129-79a0-496b-919a-b4a69510ae26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:47.530665 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 852/1706] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:44:47 2022] DELETE /identity/v3/projects/0d6af1f8b0874b3282db6468f80e0c08 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:47.537815 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a9a0f-39e3-47dc-a216-7dcffe426257 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:47.538377 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a9a0f-39e3-47dc-a216-7dcffe426257 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:47.538862 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a9a0f-39e3-47dc-a216-7dcffe426257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:47.549289 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-caf89843-84b2-42f9-9a51-f59a8a2cf29b None None] MFA Rules not processed for user `004555d591dd4f13a5ee4656e5016873`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:47.552475 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-caf89843-84b2-42f9-9a51-f59a8a2cf29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:47.595355 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-2a3a9a0f-39e3-47dc-a216-7dcffe426257 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:47.596567 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2a3a9a0f-39e3-47dc-a216-7dcffe426257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:47.806391 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 855/1707] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:47.811425 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf89843-84b2-42f9-9a51-f59a8a2cf29b None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:47.813961 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-caf89843-84b2-42f9-9a51-f59a8a2cf29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:47.820662 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 853/1708] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:47.843933 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc178f5-c6ac-4f40-8bcf-60b17e6702dc None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:47.844821 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc178f5-c6ac-4f40-8bcf-60b17e6702dc None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:47.844929 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc178f5-c6ac-4f40-8bcf-60b17e6702dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:47.902211 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-adc178f5-c6ac-4f40-8bcf-60b17e6702dc None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:47.903978 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-adc178f5-c6ac-4f40-8bcf-60b17e6702dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:47.941416 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 854/1709] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:47.948187 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc178f5-c6ac-4f40-8bcf-60b17e6702dc None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:47.954875 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-adc178f5-c6ac-4f40-8bcf-60b17e6702dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:47.979847 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf89843-84b2-42f9-9a51-f59a8a2cf29b None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:47.987155 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b4127-d270-4844-8535-a97e4299ca75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:47.989420 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b4127-d270-4844-8535-a97e4299ca75 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:47.989939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b4127-d270-4844-8535-a97e4299ca75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:47.990617 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b4127-d270-4844-8535-a97e4299ca75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:47.994685 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1f0b4127-d270-4844-8535-a97e4299ca75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:47.999872 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc178f5-c6ac-4f40-8bcf-60b17e6702dc None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:48.008637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1cf92-1777-4a98-bdf3-f8c6e0c8bd34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:48.011049 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1cf92-1777-4a98-bdf3-f8c6e0c8bd34 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:48.011585 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1cf92-1777-4a98-bdf3-f8c6e0c8bd34 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:48.012902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1cf92-1777-4a98-bdf3-f8c6e0c8bd34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:48.046673 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1cf92-1777-4a98-bdf3-f8c6e0c8bd34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:48.055721 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1cf92-1777-4a98-bdf3-f8c6e0c8bd34 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:48.088517 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 855/1710] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:44:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:44:48.092342 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1cf92-1777-4a98-bdf3-f8c6e0c8bd34 service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:48.128488 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1cf92-1777-4a98-bdf3-f8c6e0c8bd34 service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:48.144249 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f4755-9ea8-4247-aa42-36889db9ac78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:48.145784 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f4755-9ea8-4247-aa42-36889db9ac78 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:48.146392 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f4755-9ea8-4247-aa42-36889db9ac78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:48.147036 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f4755-9ea8-4247-aa42-36889db9ac78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:48.148996 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f4755-9ea8-4247-aa42-36889db9ac78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:44:48.150856 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f4755-9ea8-4247-aa42-36889db9ac78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:48.156806 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f4755-9ea8-4247-aa42-36889db9ac78 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:48.248862 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:48.269336 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 856/1711] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:44:48.277928 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c3835-81e9-4c1e-af83-acce9e544ac5 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:48.282356 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c3835-81e9-4c1e-af83-acce9e544ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:48.283457 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c3835-81e9-4c1e-af83-acce9e544ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:48.356765 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b4127-d270-4844-8535-a97e4299ca75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:48.371426 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b4127-d270-4844-8535-a97e4299ca75 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:48.430507 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-3c1c3835-81e9-4c1e-af83-acce9e544ac5 None None] MFA Rules not processed for user `31214da58fc3420393b0f5bd5df8e9d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:48.436426 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-3c1c3835-81e9-4c1e-af83-acce9e544ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:48.469487 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 856/1712] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:44:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:44:48.476703 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b4127-d270-4844-8535-a97e4299ca75 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:48.591169 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b4127-d270-4844-8535-a97e4299ca75 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:48.638819 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18d1de-a040-411f-b400-e7ebc709556a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:48.641093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18d1de-a040-411f-b400-e7ebc709556a admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:48.647271 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18d1de-a040-411f-b400-e7ebc709556a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:48.649183 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b18d1de-a040-411f-b400-e7ebc709556a admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:48.658092 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18d1de-a040-411f-b400-e7ebc709556a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:48.672688 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b18d1de-a040-411f-b400-e7ebc709556a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:48.838629 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 857/1713] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:44:48 2022] POST /identity/v3/projects => generated 355 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:44:48.839562 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18d1de-a040-411f-b400-e7ebc709556a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:48.864046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:48.896875 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 857/1714] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 627 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:48.897965 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c3835-81e9-4c1e-af83-acce9e544ac5 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:48.959541 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c3835-81e9-4c1e-af83-acce9e544ac5 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:49.052397 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b18d1de-a040-411f-b400-e7ebc709556a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:49.080593 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb6cba-50fe-4a36-99d8-b1bb02a27004 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:49.082542 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb6cba-50fe-4a36-99d8-b1bb02a27004 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:49.083060 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb6cba-50fe-4a36-99d8-b1bb02a27004 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:49.083515 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb6cba-50fe-4a36-99d8-b1bb02a27004 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:49.089143 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-75eb6cba-50fe-4a36-99d8-b1bb02a27004 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:49.194760 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70a9931-7e39-492a-9283-16c6cd2e46aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:49.195819 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a9931-7e39-492a-9283-16c6cd2e46aa admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:49.196296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a9931-7e39-492a-9283-16c6cd2e46aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:49.196769 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70a9931-7e39-492a-9283-16c6cd2e46aa admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:49.198157 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a9931-7e39-492a-9283-16c6cd2e46aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:49.201845 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70a9931-7e39-492a-9283-16c6cd2e46aa admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:49.291871 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 858/1715] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:44:48 2022] POST /identity/v3/users => generated 278 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:44:49.294590 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243e5d6-17e7-41fd-bc52-6a0eff198369 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:49.295053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243e5d6-17e7-41fd-bc52-6a0eff198369 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:49.295522 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243e5d6-17e7-41fd-bc52-6a0eff198369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:49.312391 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb6cba-50fe-4a36-99d8-b1bb02a27004 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:49.314180 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb6cba-50fe-4a36-99d8-b1bb02a27004 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:49.352648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 858/1716] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:44:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:44:49.353227 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb6cba-50fe-4a36-99d8-b1bb02a27004 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:49.359653 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-8243e5d6-17e7-41fd-bc52-6a0eff198369 None None] MFA Rules not processed for user `31214da58fc3420393b0f5bd5df8e9d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:49.365687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-8243e5d6-17e7-41fd-bc52-6a0eff198369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:49.386616 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb6cba-50fe-4a36-99d8-b1bb02a27004 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:49.406886 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ca804-a4fa-4683-8e1e-ab29f4348aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:49.409354 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ca804-a4fa-4683-8e1e-ab29f4348aae admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:49.411205 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ca804-a4fa-4683-8e1e-ab29f4348aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:49.411781 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ca804-a4fa-4683-8e1e-ab29f4348aae admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:49.414771 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ca804-a4fa-4683-8e1e-ab29f4348aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:49.420838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ca804-a4fa-4683-8e1e-ab29f4348aae admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:49.482641 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 859/1717] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:44:49.489429 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ca804-a4fa-4683-8e1e-ab29f4348aae admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:49.536161 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ca804-a4fa-4683-8e1e-ab29f4348aae admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:49.554324 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c015d9-d60e-4bc3-8b48-a431d4720884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:49.556522 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c015d9-d60e-4bc3-8b48-a431d4720884 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:49.557607 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c015d9-d60e-4bc3-8b48-a431d4720884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:49.558953 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c015d9-d60e-4bc3-8b48-a431d4720884 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:49.563560 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c015d9-d60e-4bc3-8b48-a431d4720884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:49.569193 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c015d9-d60e-4bc3-8b48-a431d4720884 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:49.614427 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 860/1718] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:44:49.624050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c015d9-d60e-4bc3-8b48-a431d4720884 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:49.627963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 859/1719] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:49.635656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243e5d6-17e7-41fd-bc52-6a0eff198369 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:49.644886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-8243e5d6-17e7-41fd-bc52-6a0eff198369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:49.645142 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c015d9-d60e-4bc3-8b48-a431d4720884 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:49.664155 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1935337-50b7-4d39-b123-fa79bf6ceb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:49.666343 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1935337-50b7-4d39-b123-fa79bf6ceb18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:49.668758 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1935337-50b7-4d39-b123-fa79bf6ceb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:49.673745 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1935337-50b7-4d39-b123-fa79bf6ceb18 admin admin] PATH_INFO: `/v3/projects/492913b3edda477190022e78fe2e02ff/users/83a2b00b16fe417abd438204eda4d459/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:49.720460 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1935337-50b7-4d39-b123-fa79bf6ceb18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=492913b3edda477190022e78fe2e02ff, user_id=83a2b00b16fe417abd438204eda4d459, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:49.730809 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1935337-50b7-4d39-b123-fa79bf6ceb18 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:49.794180 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 861/1720] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:44:49 2022] PUT /identity/v3/projects/492913b3edda477190022e78fe2e02ff/users/83a2b00b16fe417abd438204eda4d459/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:49.796657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded957f-2671-45c7-ae88-d43d05250ea7 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:49.797244 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded957f-2671-45c7-ae88-d43d05250ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:49.797529 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded957f-2671-45c7-ae88-d43d05250ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:49.935488 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-3ded957f-2671-45c7-ae88-d43d05250ea7 None None] MFA Rules not processed for user `83a2b00b16fe417abd438204eda4d459`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:49.939939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3ded957f-2671-45c7-ae88-d43d05250ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:49.972374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243e5d6-17e7-41fd-bc52-6a0eff198369 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:49.974487 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:50.060792 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:50.131543 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ddc4f-ef8b-4fad-b115-f078bdd656fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:50.133072 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ddc4f-ef8b-4fad-b115-f078bdd656fb service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:50.133757 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ddc4f-ef8b-4fad-b115-f078bdd656fb service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:50.135986 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ddc4f-ef8b-4fad-b115-f078bdd656fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:50.159001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 862/1721] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:50.165212 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded957f-2671-45c7-ae88-d43d05250ea7 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:50.249223 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ddc4f-ef8b-4fad-b115-f078bdd656fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:50.252871 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7ddc4f-ef8b-4fad-b115-f078bdd656fb service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:50.280787 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 860/1722] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:44:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:44:50.356009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded957f-2671-45c7-ae88-d43d05250ea7 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:50.372603 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5669cc-5d6e-43c4-8962-78ea52b72491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:50.373244 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5669cc-5d6e-43c4-8962-78ea52b72491 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:50.373522 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5669cc-5d6e-43c4-8962-78ea52b72491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:50.373793 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5669cc-5d6e-43c4-8962-78ea52b72491 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:50.374647 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5669cc-5d6e-43c4-8962-78ea52b72491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:50.379983 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5669cc-5d6e-43c4-8962-78ea52b72491 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:50.446774 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 863/1723] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:44:50 2022] POST /identity/v3/projects => generated 357 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:44:50.453413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ddc4f-ef8b-4fad-b115-f078bdd656fb service nova] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:50.510580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ddc4f-ef8b-4fad-b115-f078bdd656fb service nova] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:50.736916 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e809c-e19e-45ce-ba22-cb26d9bfed9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:50.739531 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e809c-e19e-45ce-ba22-cb26d9bfed9f admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:50.739848 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e809c-e19e-45ce-ba22-cb26d9bfed9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:50.740093 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e809c-e19e-45ce-ba22-cb26d9bfed9f admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:50.740843 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e809c-e19e-45ce-ba22-cb26d9bfed9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:50.749010 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e809c-e19e-45ce-ba22-cb26d9bfed9f admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:50.810844 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 861/1724] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:44:50 2022] POST /identity/v3/users => generated 285 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:44:50.816518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5669cc-5d6e-43c4-8962-78ea52b72491 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:50.835264 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5669cc-5d6e-43c4-8962-78ea52b72491 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:50.848313 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588bd05-6de4-46d1-9275-d7bbea44b075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:50.849908 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588bd05-6de4-46d1-9275-d7bbea44b075 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:50.850553 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588bd05-6de4-46d1-9275-d7bbea44b075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:50.850927 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9588bd05-6de4-46d1-9275-d7bbea44b075 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:50.851706 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588bd05-6de4-46d1-9275-d7bbea44b075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:50.860096 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9588bd05-6de4-46d1-9275-d7bbea44b075 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:50.882174 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 864/1725] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:44:50.888036 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e809c-e19e-45ce-ba22-cb26d9bfed9f admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:50.904005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e809c-e19e-45ce-ba22-cb26d9bfed9f admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:50.916428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad206bce-797e-4bee-81bf-8229c86b979d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:50.917269 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad206bce-797e-4bee-81bf-8229c86b979d admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:50.917637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad206bce-797e-4bee-81bf-8229c86b979d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:50.917977 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad206bce-797e-4bee-81bf-8229c86b979d admin admin] PATH_INFO: `/v3/projects/bade5a35b2014affb4dfb87c7368705f/users/248b332960f54028a820b223e26e7f87/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:50.960680 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad206bce-797e-4bee-81bf-8229c86b979d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bade5a35b2014affb4dfb87c7368705f, user_id=248b332960f54028a820b223e26e7f87, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:50.964397 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad206bce-797e-4bee-81bf-8229c86b979d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:50.992759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 862/1726] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:44:50 2022] PUT /identity/v3/projects/bade5a35b2014affb4dfb87c7368705f/users/248b332960f54028a820b223e26e7f87/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:50.998620 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588bd05-6de4-46d1-9275-d7bbea44b075 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:51.013912 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9588bd05-6de4-46d1-9275-d7bbea44b075 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:51.180556 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f37f2c-5784-4b1e-99e9-59e7cbb70e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:51.181548 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f37f2c-5784-4b1e-99e9-59e7cbb70e46 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:51.181723 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f37f2c-5784-4b1e-99e9-59e7cbb70e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:51.181989 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f37f2c-5784-4b1e-99e9-59e7cbb70e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:51.183577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f37f2c-5784-4b1e-99e9-59e7cbb70e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:51.186295 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f37f2c-5784-4b1e-99e9-59e7cbb70e46 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:51.200459 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 865/1727] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:44:51.206035 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad206bce-797e-4bee-81bf-8229c86b979d admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:51.230888 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad206bce-797e-4bee-81bf-8229c86b979d admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:51.251931 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c82c55-a12c-4f2e-afa5-0159914c0e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:51.253062 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c82c55-a12c-4f2e-afa5-0159914c0e00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:51.253722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c82c55-a12c-4f2e-afa5-0159914c0e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:51.254444 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c82c55-a12c-4f2e-afa5-0159914c0e00 admin admin] PATH_INFO: `/v3/projects/bade5a35b2014affb4dfb87c7368705f/users/248b332960f54028a820b223e26e7f87/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:51.258283 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c82c55-a12c-4f2e-afa5-0159914c0e00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bade5a35b2014affb4dfb87c7368705f, user_id=248b332960f54028a820b223e26e7f87, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:51.263510 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c82c55-a12c-4f2e-afa5-0159914c0e00 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:51.303706 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 863/1728] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:44:51 2022] PUT /identity/v3/projects/bade5a35b2014affb4dfb87c7368705f/users/248b332960f54028a820b223e26e7f87/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:44:51.325409 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31828812-a8f0-4c4c-bf31-d1a030e40647 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:51.326100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31828812-a8f0-4c4c-bf31-d1a030e40647 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:51.326661 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31828812-a8f0-4c4c-bf31-d1a030e40647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:51.413549 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-31828812-a8f0-4c4c-bf31-d1a030e40647 None None] MFA Rules not processed for user `248b332960f54028a820b223e26e7f87`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:51.417641 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-31828812-a8f0-4c4c-bf31-d1a030e40647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:51.461752 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:51.692152 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 866/1729] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:51 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:51.811160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6a2dc-d8a6-4e52-8345-8c0ac34594ee None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:51.811695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6a2dc-d8a6-4e52-8345-8c0ac34594ee None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:51.811695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6a2dc-d8a6-4e52-8345-8c0ac34594ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:51.856335 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-6fb6a2dc-d8a6-4e52-8345-8c0ac34594ee None None] MFA Rules not processed for user `1aebaf488289488387d0b9efa7818285`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:51.857595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-6fb6a2dc-d8a6-4e52-8345-8c0ac34594ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:51.936474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:52.021596 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31828812-a8f0-4c4c-bf31-d1a030e40647 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:52.197499 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 864/1730] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:44:52.279997 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31828812-a8f0-4c4c-bf31-d1a030e40647 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:52.299299 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc7c74-59c1-4473-b8cd-473e388c5f4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:52.301223 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc7c74-59c1-4473-b8cd-473e388c5f4c service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:52.301496 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc7c74-59c1-4473-b8cd-473e388c5f4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:52.301769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc7c74-59c1-4473-b8cd-473e388c5f4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:52.331334 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc7c74-59c1-4473-b8cd-473e388c5f4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:52.333349 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc7c74-59c1-4473-b8cd-473e388c5f4c service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:52.371599 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 867/1731] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:44:52 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:44:52.631057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643fa34-3149-4e12-8f6e-87bac575202b None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:52.632463 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643fa34-3149-4e12-8f6e-87bac575202b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:52.633003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643fa34-3149-4e12-8f6e-87bac575202b None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:52.635214 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 865/1732] 10.222.0.66 () {54 vars in 912 bytes} [Mon Sep 26 05:44:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:44:52.642647 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c81e0-190b-4a44-9113-2c76e053ce72 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:52.642929 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c81e0-190b-4a44-9113-2c76e053ce72 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:52.643430 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c81e0-190b-4a44-9113-2c76e053ce72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:52.751664 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-148c81e0-190b-4a44-9113-2c76e053ce72 None None] MFA Rules not processed for user `26b3d51ac6ca41cf9e535e751ac94675`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:52.754746 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-148c81e0-190b-4a44-9113-2c76e053ce72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:52.969441 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 868/1733] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Sep 26 05:44:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:53.093234 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643fa34-3149-4e12-8f6e-87bac575202b None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:53.119915 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643fa34-3149-4e12-8f6e-87bac575202b None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:53.125123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c81e0-190b-4a44-9113-2c76e053ce72 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:53.127101 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-148c81e0-190b-4a44-9113-2c76e053ce72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:53.155194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99dea5f-8f57-46e6-9d29-53e716c999f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:53.160553 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dea5f-8f57-46e6-9d29-53e716c999f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:53.161760 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dea5f-8f57-46e6-9d29-53e716c999f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:53.163297 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99dea5f-8f57-46e6-9d29-53e716c999f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:53.163681 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c81e0-190b-4a44-9113-2c76e053ce72 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:53.187359 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d0938-d81d-4056-b270-f0e31bce11b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:53.189147 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d0938-d81d-4056-b270-f0e31bce11b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:53.198552 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d0938-d81d-4056-b270-f0e31bce11b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:53.200162 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d0938-d81d-4056-b270-f0e31bce11b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:53.228228 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d0938-d81d-4056-b270-f0e31bce11b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:53.236865 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d0938-d81d-4056-b270-f0e31bce11b3 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:53.271607 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 869/1734] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:44:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:44:53.387798 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99dea5f-8f57-46e6-9d29-53e716c999f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:53.398560 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99dea5f-8f57-46e6-9d29-53e716c999f0 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:53.430409 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 866/1735] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:44:53 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:44:54.071490 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b782cfb-7f5c-4d88-850b-f66ed264b8f7 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:54.072215 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b782cfb-7f5c-4d88-850b-f66ed264b8f7 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:54.072336 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b782cfb-7f5c-4d88-850b-f66ed264b8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:54.169193 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-1b782cfb-7f5c-4d88-850b-f66ed264b8f7 None None] MFA Rules not processed for user `9b19bf41fdb74cc4a8e0e048f86bf3c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:54.174947 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1b782cfb-7f5c-4d88-850b-f66ed264b8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:54.191772 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc419b-8710-4298-9c9a-6040ae85e5c0 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:54.192254 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc419b-8710-4298-9c9a-6040ae85e5c0 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:54.192351 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc419b-8710-4298-9c9a-6040ae85e5c0 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:54.193779 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 867/1736] 10.222.0.66 () {54 vars in 912 bytes} [Mon Sep 26 05:44:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:44:54.222642 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76d1d6-d07f-4ca1-84cc-5a38743badc6 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:54.223351 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76d1d6-d07f-4ca1-84cc-5a38743badc6 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:54.223628 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76d1d6-d07f-4ca1-84cc-5a38743badc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:54.276693 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-7d76d1d6-d07f-4ca1-84cc-5a38743badc6 None None] MFA Rules not processed for user `26b3d51ac6ca41cf9e535e751ac94675`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:54.277734 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-7d76d1d6-d07f-4ca1-84cc-5a38743badc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:54.291027 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 868/1737] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Sep 26 05:44:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:44:54.301195 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:54.314657 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76d1d6-d07f-4ca1-84cc-5a38743badc6 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:54.316651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-7d76d1d6-d07f-4ca1-84cc-5a38743badc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:54.339647 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76d1d6-d07f-4ca1-84cc-5a38743badc6 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:54.349336 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85893e-2bcc-4410-b870-aa706c7cb72d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:54.350664 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85893e-2bcc-4410-b870-aa706c7cb72d service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:54.352286 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85893e-2bcc-4410-b870-aa706c7cb72d service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:54.352890 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85893e-2bcc-4410-b870-aa706c7cb72d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:54.369882 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 870/1738] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:54.369882 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589857d-ad2f-44d9-88a3-dc2682eab5be None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:54.369882 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589857d-ad2f-44d9-88a3-dc2682eab5be None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:54.369882 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589857d-ad2f-44d9-88a3-dc2682eab5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:54.386607 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85893e-2bcc-4410-b870-aa706c7cb72d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:54.389953 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85893e-2bcc-4410-b870-aa706c7cb72d service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:54.470802 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 869/1739] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:44:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:44:54.532453 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-d589857d-ad2f-44d9-88a3-dc2682eab5be None None] MFA Rules not processed for user `5224b2ba12d54146855fe3a993dc0915`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:54.536281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d589857d-ad2f-44d9-88a3-dc2682eab5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:54.765942 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85893e-2bcc-4410-b870-aa706c7cb72d service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:54.800847 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 871/1740] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:54.813208 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22576f5f-782e-4543-8c85-f944ef5d6c3f None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:54.816146 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22576f5f-782e-4543-8c85-f944ef5d6c3f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:54.817346 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22576f5f-782e-4543-8c85-f944ef5d6c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:54.867362 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-22576f5f-782e-4543-8c85-f944ef5d6c3f None None] MFA Rules not processed for user `5224b2ba12d54146855fe3a993dc0915`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:54.869272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-22576f5f-782e-4543-8c85-f944ef5d6c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:54.887354 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 872/1741] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:54.904436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22576f5f-782e-4543-8c85-f944ef5d6c3f None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:54.906326 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-22576f5f-782e-4543-8c85-f944ef5d6c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:55.097058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22576f5f-782e-4543-8c85-f944ef5d6c3f None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:55.099016 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85893e-2bcc-4410-b870-aa706c7cb72d service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:55.107820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30adc7-f8e0-44dc-8d71-2e6eb38f3946 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895edcfb20484b188a3877c9de8b59c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:55.109250 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30adc7-f8e0-44dc-8d71-2e6eb38f3946 service placement] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:55.109720 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30adc7-f8e0-44dc-8d71-2e6eb38f3946 service placement] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:55.110307 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30adc7-f8e0-44dc-8d71-2e6eb38f3946 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:55.112804 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ae30adc7-f8e0-44dc-8d71-2e6eb38f3946 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:55.119244 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f4fc6-2f85-40d6-9847-a3c043b7e602 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:55.119861 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f4fc6-2f85-40d6-9847-a3c043b7e602 service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:55.120316 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f4fc6-2f85-40d6-9847-a3c043b7e602 service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:55.120691 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f4fc6-2f85-40d6-9847-a3c043b7e602 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:55.132964 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae30adc7-f8e0-44dc-8d71-2e6eb38f3946 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:55.135514 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae30adc7-f8e0-44dc-8d71-2e6eb38f3946 service placement] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:55.146743 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f4fc6-2f85-40d6-9847-a3c043b7e602 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:55.149031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f4fc6-2f85-40d6-9847-a3c043b7e602 service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:55.164365 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 873/1742] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:44:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:44:55.205298 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 870/1743] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:44:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:44:55.362825 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30adc7-f8e0-44dc-8d71-2e6eb38f3946 service placement] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:55.401301 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30adc7-f8e0-44dc-8d71-2e6eb38f3946 service placement] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:55.432404 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06895b59-b47f-4e9f-beaa-e0fb6cbf5a28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:55.434736 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06895b59-b47f-4e9f-beaa-e0fb6cbf5a28 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:55.436175 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06895b59-b47f-4e9f-beaa-e0fb6cbf5a28 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:55.436826 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06895b59-b47f-4e9f-beaa-e0fb6cbf5a28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:55.467059 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06895b59-b47f-4e9f-beaa-e0fb6cbf5a28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:55.474235 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06895b59-b47f-4e9f-beaa-e0fb6cbf5a28 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:55.498690 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 874/1744] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:44:55 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:44:56.201061 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f4fc6-2f85-40d6-9847-a3c043b7e602 service nova] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:56.202859 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-7e9f4fc6-2f85-40d6-9847-a3c043b7e602 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:56.324818 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:56.525715 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f4fc6-2f85-40d6-9847-a3c043b7e602 service nova] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:56.543387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e366c5e-c6b7-499a-aa63-12261ff9f55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:56.552789 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e366c5e-c6b7-499a-aa63-12261ff9f55b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:56.554547 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e366c5e-c6b7-499a-aa63-12261ff9f55b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:56.554856 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e366c5e-c6b7-499a-aa63-12261ff9f55b admin admin] PATH_INFO: `/v3/users/c727373260864e158451642496b83957` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:56.564386 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e366c5e-c6b7-499a-aa63-12261ff9f55b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c727373260864e158451642496b83957)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:56.576970 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e366c5e-c6b7-499a-aa63-12261ff9f55b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:56.838089 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-0e366c5e-c6b7-499a-aa63-12261ff9f55b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c727373260864e158451642496b83957'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:56.864483 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-0e366c5e-c6b7-499a-aa63-12261ff9f55b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c727373260864e158451642496b83957'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:56.898945 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-0e366c5e-c6b7-499a-aa63-12261ff9f55b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c727373260864e158451642496b83957'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:56.901736 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-0e366c5e-c6b7-499a-aa63-12261ff9f55b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c727373260864e158451642496b83957'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:56.921402 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-0e366c5e-c6b7-499a-aa63-12261ff9f55b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c727373260864e158451642496b83957'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:56.958970 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81dffd-1188-4d03-8a9f-56ca8b40e9ae None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:56.959483 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81dffd-1188-4d03-8a9f-56ca8b40e9ae None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:56.959604 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a81dffd-1188-4d03-8a9f-56ca8b40e9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:56.963942 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 871/1745] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:44:56 2022] DELETE /identity/v3/users/c727373260864e158451642496b83957 => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:57.036561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-9a81dffd-1188-4d03-8a9f-56ca8b40e9ae None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:57.041035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9a81dffd-1188-4d03-8a9f-56ca8b40e9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:57.149547 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:57.356935 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 875/1746] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:57.368540 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e366c5e-c6b7-499a-aa63-12261ff9f55b admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:57.372843 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0e366c5e-c6b7-499a-aa63-12261ff9f55b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:57.597807 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e366c5e-c6b7-499a-aa63-12261ff9f55b admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:57.611582 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac13a3-799e-46b6-9c34-fc8987a8e28a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:57.613918 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac13a3-799e-46b6-9c34-fc8987a8e28a service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:57.614361 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac13a3-799e-46b6-9c34-fc8987a8e28a service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:57.614781 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac13a3-799e-46b6-9c34-fc8987a8e28a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:57.639980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac13a3-799e-46b6-9c34-fc8987a8e28a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:57.641789 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac13a3-799e-46b6-9c34-fc8987a8e28a service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:57.665566 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 872/1747] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:44:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:44:57.714159 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf8850-11e0-46b7-a636-054462a8199c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:57.714855 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf8850-11e0-46b7-a636-054462a8199c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:57.715341 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf8850-11e0-46b7-a636-054462a8199c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:57.789881 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-27bf8850-11e0-46b7-a636-054462a8199c None None] MFA Rules not processed for user `5224b2ba12d54146855fe3a993dc0915`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:57.791132 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-27bf8850-11e0-46b7-a636-054462a8199c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:58.028838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 876/1748] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:44:58.406322 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac13a3-799e-46b6-9c34-fc8987a8e28a service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:58.409465 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-57ac13a3-799e-46b6-9c34-fc8987a8e28a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:58.447340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac13a3-799e-46b6-9c34-fc8987a8e28a service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:58.456920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c5262-8865-4cc1-9e18-60a3182a83dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:58.457569 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c5262-8865-4cc1-9e18-60a3182a83dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:58.460288 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c5262-8865-4cc1-9e18-60a3182a83dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:58.460766 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c5262-8865-4cc1-9e18-60a3182a83dc admin admin] PATH_INFO: `/v3/users/1f551f069a5c4fff9b7c75e28f27b1f5` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:58.462777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c5262-8865-4cc1-9e18-60a3182a83dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f551f069a5c4fff9b7c75e28f27b1f5)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:58.469748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c5262-8865-4cc1-9e18-60a3182a83dc admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:58.570625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:58.580285 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-990c5262-8865-4cc1-9e18-60a3182a83dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f551f069a5c4fff9b7c75e28f27b1f5'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:58.594643 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-990c5262-8865-4cc1-9e18-60a3182a83dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f551f069a5c4fff9b7c75e28f27b1f5'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:58.625357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-990c5262-8865-4cc1-9e18-60a3182a83dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f551f069a5c4fff9b7c75e28f27b1f5'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:58.626396 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-990c5262-8865-4cc1-9e18-60a3182a83dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f551f069a5c4fff9b7c75e28f27b1f5'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:58.637689 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-990c5262-8865-4cc1-9e18-60a3182a83dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f551f069a5c4fff9b7c75e28f27b1f5'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:58.651018 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 873/1749] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:44:58 2022] DELETE /identity/v3/users/1f551f069a5c4fff9b7c75e28f27b1f5 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:58.655492 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace02b1-929e-47f4-84cd-5f9395da1320 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:58.656039 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace02b1-929e-47f4-84cd-5f9395da1320 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:58.656511 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace02b1-929e-47f4-84cd-5f9395da1320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:58.690493 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-cace02b1-929e-47f4-84cd-5f9395da1320 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:44:58.691775 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-cace02b1-929e-47f4-84cd-5f9395da1320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:58.822367 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 877/1750] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:44:58.833371 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c5262-8865-4cc1-9e18-60a3182a83dc admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:58.835073 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-990c5262-8865-4cc1-9e18-60a3182a83dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:58.941407 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c5262-8865-4cc1-9e18-60a3182a83dc admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:58.954148 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23cfe27-8e40-48e2-a75e-3c513b326760 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:58.955833 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cfe27-8e40-48e2-a75e-3c513b326760 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:58.956122 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cfe27-8e40-48e2-a75e-3c513b326760 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:58.956397 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23cfe27-8e40-48e2-a75e-3c513b326760 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:58.985043 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23cfe27-8e40-48e2-a75e-3c513b326760 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:58.986569 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23cfe27-8e40-48e2-a75e-3c513b326760 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:59.019205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 874/1751] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:44:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:44:59.343617 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace02b1-929e-47f4-84cd-5f9395da1320 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:59.345690 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-cace02b1-929e-47f4-84cd-5f9395da1320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:44:59.380046 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace02b1-929e-47f4-84cd-5f9395da1320 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:44:59.416075 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048038b3-c3e7-4504-89cf-5127f7d38cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:44:59.416784 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048038b3-c3e7-4504-89cf-5127f7d38cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:44:59.417074 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048038b3-c3e7-4504-89cf-5127f7d38cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:44:59.417355 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048038b3-c3e7-4504-89cf-5127f7d38cbb admin admin] PATH_INFO: `/v3/projects/f3822d3cf1954b5abd7102948c801bff` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:44:59.436029 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048038b3-c3e7-4504-89cf-5127f7d38cbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3822d3cf1954b5abd7102948c801bff)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:44:59.444252 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048038b3-c3e7-4504-89cf-5127f7d38cbb admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:44:59.683098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-048038b3-c3e7-4504-89cf-5127f7d38cbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3822d3cf1954b5abd7102948c801bff', 'request_id': 'req-048038b3-c3e7-4504-89cf-5127f7d38cbb'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:59.700577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-048038b3-c3e7-4504-89cf-5127f7d38cbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3822d3cf1954b5abd7102948c801bff', 'request_id': 'req-048038b3-c3e7-4504-89cf-5127f7d38cbb'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:59.724911 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-048038b3-c3e7-4504-89cf-5127f7d38cbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3822d3cf1954b5abd7102948c801bff', 'request_id': 'req-048038b3-c3e7-4504-89cf-5127f7d38cbb'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:59.740475 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:44:59.761917 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-048038b3-c3e7-4504-89cf-5127f7d38cbb admin admin] The token cache is being invalidate because project f3822d3cf1954b5abd7102948c801bff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:44:59.762209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-048038b3-c3e7-4504-89cf-5127f7d38cbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:59.768360 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-048038b3-c3e7-4504-89cf-5127f7d38cbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:44:59.775622 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 878/1752] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:44:59 2022] DELETE /identity/v3/projects/f3822d3cf1954b5abd7102948c801bff => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:44:59.779934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23cfe27-8e40-48e2-a75e-3c513b326760 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:44:59.807831 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23cfe27-8e40-48e2-a75e-3c513b326760 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:00.022665 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33566b9b-6eb8-4e39-8415-60e9d9f2cd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:00.023337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33566b9b-6eb8-4e39-8415-60e9d9f2cd53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:00.023614 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33566b9b-6eb8-4e39-8415-60e9d9f2cd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:00.023911 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33566b9b-6eb8-4e39-8415-60e9d9f2cd53 admin admin] PATH_INFO: `/v3/users/5e5f211de9f84b0aa02269b565b77c9d` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:00.025686 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33566b9b-6eb8-4e39-8415-60e9d9f2cd53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e5f211de9f84b0aa02269b565b77c9d)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:00.028149 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33566b9b-6eb8-4e39-8415-60e9d9f2cd53 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:00.194956 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6140ad-ca51-4436-b5e7-9a5d392c42c9 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:00.195492 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6140ad-ca51-4436-b5e7-9a5d392c42c9 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:00.195968 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6140ad-ca51-4436-b5e7-9a5d392c42c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:00.260378 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-33566b9b-6eb8-4e39-8415-60e9d9f2cd53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e5f211de9f84b0aa02269b565b77c9d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:00.295165 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-33566b9b-6eb8-4e39-8415-60e9d9f2cd53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e5f211de9f84b0aa02269b565b77c9d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:00.332745 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:00.337035 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-33566b9b-6eb8-4e39-8415-60e9d9f2cd53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e5f211de9f84b0aa02269b565b77c9d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:00.338262 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-33566b9b-6eb8-4e39-8415-60e9d9f2cd53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e5f211de9f84b0aa02269b565b77c9d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:00.368332 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-33566b9b-6eb8-4e39-8415-60e9d9f2cd53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e5f211de9f84b0aa02269b565b77c9d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:00.393917 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 875/1753] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:44:59 2022] DELETE /identity/v3/users/5e5f211de9f84b0aa02269b565b77c9d => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:00.516804 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-2c6140ad-ca51-4436-b5e7-9a5d392c42c9 None None] MFA Rules not processed for user `5bdaf32400b94aa291ad43a3131e1d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:00.518141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2c6140ad-ca51-4436-b5e7-9a5d392c42c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:00.895129 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 879/1754] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Sep 26 05:45:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 701 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:45:01.081431 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae10b6-4aaf-4239-9d0f-44f84d3f94a9 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:01.082433 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae10b6-4aaf-4239-9d0f-44f84d3f94a9 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:01.082433 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae10b6-4aaf-4239-9d0f-44f84d3f94a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:01.138323 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-b6ae10b6-4aaf-4239-9d0f-44f84d3f94a9 None None] MFA Rules not processed for user `9b19bf41fdb74cc4a8e0e048f86bf3c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:01.142374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b6ae10b6-4aaf-4239-9d0f-44f84d3f94a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:01.270620 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6140ad-ca51-4436-b5e7-9a5d392c42c9 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:01.272859 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2c6140ad-ca51-4436-b5e7-9a5d392c42c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:01.384203 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 876/1755] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:01.603975 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6140ad-ca51-4436-b5e7-9a5d392c42c9 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:01.624914 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049b9cd-135c-4f85-bb15-11f8734204e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '830cd52ac42548b2ade17b5215aefd28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:01.626017 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049b9cd-135c-4f85-bb15-11f8734204e4 service swift] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:01.627996 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049b9cd-135c-4f85-bb15-11f8734204e4 service swift] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:01.629425 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049b9cd-135c-4f85-bb15-11f8734204e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:01.643350 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049b9cd-135c-4f85-bb15-11f8734204e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:01.645389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a049b9cd-135c-4f85-bb15-11f8734204e4 service swift] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:01.681754 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 880/1756] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 26 05:45:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 05:45:02.568490 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae10b6-4aaf-4239-9d0f-44f84d3f94a9 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:02.572771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b6ae10b6-4aaf-4239-9d0f-44f84d3f94a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:02.867839 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae10b6-4aaf-4239-9d0f-44f84d3f94a9 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:02.885920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5884636-6245-49a8-8936-9615260c3553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:02.888474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5884636-6245-49a8-8936-9615260c3553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:02.893046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5884636-6245-49a8-8936-9615260c3553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:02.893604 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5884636-6245-49a8-8936-9615260c3553 admin admin] PATH_INFO: `/v3/projects/75ff01eb83f049c688ecb757a690958b` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:02.899270 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5884636-6245-49a8-8936-9615260c3553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75ff01eb83f049c688ecb757a690958b)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:02.904019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5884636-6245-49a8-8936-9615260c3553 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:03.122385 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a5884636-6245-49a8-8936-9615260c3553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75ff01eb83f049c688ecb757a690958b', 'request_id': 'req-a5884636-6245-49a8-8936-9615260c3553'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:03.146601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a5884636-6245-49a8-8936-9615260c3553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75ff01eb83f049c688ecb757a690958b', 'request_id': 'req-a5884636-6245-49a8-8936-9615260c3553'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:03.175963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a5884636-6245-49a8-8936-9615260c3553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75ff01eb83f049c688ecb757a690958b', 'request_id': 'req-a5884636-6245-49a8-8936-9615260c3553'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:03.213743 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a5884636-6245-49a8-8936-9615260c3553 admin admin] The token cache is being invalidate because project 75ff01eb83f049c688ecb757a690958b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:45:03.214034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a5884636-6245-49a8-8936-9615260c3553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:03.218271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a5884636-6245-49a8-8936-9615260c3553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:03.224587 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 877/1757] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:45:02 2022] DELETE /identity/v3/projects/75ff01eb83f049c688ecb757a690958b => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:03.233083 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049b9cd-135c-4f85-bb15-11f8734204e4 service swift] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:03.287493 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049b9cd-135c-4f85-bb15-11f8734204e4 service swift] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:03.472077 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:03.527213 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0405845-b8d8-43c7-9748-a91816b36a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:03.528602 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0405845-b8d8-43c7-9748-a91816b36a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:03.529037 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0405845-b8d8-43c7-9748-a91816b36a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:03.529456 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0405845-b8d8-43c7-9748-a91816b36a8f admin admin] PATH_INFO: `/v3/users/a86cda49549c4cd2ab20315c81a27955` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:03.532555 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0405845-b8d8-43c7-9748-a91816b36a8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a86cda49549c4cd2ab20315c81a27955)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:03.534806 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0405845-b8d8-43c7-9748-a91816b36a8f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:03.662305 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a0405845-b8d8-43c7-9748-a91816b36a8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a86cda49549c4cd2ab20315c81a27955'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:03.688655 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a0405845-b8d8-43c7-9748-a91816b36a8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a86cda49549c4cd2ab20315c81a27955'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:03.692834 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a0405845-b8d8-43c7-9748-a91816b36a8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a86cda49549c4cd2ab20315c81a27955'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:03.756016 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a0405845-b8d8-43c7-9748-a91816b36a8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a86cda49549c4cd2ab20315c81a27955'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:03.788157 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a0405845-b8d8-43c7-9748-a91816b36a8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a86cda49549c4cd2ab20315c81a27955'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:03.809751 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 881/1758] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:45:03 2022] DELETE /identity/v3/users/a86cda49549c4cd2ab20315c81a27955 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:04.877155 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b345d-ac23-4276-9b28-caeac8a61df8 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:04.878072 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b345d-ac23-4276-9b28-caeac8a61df8 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:04.878798 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b345d-ac23-4276-9b28-caeac8a61df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:04.937074 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-722b345d-ac23-4276-9b28-caeac8a61df8 None None] MFA Rules not processed for user `26b3d51ac6ca41cf9e535e751ac94675`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:04.939242 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-722b345d-ac23-4276-9b28-caeac8a61df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:04.971457 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:05.118865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 878/1759] 10.222.0.26 () {58 vars in 1015 bytes} [Mon Sep 26 05:45:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:05.253902 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0405845-b8d8-43c7-9748-a91816b36a8f admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:05.260395 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a0405845-b8d8-43c7-9748-a91816b36a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:05.310055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0405845-b8d8-43c7-9748-a91816b36a8f admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:05.332492 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811bccc5-5aea-484d-901f-a67e55643dc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:05.332492 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bccc5-5aea-484d-901f-a67e55643dc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:05.332746 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bccc5-5aea-484d-901f-a67e55643dc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:05.333005 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bccc5-5aea-484d-901f-a67e55643dc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:05.360632 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811bccc5-5aea-484d-901f-a67e55643dc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:05.366240 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811bccc5-5aea-484d-901f-a67e55643dc3 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:05.395002 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 882/1760] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:45:05.779489 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b345d-ac23-4276-9b28-caeac8a61df8 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:05.781275 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-722b345d-ac23-4276-9b28-caeac8a61df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:06.019806 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b345d-ac23-4276-9b28-caeac8a61df8 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:06.048490 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e07352-8b90-4a59-b479-8a9aedc0ca37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:06.050485 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e07352-8b90-4a59-b479-8a9aedc0ca37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:06.051347 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e07352-8b90-4a59-b479-8a9aedc0ca37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:06.052881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e07352-8b90-4a59-b479-8a9aedc0ca37 admin admin] PATH_INFO: `/v3/projects/c3c65a13597b4ba89ddc2c4411fcf89e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:06.057411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e07352-8b90-4a59-b479-8a9aedc0ca37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3c65a13597b4ba89ddc2c4411fcf89e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:06.063949 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e07352-8b90-4a59-b479-8a9aedc0ca37 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:06.319840 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a2e07352-8b90-4a59-b479-8a9aedc0ca37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3c65a13597b4ba89ddc2c4411fcf89e', 'request_id': 'req-a2e07352-8b90-4a59-b479-8a9aedc0ca37'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:06.356413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a2e07352-8b90-4a59-b479-8a9aedc0ca37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3c65a13597b4ba89ddc2c4411fcf89e', 'request_id': 'req-a2e07352-8b90-4a59-b479-8a9aedc0ca37'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:06.377520 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a2e07352-8b90-4a59-b479-8a9aedc0ca37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3c65a13597b4ba89ddc2c4411fcf89e', 'request_id': 'req-a2e07352-8b90-4a59-b479-8a9aedc0ca37'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:06.419169 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a2e07352-8b90-4a59-b479-8a9aedc0ca37 admin admin] The token cache is being invalidate because project c3c65a13597b4ba89ddc2c4411fcf89e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:45:06.419854 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a2e07352-8b90-4a59-b479-8a9aedc0ca37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:06.421539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a2e07352-8b90-4a59-b479-8a9aedc0ca37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:06.424580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 879/1761] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:45:05 2022] DELETE /identity/v3/projects/c3c65a13597b4ba89ddc2c4411fcf89e => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:06.432477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab49cc-574d-45db-8adc-ee1476871b35 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:06.434116 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab49cc-574d-45db-8adc-ee1476871b35 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:06.434860 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab49cc-574d-45db-8adc-ee1476871b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:06.537899 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c9ab49cc-574d-45db-8adc-ee1476871b35 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:06.542643 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c9ab49cc-574d-45db-8adc-ee1476871b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:06.983054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 883/1762] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 552 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:06.995194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf73063-2bd2-4b55-a1ed-4b02fe9bdc1e None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:06.995764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf73063-2bd2-4b55-a1ed-4b02fe9bdc1e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:06.996232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf73063-2bd2-4b55-a1ed-4b02fe9bdc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:07.062060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-ccf73063-2bd2-4b55-a1ed-4b02fe9bdc1e None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:07.063313 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ccf73063-2bd2-4b55-a1ed-4b02fe9bdc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:07.111179 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 880/1763] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:07.117137 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab49cc-574d-45db-8adc-ee1476871b35 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:07.137856 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab49cc-574d-45db-8adc-ee1476871b35 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:07.157866 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830bd09-4919-4ebd-a235-0eb6bfbad970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:07.158521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830bd09-4919-4ebd-a235-0eb6bfbad970 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:07.158794 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830bd09-4919-4ebd-a235-0eb6bfbad970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:07.159061 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830bd09-4919-4ebd-a235-0eb6bfbad970 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:07.159724 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830bd09-4919-4ebd-a235-0eb6bfbad970 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:45:07.160074 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830bd09-4919-4ebd-a235-0eb6bfbad970 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:07.161740 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830bd09-4919-4ebd-a235-0eb6bfbad970 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:07.226305 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 884/1764] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:45:07.234608 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf73063-2bd2-4b55-a1ed-4b02fe9bdc1e None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:07.264504 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf73063-2bd2-4b55-a1ed-4b02fe9bdc1e None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:07.290240 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732b642-84e0-430b-8443-8711057a9a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:07.290886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732b642-84e0-430b-8443-8711057a9a30 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:07.291358 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732b642-84e0-430b-8443-8711057a9a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:07.291810 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a732b642-84e0-430b-8443-8711057a9a30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:07.301273 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732b642-84e0-430b-8443-8711057a9a30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:07.303407 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a732b642-84e0-430b-8443-8711057a9a30 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:07.413441 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 881/1765] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:45:07 2022] POST /identity/v3/projects => generated 381 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:07.420703 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830bd09-4919-4ebd-a235-0eb6bfbad970 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:07.487136 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830bd09-4919-4ebd-a235-0eb6bfbad970 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:07.658808 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:07.827631 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a57cac-f64e-4193-915e-76fed84a9fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:07.830130 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a57cac-f64e-4193-915e-76fed84a9fce admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:07.830481 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a57cac-f64e-4193-915e-76fed84a9fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:07.830760 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a57cac-f64e-4193-915e-76fed84a9fce admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:07.847416 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a57cac-f64e-4193-915e-76fed84a9fce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:07.849462 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a57cac-f64e-4193-915e-76fed84a9fce admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:07.942397 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 885/1766] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:45:07 2022] POST /identity/v3/users => generated 291 bytes in 523 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:07.948433 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732b642-84e0-430b-8443-8711057a9a30 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:07.967724 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a732b642-84e0-430b-8443-8711057a9a30 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:08.005274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd0e8a-ae0c-4908-8fbc-8f676ee273e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:08.006064 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd0e8a-ae0c-4908-8fbc-8f676ee273e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:08.006448 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd0e8a-ae0c-4908-8fbc-8f676ee273e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:08.006813 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcd0e8a-ae0c-4908-8fbc-8f676ee273e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:08.007538 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd0e8a-ae0c-4908-8fbc-8f676ee273e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:08.011564 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcd0e8a-ae0c-4908-8fbc-8f676ee273e6 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:08.069774 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 882/1767] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:08.071917 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a57cac-f64e-4193-915e-76fed84a9fce admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:08.097026 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a57cac-f64e-4193-915e-76fed84a9fce admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:08.129981 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ce594-dea2-42e4-8d08-2f7b4c6db5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:08.134586 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ce594-dea2-42e4-8d08-2f7b4c6db5b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:08.134892 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ce594-dea2-42e4-8d08-2f7b4c6db5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:08.137653 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ce594-dea2-42e4-8d08-2f7b4c6db5b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:08.143673 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ce594-dea2-42e4-8d08-2f7b4c6db5b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:08.153465 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ce594-dea2-42e4-8d08-2f7b4c6db5b5 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:08.210775 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd0e8a-ae0c-4908-8fbc-8f676ee273e6 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:08.212401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 886/1768] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:08.252975 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcd0e8a-ae0c-4908-8fbc-8f676ee273e6 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:08.276364 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32003a66-6342-46b8-b5ac-06f6508421af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:08.278059 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32003a66-6342-46b8-b5ac-06f6508421af admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:08.278722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32003a66-6342-46b8-b5ac-06f6508421af admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:08.279427 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32003a66-6342-46b8-b5ac-06f6508421af admin admin] PATH_INFO: `/v3/projects/e5e7fd556b3242bcb923abdef9f92a51/users/63c818379ad148b28aa71818cff83f58/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:08.351326 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32003a66-6342-46b8-b5ac-06f6508421af admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5e7fd556b3242bcb923abdef9f92a51, user_id=63c818379ad148b28aa71818cff83f58, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:08.363691 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32003a66-6342-46b8-b5ac-06f6508421af admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:08.385877 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:08.434163 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 883/1769] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:08 2022] PUT /identity/v3/projects/e5e7fd556b3242bcb923abdef9f92a51/users/63c818379ad148b28aa71818cff83f58/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:08.464197 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5454b75-48fc-4383-bbcb-3b20ed799ce2 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:08.464985 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5454b75-48fc-4383-bbcb-3b20ed799ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:08.467721 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5454b75-48fc-4383-bbcb-3b20ed799ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:08.630528 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-a5454b75-48fc-4383-bbcb-3b20ed799ce2 None None] MFA Rules not processed for user `63c818379ad148b28aa71818cff83f58`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:08.635788 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a5454b75-48fc-4383-bbcb-3b20ed799ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:08.825396 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32003a66-6342-46b8-b5ac-06f6508421af admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:08.828028 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-32003a66-6342-46b8-b5ac-06f6508421af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:08.964640 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 887/1770] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 507 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:08.968680 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5454b75-48fc-4383-bbcb-3b20ed799ce2 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:08.997276 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5454b75-48fc-4383-bbcb-3b20ed799ce2 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:09.010244 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e07e4-8415-422c-bf87-f802aa5a5b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:09.014397 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e07e4-8415-422c-bf87-f802aa5a5b56 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:09.014580 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e07e4-8415-422c-bf87-f802aa5a5b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:09.015996 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e07e4-8415-422c-bf87-f802aa5a5b56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:09.018072 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e07e4-8415-422c-bf87-f802aa5a5b56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:09.018893 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32003a66-6342-46b8-b5ac-06f6508421af admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:09.024951 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e07e4-8415-422c-bf87-f802aa5a5b56 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:09.043155 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f4dfe-91fc-4580-bcef-0b2e9ce897f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:09.044055 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f4dfe-91fc-4580-bcef-0b2e9ce897f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:09.044434 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f4dfe-91fc-4580-bcef-0b2e9ce897f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:09.050555 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f4dfe-91fc-4580-bcef-0b2e9ce897f8 admin admin] PATH_INFO: `/v3/projects/a887e75fff7c43b48a88b5e03068c4bc` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:09.054703 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f4dfe-91fc-4580-bcef-0b2e9ce897f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a887e75fff7c43b48a88b5e03068c4bc)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:09.067636 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f4dfe-91fc-4580-bcef-0b2e9ce897f8 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:09.101452 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 888/1771] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:45:08 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:09.103820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e07e4-8415-422c-bf87-f802aa5a5b56 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:09.251145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-7a6f4dfe-91fc-4580-bcef-0b2e9ce897f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a887e75fff7c43b48a88b5e03068c4bc', 'request_id': 'req-7a6f4dfe-91fc-4580-bcef-0b2e9ce897f8'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:09.278696 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-7a6f4dfe-91fc-4580-bcef-0b2e9ce897f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a887e75fff7c43b48a88b5e03068c4bc', 'request_id': 'req-7a6f4dfe-91fc-4580-bcef-0b2e9ce897f8'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:09.281367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-7a6f4dfe-91fc-4580-bcef-0b2e9ce897f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a887e75fff7c43b48a88b5e03068c4bc', 'request_id': 'req-7a6f4dfe-91fc-4580-bcef-0b2e9ce897f8'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:09.322513 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e07e4-8415-422c-bf87-f802aa5a5b56 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:09.325946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-7a6f4dfe-91fc-4580-bcef-0b2e9ce897f8 admin admin] The token cache is being invalidate because project a887e75fff7c43b48a88b5e03068c4bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:45:09.326719 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-7a6f4dfe-91fc-4580-bcef-0b2e9ce897f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:09.328433 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-7a6f4dfe-91fc-4580-bcef-0b2e9ce897f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:09.334876 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 884/1772] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:45:08 2022] DELETE /identity/v3/projects/a887e75fff7c43b48a88b5e03068c4bc => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:09.347897 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9a80e-c572-45f5-9094-0dfe39d73022 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:09.348060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9a80e-c572-45f5-9094-0dfe39d73022 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:09.348351 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9a80e-c572-45f5-9094-0dfe39d73022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:09.427392 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:09.436896 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-7ad9a80e-c572-45f5-9094-0dfe39d73022 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:09.446720 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-7ad9a80e-c572-45f5-9094-0dfe39d73022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:09.539960 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f07e9-021a-43b2-9b9d-ef33ff2db4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:09.541185 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f07e9-021a-43b2-9b9d-ef33ff2db4b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:09.541539 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f07e9-021a-43b2-9b9d-ef33ff2db4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:09.541816 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f07e9-021a-43b2-9b9d-ef33ff2db4b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:09.542507 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f07e9-021a-43b2-9b9d-ef33ff2db4b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:09.563444 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f07e9-021a-43b2-9b9d-ef33ff2db4b0 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:09.658924 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 885/1774] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:09.661068 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 889/1773] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:45:09 2022] POST /identity/v3/users => generated 297 bytes in 552 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:09.661968 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e96710-e362-48b0-8417-730070ec816e None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:09.661968 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e96710-e362-48b0-8417-730070ec816e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:09.662393 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e96710-e362-48b0-8417-730070ec816e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:09.662993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f07e9-021a-43b2-9b9d-ef33ff2db4b0 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:09.677165 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-683f07e9-021a-43b2-9b9d-ef33ff2db4b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:09.722781 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f07e9-021a-43b2-9b9d-ef33ff2db4b0 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:09.768446 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8ac81-f1ff-42e1-87a2-46a4d281a399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:09.769922 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8ac81-f1ff-42e1-87a2-46a4d281a399 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:09.770904 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8ac81-f1ff-42e1-87a2-46a4d281a399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:09.771509 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8ac81-f1ff-42e1-87a2-46a4d281a399 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:09.772956 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8ac81-f1ff-42e1-87a2-46a4d281a399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:09.775377 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-21e96710-e362-48b0-8417-730070ec816e None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:09.784593 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-21e96710-e362-48b0-8417-730070ec816e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:09.784826 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a8ac81-f1ff-42e1-87a2-46a4d281a399 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:09.830052 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 890/1775] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:09.833126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8ac81-f1ff-42e1-87a2-46a4d281a399 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:09.864536 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 886/1776] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:09.865902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e96710-e362-48b0-8417-730070ec816e None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:09.872987 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8ac81-f1ff-42e1-87a2-46a4d281a399 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:09.894458 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ae8b2-f872-4ab7-b5dc-47811b40de15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:09.899859 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ae8b2-f872-4ab7-b5dc-47811b40de15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:09.901332 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ae8b2-f872-4ab7-b5dc-47811b40de15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:09.901332 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ae8b2-f872-4ab7-b5dc-47811b40de15 admin admin] PATH_INFO: `/v3/projects/e7b30efaf23046a880c996388a41bf6f/users/a5e9542f0cc941f195cf7a93d6120afb/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:09.923521 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e96710-e362-48b0-8417-730070ec816e None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:09.971458 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066a675-63d8-4006-b437-4d4d770a5683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:09.974522 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ae8b2-f872-4ab7-b5dc-47811b40de15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7b30efaf23046a880c996388a41bf6f, user_id=a5e9542f0cc941f195cf7a93d6120afb, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:09.975071 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066a675-63d8-4006-b437-4d4d770a5683 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:09.976119 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066a675-63d8-4006-b437-4d4d770a5683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:09.976640 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066a675-63d8-4006-b437-4d4d770a5683 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:09.982166 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ae8b2-f872-4ab7-b5dc-47811b40de15 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:09.982386 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066a675-63d8-4006-b437-4d4d770a5683 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:45:09.982981 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066a675-63d8-4006-b437-4d4d770a5683 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:09.990754 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066a675-63d8-4006-b437-4d4d770a5683 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:10.049022 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 891/1777] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:09 2022] PUT /identity/v3/projects/e7b30efaf23046a880c996388a41bf6f/users/a5e9542f0cc941f195cf7a93d6120afb/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:10.051356 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ae8b2-f872-4ab7-b5dc-47811b40de15 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:10.094929 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 887/1778] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:45:10.097189 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066a675-63d8-4006-b437-4d4d770a5683 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:10.148969 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ae8b2-f872-4ab7-b5dc-47811b40de15 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:10.156113 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066a675-63d8-4006-b437-4d4d770a5683 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:10.158077 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a563293-e6bf-4777-b1c2-1ebfba156d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:10.158864 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a563293-e6bf-4777-b1c2-1ebfba156d1a admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:10.159220 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a563293-e6bf-4777-b1c2-1ebfba156d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:10.159623 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a563293-e6bf-4777-b1c2-1ebfba156d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:10.160355 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a563293-e6bf-4777-b1c2-1ebfba156d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:10.162180 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a563293-e6bf-4777-b1c2-1ebfba156d1a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:10.180859 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 892/1779] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:10.182047 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a563293-e6bf-4777-b1c2-1ebfba156d1a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:10.193594 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6939822-3aa9-44b9-a499-1519fa8ae4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:10.199158 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6939822-3aa9-44b9-a499-1519fa8ae4e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:10.199721 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6939822-3aa9-44b9-a499-1519fa8ae4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:10.203823 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6939822-3aa9-44b9-a499-1519fa8ae4e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:10.205599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6939822-3aa9-44b9-a499-1519fa8ae4e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:10.211711 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6939822-3aa9-44b9-a499-1519fa8ae4e5 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:10.220407 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a563293-e6bf-4777-b1c2-1ebfba156d1a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:10.226098 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:10.248078 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987425c6-b35a-460e-b078-9aabc0d19e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:10.254104 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987425c6-b35a-460e-b078-9aabc0d19e30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:10.254104 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987425c6-b35a-460e-b078-9aabc0d19e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:10.254104 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987425c6-b35a-460e-b078-9aabc0d19e30 admin admin] PATH_INFO: `/v3/projects/e7b30efaf23046a880c996388a41bf6f/users/a5e9542f0cc941f195cf7a93d6120afb/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:10.255554 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987425c6-b35a-460e-b078-9aabc0d19e30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7b30efaf23046a880c996388a41bf6f, user_id=a5e9542f0cc941f195cf7a93d6120afb, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:10.264166 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987425c6-b35a-460e-b078-9aabc0d19e30 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:10.318864 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 893/1780] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:10 2022] PUT /identity/v3/projects/e7b30efaf23046a880c996388a41bf6f/users/a5e9542f0cc941f195cf7a93d6120afb/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:10.324128 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4db47-4969-4ca8-9b95-ec5d738b95f5 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:10.326472 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4db47-4969-4ca8-9b95-ec5d738b95f5 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:10.327367 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4db47-4969-4ca8-9b95-ec5d738b95f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:10.348309 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 888/1781] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:45:10 2022] POST /identity/v3/projects => generated 371 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:10.351472 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6939822-3aa9-44b9-a499-1519fa8ae4e5 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:10.397648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b4d4db47-4969-4ca8-9b95-ec5d738b95f5 None None] MFA Rules not processed for user `a5e9542f0cc941f195cf7a93d6120afb`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:10.399236 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b4d4db47-4969-4ca8-9b95-ec5d738b95f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:10.466035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:10.492844 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 894/1782] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:10.605563 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4db47-4969-4ca8-9b95-ec5d738b95f5 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:10.608188 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b4d4db47-4969-4ca8-9b95-ec5d738b95f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:10.623625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6939822-3aa9-44b9-a499-1519fa8ae4e5 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:10.671273 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef48d8-139b-4b9a-b153-7f9679d769e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:10.671273 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef48d8-139b-4b9a-b153-7f9679d769e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:10.671273 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef48d8-139b-4b9a-b153-7f9679d769e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:10.671273 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef48d8-139b-4b9a-b153-7f9679d769e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:10.672987 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef48d8-139b-4b9a-b153-7f9679d769e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:10.675881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef48d8-139b-4b9a-b153-7f9679d769e9 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:10.760261 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 889/1783] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:45:10 2022] POST /identity/v3/users => generated 286 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:10.762777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef48d8-139b-4b9a-b153-7f9679d769e9 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:10.798929 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef48d8-139b-4b9a-b153-7f9679d769e9 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:10.824690 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f81c4-6d4e-48d3-b401-85b391309033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:10.825341 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f81c4-6d4e-48d3-b401-85b391309033 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:10.825618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f81c4-6d4e-48d3-b401-85b391309033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:10.826198 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f81c4-6d4e-48d3-b401-85b391309033 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:10.826917 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f81c4-6d4e-48d3-b401-85b391309033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:10.828652 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f81c4-6d4e-48d3-b401-85b391309033 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:10.841350 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4db47-4969-4ca8-9b95-ec5d738b95f5 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:10.849042 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943950a1-9621-4ab5-ba04-9e1b9dc3c6c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:10.850106 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943950a1-9621-4ab5-ba04-9e1b9dc3c6c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:10.850559 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943950a1-9621-4ab5-ba04-9e1b9dc3c6c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:10.852011 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943950a1-9621-4ab5-ba04-9e1b9dc3c6c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:10.868169 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943950a1-9621-4ab5-ba04-9e1b9dc3c6c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:10.871298 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943950a1-9621-4ab5-ba04-9e1b9dc3c6c2 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:10.886070 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 895/1784] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:45:10.890415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 890/1785] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:10.891573 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943950a1-9621-4ab5-ba04-9e1b9dc3c6c2 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:10.936557 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943950a1-9621-4ab5-ba04-9e1b9dc3c6c2 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:10.952022 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b4275-4205-43c3-950f-c89edcefe905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:10.952916 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b4275-4205-43c3-950f-c89edcefe905 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:10.953379 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b4275-4205-43c3-950f-c89edcefe905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:10.953763 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b4275-4205-43c3-950f-c89edcefe905 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:10.956449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b4275-4205-43c3-950f-c89edcefe905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:10.963324 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b4275-4205-43c3-950f-c89edcefe905 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:11.003446 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 896/1786] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:11.004667 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f81c4-6d4e-48d3-b401-85b391309033 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:11.015453 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f81c4-6d4e-48d3-b401-85b391309033 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:11.041473 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09463f-c784-46b8-bb52-d2ec07f20a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:11.042299 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09463f-c784-46b8-bb52-d2ec07f20a24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:11.052515 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09463f-c784-46b8-bb52-d2ec07f20a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:11.054802 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09463f-c784-46b8-bb52-d2ec07f20a24 admin admin] PATH_INFO: `/v3/projects/386ae1ee71ee47ecba8985675d032fb8/users/609d5c7a9bbb481c954cd309dabdf277/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:11.133950 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09463f-c784-46b8-bb52-d2ec07f20a24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=386ae1ee71ee47ecba8985675d032fb8, user_id=609d5c7a9bbb481c954cd309dabdf277, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:11.136846 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09463f-c784-46b8-bb52-d2ec07f20a24 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:11.190049 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 891/1787] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:11 2022] PUT /identity/v3/projects/386ae1ee71ee47ecba8985675d032fb8/users/609d5c7a9bbb481c954cd309dabdf277/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:11.212933 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf308424-8afd-43bf-a0bf-7b178792c919 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:11.213294 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf308424-8afd-43bf-a0bf-7b178792c919 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:11.213549 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf308424-8afd-43bf-a0bf-7b178792c919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:11.371691 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-bf308424-8afd-43bf-a0bf-7b178792c919 None None] MFA Rules not processed for user `609d5c7a9bbb481c954cd309dabdf277`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:11.379667 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-bf308424-8afd-43bf-a0bf-7b178792c919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:11.698752 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 897/1788] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 487 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:11.703057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09463f-c784-46b8-bb52-d2ec07f20a24 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:11.895398 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09463f-c784-46b8-bb52-d2ec07f20a24 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:11.902915 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d819f1-8574-49a2-92e1-3af82964280b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:11.904122 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d819f1-8574-49a2-92e1-3af82964280b admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:11.904686 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d819f1-8574-49a2-92e1-3af82964280b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:11.905246 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d819f1-8574-49a2-92e1-3af82964280b admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:11.906050 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d819f1-8574-49a2-92e1-3af82964280b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:11.908635 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d819f1-8574-49a2-92e1-3af82964280b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:11.991310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 892/1789] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:45:11 2022] POST /identity/v3/projects => generated 373 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:11.997569 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf308424-8afd-43bf-a0bf-7b178792c919 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:12.017606 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf308424-8afd-43bf-a0bf-7b178792c919 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:12.252933 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79b1f1-a6b1-424b-bd71-dfd1f35fd4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:12.260573 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79b1f1-a6b1-424b-bd71-dfd1f35fd4ad admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:12.261181 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79b1f1-a6b1-424b-bd71-dfd1f35fd4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:12.263767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79b1f1-a6b1-424b-bd71-dfd1f35fd4ad admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:12.267303 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79b1f1-a6b1-424b-bd71-dfd1f35fd4ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:12.269803 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79b1f1-a6b1-424b-bd71-dfd1f35fd4ad admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:12.329654 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d819f1-8574-49a2-92e1-3af82964280b admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:12.347928 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:12.349420 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 898/1790] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:45:11 2022] POST /identity/v3/users => generated 293 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:12.354506 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79b1f1-a6b1-424b-bd71-dfd1f35fd4ad admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:12.384616 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79b1f1-a6b1-424b-bd71-dfd1f35fd4ad admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:12.427505 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4fc9a-ed70-4779-aee0-8719ceb0c79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:12.428678 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4fc9a-ed70-4779-aee0-8719ceb0c79b admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:12.429040 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4fc9a-ed70-4779-aee0-8719ceb0c79b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:12.429369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4fc9a-ed70-4779-aee0-8719ceb0c79b admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:12.430415 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4fc9a-ed70-4779-aee0-8719ceb0c79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:12.434889 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4fc9a-ed70-4779-aee0-8719ceb0c79b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:12.452143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:12.459396 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 899/1791] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:45:12.465679 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4fc9a-ed70-4779-aee0-8719ceb0c79b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:12.509249 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4fc9a-ed70-4779-aee0-8719ceb0c79b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:12.536433 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d819f1-8574-49a2-92e1-3af82964280b admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:12.540787 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71204583-241b-4c7a-a89c-728704eecd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:12.541537 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71204583-241b-4c7a-a89c-728704eecd88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:12.541816 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71204583-241b-4c7a-a89c-728704eecd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:12.542096 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71204583-241b-4c7a-a89c-728704eecd88 admin admin] PATH_INFO: `/v3/projects/5b2900a59c3542efb9ab41c3550db964/users/d6683a5192634ad7a690b48c8f1003bd/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:12.545640 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7161a4e-7b7d-45fe-bc71-69d1d5429078 tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e9542f0cc941f195cf7a93d6120afb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7b30efaf23046a880c996388a41bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:12.547183 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7161a4e-7b7d-45fe-bc71-69d1d5429078 tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:12.548922 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7161a4e-7b7d-45fe-bc71-69d1d5429078 tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:12.549970 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7161a4e-7b7d-45fe-bc71-69d1d5429078 tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:12.551046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7161a4e-7b7d-45fe-bc71-69d1d5429078 tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:45:12.551597 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7161a4e-7b7d-45fe-bc71-69d1d5429078 tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:12.554593 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7161a4e-7b7d-45fe-bc71-69d1d5429078 tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:12.599067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 893/1792] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:45:12.604677 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7161a4e-7b7d-45fe-bc71-69d1d5429078 tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:12.612199 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71204583-241b-4c7a-a89c-728704eecd88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2900a59c3542efb9ab41c3550db964, user_id=d6683a5192634ad7a690b48c8f1003bd, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:12.640745 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71204583-241b-4c7a-a89c-728704eecd88 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:12.651478 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7161a4e-7b7d-45fe-bc71-69d1d5429078 tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:12.672065 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa99f54-3470-481a-8385-eadda5ec77ea tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e9542f0cc941f195cf7a93d6120afb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7b30efaf23046a880c996388a41bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:12.672887 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa99f54-3470-481a-8385-eadda5ec77ea tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:12.673379 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa99f54-3470-481a-8385-eadda5ec77ea tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:12.673882 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa99f54-3470-481a-8385-eadda5ec77ea tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:12.683783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa99f54-3470-481a-8385-eadda5ec77ea tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:12.684580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa99f54-3470-481a-8385-eadda5ec77ea tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:12.699404 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 900/1793] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:12 2022] PUT /identity/v3/projects/5b2900a59c3542efb9ab41c3550db964/users/d6683a5192634ad7a690b48c8f1003bd/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:12.705317 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71204583-241b-4c7a-a89c-728704eecd88 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:12.809741 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 894/1794] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:45:12 2022] POST /identity/v3/projects => generated 354 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:12.815587 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa99f54-3470-481a-8385-eadda5ec77ea tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:12.946558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71204583-241b-4c7a-a89c-728704eecd88 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:13.132052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa99f54-3470-481a-8385-eadda5ec77ea tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:13.153134 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68040f76-c3c2-4df5-adbf-d5b8991a866f tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e9542f0cc941f195cf7a93d6120afb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7b30efaf23046a880c996388a41bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:13.156150 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68040f76-c3c2-4df5-adbf-d5b8991a866f tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:13.157248 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec4035-af89-443d-8def-5d4f0c7b47de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:13.157993 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68040f76-c3c2-4df5-adbf-d5b8991a866f tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:13.158554 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68040f76-c3c2-4df5-adbf-d5b8991a866f tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:13.160325 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68040f76-c3c2-4df5-adbf-d5b8991a866f tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:45:13.161429 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec4035-af89-443d-8def-5d4f0c7b47de admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:13.161850 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec4035-af89-443d-8def-5d4f0c7b47de admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:13.162248 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec4035-af89-443d-8def-5d4f0c7b47de admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:13.162842 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68040f76-c3c2-4df5-adbf-d5b8991a866f tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:13.164279 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec4035-af89-443d-8def-5d4f0c7b47de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:13.169730 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68040f76-c3c2-4df5-adbf-d5b8991a866f tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:13.174077 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec4035-af89-443d-8def-5d4f0c7b47de admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:13.198286 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 901/1795] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 491 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:13.198286 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160eec8-e07d-42d9-bb2d-3b8c47ce4466 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:13.198286 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160eec8-e07d-42d9-bb2d-3b8c47ce4466 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:13.198286 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160eec8-e07d-42d9-bb2d-3b8c47ce4466 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:13.200707 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 902/1796] 10.222.0.66 () {54 vars in 921 bytes} [Mon Sep 26 05:45:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:45:13.201705 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160eec8-e07d-42d9-bb2d-3b8c47ce4466 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:13.221935 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160eec8-e07d-42d9-bb2d-3b8c47ce4466 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:13.224055 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 895/1797] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:45:13.247932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4421e8-a5bd-408d-88a4-8fba187af0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:13.255964 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4421e8-a5bd-408d-88a4-8fba187af0e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:13.256337 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4421e8-a5bd-408d-88a4-8fba187af0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:13.256617 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4421e8-a5bd-408d-88a4-8fba187af0e7 admin admin] PATH_INFO: `/v3/projects/5b2900a59c3542efb9ab41c3550db964/users/d6683a5192634ad7a690b48c8f1003bd/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:13.264493 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4421e8-a5bd-408d-88a4-8fba187af0e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2900a59c3542efb9ab41c3550db964, user_id=d6683a5192634ad7a690b48c8f1003bd, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:13.271705 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4421e8-a5bd-408d-88a4-8fba187af0e7 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:13.302702 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68040f76-c3c2-4df5-adbf-d5b8991a866f tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:13.321798 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 903/1798] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:13 2022] PUT /identity/v3/projects/5b2900a59c3542efb9ab41c3550db964/users/d6683a5192634ad7a690b48c8f1003bd/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:13.332327 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68040f76-c3c2-4df5-adbf-d5b8991a866f tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:13.333014 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f08c1-fdf3-4278-97b6-d209dd06dc04 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:13.333307 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f08c1-fdf3-4278-97b6-d209dd06dc04 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:13.333583 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f08c1-fdf3-4278-97b6-d209dd06dc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:13.465238 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-3b4f08c1-fdf3-4278-97b6-d209dd06dc04 None None] MFA Rules not processed for user `d6683a5192634ad7a690b48c8f1003bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:13.472015 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3b4f08c1-fdf3-4278-97b6-d209dd06dc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:13.636486 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e1123-5ffe-48cd-96a7-01c8af2eeaea tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5e9542f0cc941f195cf7a93d6120afb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e7b30efaf23046a880c996388a41bf6f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:13.637355 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e1123-5ffe-48cd-96a7-01c8af2eeaea tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:13.640086 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e1123-5ffe-48cd-96a7-01c8af2eeaea tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:13.640416 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e1123-5ffe-48cd-96a7-01c8af2eeaea tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] PATH_INFO: `/v3/projects/b0970382ed9741d8bcc3d7ba00fa9f4b` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:13.646267 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e1123-5ffe-48cd-96a7-01c8af2eeaea tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b0970382ed9741d8bcc3d7ba00fa9f4b)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:13.653378 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e1123-5ffe-48cd-96a7-01c8af2eeaea tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:13.738312 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:13.758090 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1c7e1123-5ffe-48cd-96a7-01c8af2eeaea tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0970382ed9741d8bcc3d7ba00fa9f4b', 'request_id': 'req-1c7e1123-5ffe-48cd-96a7-01c8af2eeaea'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:13.775271 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:13.776956 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1c7e1123-5ffe-48cd-96a7-01c8af2eeaea tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0970382ed9741d8bcc3d7ba00fa9f4b', 'request_id': 'req-1c7e1123-5ffe-48cd-96a7-01c8af2eeaea'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:13.791213 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1c7e1123-5ffe-48cd-96a7-01c8af2eeaea tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0970382ed9741d8bcc3d7ba00fa9f4b', 'request_id': 'req-1c7e1123-5ffe-48cd-96a7-01c8af2eeaea'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:13.818142 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1c7e1123-5ffe-48cd-96a7-01c8af2eeaea tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] The token cache is being invalidate because project b0970382ed9741d8bcc3d7ba00fa9f4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:45:13.818908 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1c7e1123-5ffe-48cd-96a7-01c8af2eeaea tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:13.820017 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1c7e1123-5ffe-48cd-96a7-01c8af2eeaea tempest-VolumeQuotaClassesTest-2077212938 tempest-VolumeQuotaClassesTest-2077212938-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:13.823093 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 896/1799] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:45:13 2022] DELETE /identity/v3/projects/b0970382ed9741d8bcc3d7ba00fa9f4b => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:13.824874 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18bee9-7918-49cf-80ca-45293f02e16e None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:13.825157 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18bee9-7918-49cf-80ca-45293f02e16e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:13.825436 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af18bee9-7918-49cf-80ca-45293f02e16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:13.904335 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-af18bee9-7918-49cf-80ca-45293f02e16e None None] MFA Rules not processed for user `c559a36836be411b9afd076f4c9a0655`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:13.908976 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-af18bee9-7918-49cf-80ca-45293f02e16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:13.942428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 904/1800] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 611 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:13.953434 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f08c1-fdf3-4278-97b6-d209dd06dc04 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:13.956013 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3b4f08c1-fdf3-4278-97b6-d209dd06dc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:14.276939 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 897/1801] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Sep 26 05:45:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:14.319701 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f08c1-fdf3-4278-97b6-d209dd06dc04 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:14.419273 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124fdbb-d087-44a2-8ee3-d920afa41911 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:14.420529 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124fdbb-d087-44a2-8ee3-d920afa41911 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:14.420979 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124fdbb-d087-44a2-8ee3-d920afa41911 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:14.421421 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124fdbb-d087-44a2-8ee3-d920afa41911 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:14.580868 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124fdbb-d087-44a2-8ee3-d920afa41911 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:14.589462 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124fdbb-d087-44a2-8ee3-d920afa41911 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:14.629388 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 905/1802] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 677 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:45:14.725650 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18bee9-7918-49cf-80ca-45293f02e16e None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:14.729484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-af18bee9-7918-49cf-80ca-45293f02e16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:14.941075 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af18bee9-7918-49cf-80ca-45293f02e16e None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:14.952057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c334194-31a4-4c9f-905f-6160ec00940b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:14.953202 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c334194-31a4-4c9f-905f-6160ec00940b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:14.953643 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c334194-31a4-4c9f-905f-6160ec00940b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:14.954072 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c334194-31a4-4c9f-905f-6160ec00940b admin admin] PATH_INFO: `/v3/users/63c818379ad148b28aa71818cff83f58` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:14.955856 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c334194-31a4-4c9f-905f-6160ec00940b admin admin] RBAC: Authorizing `identity:delete_user(user_id=63c818379ad148b28aa71818cff83f58)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:14.958737 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c334194-31a4-4c9f-905f-6160ec00940b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:15.103410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9c334194-31a4-4c9f-905f-6160ec00940b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63c818379ad148b28aa71818cff83f58'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:15.122553 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9c334194-31a4-4c9f-905f-6160ec00940b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63c818379ad148b28aa71818cff83f58'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:15.138845 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:15.160580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9c334194-31a4-4c9f-905f-6160ec00940b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63c818379ad148b28aa71818cff83f58'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:15.162828 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9c334194-31a4-4c9f-905f-6160ec00940b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63c818379ad148b28aa71818cff83f58'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:15.207343 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9c334194-31a4-4c9f-905f-6160ec00940b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63c818379ad148b28aa71818cff83f58'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:15.221983 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 898/1803] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:45:14 2022] DELETE /identity/v3/users/63c818379ad148b28aa71818cff83f58 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:15.226727 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8bcfa6-c17c-4f38-9bd1-42f6eaceaebc None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:15.227008 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8bcfa6-c17c-4f38-9bd1-42f6eaceaebc None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:15.227279 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8bcfa6-c17c-4f38-9bd1-42f6eaceaebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:15.277260 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-4e8bcfa6-c17c-4f38-9bd1-42f6eaceaebc None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:15.278635 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4e8bcfa6-c17c-4f38-9bd1-42f6eaceaebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:15.409609 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:15.520511 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 906/1804] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:45:15.592455 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c334194-31a4-4c9f-905f-6160ec00940b admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:15.594129 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-9c334194-31a4-4c9f-905f-6160ec00940b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:15.756145 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8bcfa6-c17c-4f38-9bd1-42f6eaceaebc None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:15.757952 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4e8bcfa6-c17c-4f38-9bd1-42f6eaceaebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:15.785955 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8bcfa6-c17c-4f38-9bd1-42f6eaceaebc None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:15.909731 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c734a24-620e-45ef-89f2-632c2a4ae064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:15.912337 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c734a24-620e-45ef-89f2-632c2a4ae064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:15.913273 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c734a24-620e-45ef-89f2-632c2a4ae064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:15.913910 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c734a24-620e-45ef-89f2-632c2a4ae064 admin admin] PATH_INFO: `/v3/users/83a2b00b16fe417abd438204eda4d459` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:15.922922 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c734a24-620e-45ef-89f2-632c2a4ae064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83a2b00b16fe417abd438204eda4d459)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:15.931410 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c734a24-620e-45ef-89f2-632c2a4ae064 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:15.939988 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c334194-31a4-4c9f-905f-6160ec00940b admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:15.963531 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47c5d2-7d22-4595-b03a-822062b7ca0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:15.964297 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47c5d2-7d22-4595-b03a-822062b7ca0a service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:15.964491 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47c5d2-7d22-4595-b03a-822062b7ca0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:15.967929 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f47c5d2-7d22-4595-b03a-822062b7ca0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:15.985602 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47c5d2-7d22-4595-b03a-822062b7ca0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:15.987950 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f47c5d2-7d22-4595-b03a-822062b7ca0a service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:16.013081 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 899/1805] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:45:16.015128 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47c5d2-7d22-4595-b03a-822062b7ca0a service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:16.016958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4f47c5d2-7d22-4595-b03a-822062b7ca0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:16.195192 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9c734a24-620e-45ef-89f2-632c2a4ae064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83a2b00b16fe417abd438204eda4d459'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:16.215899 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9c734a24-620e-45ef-89f2-632c2a4ae064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83a2b00b16fe417abd438204eda4d459'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:16.216865 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9c734a24-620e-45ef-89f2-632c2a4ae064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83a2b00b16fe417abd438204eda4d459'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:16.266452 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9c734a24-620e-45ef-89f2-632c2a4ae064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83a2b00b16fe417abd438204eda4d459'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:16.289058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9c734a24-620e-45ef-89f2-632c2a4ae064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83a2b00b16fe417abd438204eda4d459'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:16.337228 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 907/1806] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:45:15 2022] DELETE /identity/v3/users/83a2b00b16fe417abd438204eda4d459 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:45:16.339043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c734a24-620e-45ef-89f2-632c2a4ae064 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:16.343225 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9c734a24-620e-45ef-89f2-632c2a4ae064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:16.404755 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f47c5d2-7d22-4595-b03a-822062b7ca0a service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:16.530967 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c734a24-620e-45ef-89f2-632c2a4ae064 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:16.536615 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e604e0-5f6c-4b1b-89d3-e0b07358f718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:16.537388 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e604e0-5f6c-4b1b-89d3-e0b07358f718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:16.538186 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e604e0-5f6c-4b1b-89d3-e0b07358f718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:16.538531 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e604e0-5f6c-4b1b-89d3-e0b07358f718 admin admin] PATH_INFO: `/v3/users/609d5c7a9bbb481c954cd309dabdf277` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:16.540478 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e604e0-5f6c-4b1b-89d3-e0b07358f718 admin admin] RBAC: Authorizing `identity:delete_user(user_id=609d5c7a9bbb481c954cd309dabdf277)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:16.543058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e604e0-5f6c-4b1b-89d3-e0b07358f718 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:16.661123 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47339dcd-9372-4763-b8f2-2d0a056f6bb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:16.662322 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47339dcd-9372-4763-b8f2-2d0a056f6bb3 service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:16.662915 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47339dcd-9372-4763-b8f2-2d0a056f6bb3 service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:16.663111 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47339dcd-9372-4763-b8f2-2d0a056f6bb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:16.675030 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-37e604e0-5f6c-4b1b-89d3-e0b07358f718 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '609d5c7a9bbb481c954cd309dabdf277'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:16.682225 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-47339dcd-9372-4763-b8f2-2d0a056f6bb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:16.708558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-37e604e0-5f6c-4b1b-89d3-e0b07358f718 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '609d5c7a9bbb481c954cd309dabdf277'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:16.712516 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-37e604e0-5f6c-4b1b-89d3-e0b07358f718 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '609d5c7a9bbb481c954cd309dabdf277'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:16.720334 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:16.740185 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-37e604e0-5f6c-4b1b-89d3-e0b07358f718 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '609d5c7a9bbb481c954cd309dabdf277'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:16.770520 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-37e604e0-5f6c-4b1b-89d3-e0b07358f718 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '609d5c7a9bbb481c954cd309dabdf277'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:16.784729 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47339dcd-9372-4763-b8f2-2d0a056f6bb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:16.788108 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47339dcd-9372-4763-b8f2-2d0a056f6bb3 service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:16.793592 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 908/1807] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:45:16 2022] DELETE /identity/v3/users/609d5c7a9bbb481c954cd309dabdf277 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:16.796670 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646f1d1-5f03-44d6-9419-ddb9fc704ac9 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:16.796958 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646f1d1-5f03-44d6-9419-ddb9fc704ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:16.797236 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646f1d1-5f03-44d6-9419-ddb9fc704ac9 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:16.812775 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 909/1808] 10.222.0.66 () {54 vars in 921 bytes} [Mon Sep 26 05:45:16 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:45:16.814240 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b60db-e7cb-4513-be32-576c5c10caa8 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:16.814525 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b60db-e7cb-4513-be32-576c5c10caa8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:16.814685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:16.814834 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b60db-e7cb-4513-be32-576c5c10caa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:16.841768 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 900/1809] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 829 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:45:16.844161 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a638a2-5523-4a9b-8dae-edb1b7883892 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:16.846128 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a638a2-5523-4a9b-8dae-edb1b7883892 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:16.846911 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a638a2-5523-4a9b-8dae-edb1b7883892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:16.921083 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-295b60db-e7cb-4513-be32-576c5c10caa8 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:16.926076 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-295b60db-e7cb-4513-be32-576c5c10caa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:16.935147 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-a1a638a2-5523-4a9b-8dae-edb1b7883892 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:16.939324 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a1a638a2-5523-4a9b-8dae-edb1b7883892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:17.166491 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 910/1810] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:17.166491 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0445ff2-0b59-4197-8830-ab5a24b3b565 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:17.166491 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0445ff2-0b59-4197-8830-ab5a24b3b565 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:17.167487 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0445ff2-0b59-4197-8830-ab5a24b3b565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:17.282534 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b0445ff2-0b59-4197-8830-ab5a24b3b565 None None] MFA Rules not processed for user `c559a36836be411b9afd076f4c9a0655`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:17.288189 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b0445ff2-0b59-4197-8830-ab5a24b3b565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:17.299900 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 901/1811] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:17.300861 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a638a2-5523-4a9b-8dae-edb1b7883892 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:17.306148 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a1a638a2-5523-4a9b-8dae-edb1b7883892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:17.611662 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a638a2-5523-4a9b-8dae-edb1b7883892 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:17.626175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2005a-4be3-48a8-8033-9758384a8654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:17.628819 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2005a-4be3-48a8-8033-9758384a8654 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:17.630423 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2005a-4be3-48a8-8033-9758384a8654 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:17.632470 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2005a-4be3-48a8-8033-9758384a8654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:17.634703 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 911/1812] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Sep 26 05:45:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:17.636668 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0445ff2-0b59-4197-8830-ab5a24b3b565 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:17.641402 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b0445ff2-0b59-4197-8830-ab5a24b3b565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:17.677295 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2005a-4be3-48a8-8033-9758384a8654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:17.684425 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2005a-4be3-48a8-8033-9758384a8654 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:17.697918 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0445ff2-0b59-4197-8830-ab5a24b3b565 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:17.720767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb2dc0-79e5-4a6c-b6e7-7e1321524558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:17.722542 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb2dc0-79e5-4a6c-b6e7-7e1321524558 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:17.723235 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb2dc0-79e5-4a6c-b6e7-7e1321524558 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:17.723877 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb2dc0-79e5-4a6c-b6e7-7e1321524558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:17.728302 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 902/1813] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:45:17.760680 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb2dc0-79e5-4a6c-b6e7-7e1321524558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:17.765594 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb2dc0-79e5-4a6c-b6e7-7e1321524558 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:17.795295 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 912/1814] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:45:18.069365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2005a-4be3-48a8-8033-9758384a8654 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:18.071759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4de2005a-4be3-48a8-8033-9758384a8654 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:18.105402 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2005a-4be3-48a8-8033-9758384a8654 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:18.135611 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb98ef-9caa-4e43-9011-6a1d56567bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:18.136442 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb98ef-9caa-4e43-9011-6a1d56567bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:18.136845 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb98ef-9caa-4e43-9011-6a1d56567bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:18.137238 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb98ef-9caa-4e43-9011-6a1d56567bfb admin admin] PATH_INFO: `/v3/projects/e5e7fd556b3242bcb923abdef9f92a51` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:18.139171 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb98ef-9caa-4e43-9011-6a1d56567bfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5e7fd556b3242bcb923abdef9f92a51)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:18.149508 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfb98ef-9caa-4e43-9011-6a1d56567bfb admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:18.276786 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1bfb98ef-9caa-4e43-9011-6a1d56567bfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5e7fd556b3242bcb923abdef9f92a51', 'request_id': 'req-1bfb98ef-9caa-4e43-9011-6a1d56567bfb'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:18.289393 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1bfb98ef-9caa-4e43-9011-6a1d56567bfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5e7fd556b3242bcb923abdef9f92a51', 'request_id': 'req-1bfb98ef-9caa-4e43-9011-6a1d56567bfb'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:18.309402 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1bfb98ef-9caa-4e43-9011-6a1d56567bfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5e7fd556b3242bcb923abdef9f92a51', 'request_id': 'req-1bfb98ef-9caa-4e43-9011-6a1d56567bfb'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:18.325996 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1bfb98ef-9caa-4e43-9011-6a1d56567bfb admin admin] The token cache is being invalidate because project e5e7fd556b3242bcb923abdef9f92a51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:45:18.326354 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1bfb98ef-9caa-4e43-9011-6a1d56567bfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:18.327825 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1bfb98ef-9caa-4e43-9011-6a1d56567bfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:18.329724 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 903/1815] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:45:18 2022] DELETE /identity/v3/projects/e5e7fd556b3242bcb923abdef9f92a51 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:45:18.334499 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb2dc0-79e5-4a6c-b6e7-7e1321524558 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:18.350157 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb2dc0-79e5-4a6c-b6e7-7e1321524558 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:18.442334 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:18.461792 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f1345-e0f3-44e3-a266-20a799671640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:18.462632 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f1345-e0f3-44e3-a266-20a799671640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:18.465093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f1345-e0f3-44e3-a266-20a799671640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:18.466746 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f1345-e0f3-44e3-a266-20a799671640 admin admin] PATH_INFO: `/v3/users/a5e9542f0cc941f195cf7a93d6120afb` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:18.472513 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f1345-e0f3-44e3-a266-20a799671640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5e9542f0cc941f195cf7a93d6120afb)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:18.480778 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4f1345-e0f3-44e3-a266-20a799671640 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:18.611641 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb98ef-9caa-4e43-9011-6a1d56567bfb admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:18.614529 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1bfb98ef-9caa-4e43-9011-6a1d56567bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:18.685313 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8f4f1345-e0f3-44e3-a266-20a799671640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5e9542f0cc941f195cf7a93d6120afb'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:18.702148 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8f4f1345-e0f3-44e3-a266-20a799671640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5e9542f0cc941f195cf7a93d6120afb'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:18.702948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8f4f1345-e0f3-44e3-a266-20a799671640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5e9542f0cc941f195cf7a93d6120afb'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:18.713084 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:18.743075 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8f4f1345-e0f3-44e3-a266-20a799671640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5e9542f0cc941f195cf7a93d6120afb'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:18.761420 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8f4f1345-e0f3-44e3-a266-20a799671640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5e9542f0cc941f195cf7a93d6120afb'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:18.779595 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 913/1816] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:45:18 2022] DELETE /identity/v3/users/a5e9542f0cc941f195cf7a93d6120afb => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:18.881676 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfb98ef-9caa-4e43-9011-6a1d56567bfb admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:19.053482 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffadac-5c1e-49cb-b800-6d5f0df09119 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:19.055250 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffadac-5c1e-49cb-b800-6d5f0df09119 service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:19.055545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffadac-5c1e-49cb-b800-6d5f0df09119 service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:19.055891 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffadac-5c1e-49cb-b800-6d5f0df09119 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:19.068065 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d6ffadac-5c1e-49cb-b800-6d5f0df09119 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:19.081866 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffadac-5c1e-49cb-b800-6d5f0df09119 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:19.083997 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffadac-5c1e-49cb-b800-6d5f0df09119 service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:19.128065 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 904/1817] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:45:19.491170 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f1345-e0f3-44e3-a266-20a799671640 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:19.493134 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8f4f1345-e0f3-44e3-a266-20a799671640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:19.637583 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f1345-e0f3-44e3-a266-20a799671640 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:19.643388 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8621702-0f58-449e-875f-71c732a5fc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:19.644244 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8621702-0f58-449e-875f-71c732a5fc50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:19.644588 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8621702-0f58-449e-875f-71c732a5fc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:19.644935 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8621702-0f58-449e-875f-71c732a5fc50 admin admin] PATH_INFO: `/v3/projects/492913b3edda477190022e78fe2e02ff` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:19.646404 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8621702-0f58-449e-875f-71c732a5fc50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=492913b3edda477190022e78fe2e02ff)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:19.648814 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8621702-0f58-449e-875f-71c732a5fc50 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:19.740067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffadac-5c1e-49cb-b800-6d5f0df09119 service nova] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:19.741672 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d6ffadac-5c1e-49cb-b800-6d5f0df09119 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:19.763583 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffadac-5c1e-49cb-b800-6d5f0df09119 service nova] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:19.804445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e8621702-0f58-449e-875f-71c732a5fc50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '492913b3edda477190022e78fe2e02ff', 'request_id': 'req-e8621702-0f58-449e-875f-71c732a5fc50'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:19.820698 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e8621702-0f58-449e-875f-71c732a5fc50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '492913b3edda477190022e78fe2e02ff', 'request_id': 'req-e8621702-0f58-449e-875f-71c732a5fc50'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:19.838393 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e8621702-0f58-449e-875f-71c732a5fc50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '492913b3edda477190022e78fe2e02ff', 'request_id': 'req-e8621702-0f58-449e-875f-71c732a5fc50'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:19.868253 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e8621702-0f58-449e-875f-71c732a5fc50 admin admin] The token cache is being invalidate because project 492913b3edda477190022e78fe2e02ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:45:19.868550 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e8621702-0f58-449e-875f-71c732a5fc50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:19.874098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e8621702-0f58-449e-875f-71c732a5fc50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:19.879451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 914/1818] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:45:19 2022] DELETE /identity/v3/projects/492913b3edda477190022e78fe2e02ff => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:19.880811 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8621702-0f58-449e-875f-71c732a5fc50 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:19.882632 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e8621702-0f58-449e-875f-71c732a5fc50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:19.893864 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:19.942978 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5174541-6f7f-45be-a377-34e9b2527407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:19.943791 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5174541-6f7f-45be-a377-34e9b2527407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:19.944198 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5174541-6f7f-45be-a377-34e9b2527407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:19.944543 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5174541-6f7f-45be-a377-34e9b2527407 admin admin] PATH_INFO: `/v3/projects/e7b30efaf23046a880c996388a41bf6f` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:19.946575 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5174541-6f7f-45be-a377-34e9b2527407 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7b30efaf23046a880c996388a41bf6f)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:19.948711 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5174541-6f7f-45be-a377-34e9b2527407 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:20.008951 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d5174541-6f7f-45be-a377-34e9b2527407 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7b30efaf23046a880c996388a41bf6f', 'request_id': 'req-d5174541-6f7f-45be-a377-34e9b2527407'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:20.009473 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8621702-0f58-449e-875f-71c732a5fc50 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:20.010797 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:20.020801 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d5174541-6f7f-45be-a377-34e9b2527407 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7b30efaf23046a880c996388a41bf6f', 'request_id': 'req-d5174541-6f7f-45be-a377-34e9b2527407'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:20.029999 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d5174541-6f7f-45be-a377-34e9b2527407 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7b30efaf23046a880c996388a41bf6f', 'request_id': 'req-d5174541-6f7f-45be-a377-34e9b2527407'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:20.045021 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d5174541-6f7f-45be-a377-34e9b2527407 admin admin] The token cache is being invalidate because project e7b30efaf23046a880c996388a41bf6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:45:20.045345 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d5174541-6f7f-45be-a377-34e9b2527407 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:20.045996 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d5174541-6f7f-45be-a377-34e9b2527407 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:20.047603 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 905/1819] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:45:19 2022] DELETE /identity/v3/projects/e7b30efaf23046a880c996388a41bf6f => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:20.048453 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5174541-6f7f-45be-a377-34e9b2527407 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:20.050355 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d5174541-6f7f-45be-a377-34e9b2527407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:20.083761 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c9d1f-906e-477e-aadc-9a0a2a54c90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:20.085367 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c9d1f-906e-477e-aadc-9a0a2a54c90e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:20.087153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c9d1f-906e-477e-aadc-9a0a2a54c90e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:20.087458 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c9d1f-906e-477e-aadc-9a0a2a54c90e admin admin] PATH_INFO: `/v3/users/248b332960f54028a820b223e26e7f87` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:20.089658 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c9d1f-906e-477e-aadc-9a0a2a54c90e admin admin] RBAC: Authorizing `identity:delete_user(user_id=248b332960f54028a820b223e26e7f87)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:20.093499 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c9d1f-906e-477e-aadc-9a0a2a54c90e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:20.148632 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5174541-6f7f-45be-a377-34e9b2527407 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:20.156139 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103c7a8-4529-4fd9-a636-d1d02131626a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:20.156869 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103c7a8-4529-4fd9-a636-d1d02131626a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:20.157138 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103c7a8-4529-4fd9-a636-d1d02131626a admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:20.157429 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103c7a8-4529-4fd9-a636-d1d02131626a admin admin] PATH_INFO: `/v3/projects/386ae1ee71ee47ecba8985675d032fb8` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:20.161088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103c7a8-4529-4fd9-a636-d1d02131626a admin admin] RBAC: Authorizing `identity:delete_project(project_id=386ae1ee71ee47ecba8985675d032fb8)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:20.164962 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9103c7a8-4529-4fd9-a636-d1d02131626a admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:20.178900 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-792c9d1f-906e-477e-aadc-9a0a2a54c90e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '248b332960f54028a820b223e26e7f87'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:20.189143 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-792c9d1f-906e-477e-aadc-9a0a2a54c90e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '248b332960f54028a820b223e26e7f87'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:20.189944 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-792c9d1f-906e-477e-aadc-9a0a2a54c90e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '248b332960f54028a820b223e26e7f87'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:20.207683 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-792c9d1f-906e-477e-aadc-9a0a2a54c90e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '248b332960f54028a820b223e26e7f87'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:20.223157 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-792c9d1f-906e-477e-aadc-9a0a2a54c90e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '248b332960f54028a820b223e26e7f87'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:20.232801 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 915/1820] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:45:19 2022] DELETE /identity/v3/users/248b332960f54028a820b223e26e7f87 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:20.234433 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c431aea-c53f-4956-85e6-a693e839b214 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:20.234899 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c431aea-c53f-4956-85e6-a693e839b214 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:20.235352 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c431aea-c53f-4956-85e6-a693e839b214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:20.243488 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9103c7a8-4529-4fd9-a636-d1d02131626a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '386ae1ee71ee47ecba8985675d032fb8', 'request_id': 'req-9103c7a8-4529-4fd9-a636-d1d02131626a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:20.255878 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9103c7a8-4529-4fd9-a636-d1d02131626a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '386ae1ee71ee47ecba8985675d032fb8', 'request_id': 'req-9103c7a8-4529-4fd9-a636-d1d02131626a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:20.267069 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9103c7a8-4529-4fd9-a636-d1d02131626a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '386ae1ee71ee47ecba8985675d032fb8', 'request_id': 'req-9103c7a8-4529-4fd9-a636-d1d02131626a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:20.270211 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-5c431aea-c53f-4956-85e6-a693e839b214 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:20.272451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5c431aea-c53f-4956-85e6-a693e839b214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:20.287371 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9103c7a8-4529-4fd9-a636-d1d02131626a admin admin] The token cache is being invalidate because project 386ae1ee71ee47ecba8985675d032fb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:45:20.287683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9103c7a8-4529-4fd9-a636-d1d02131626a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:20.288665 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9103c7a8-4529-4fd9-a636-d1d02131626a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:20.295184 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 906/1821] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:45:20 2022] DELETE /identity/v3/projects/386ae1ee71ee47ecba8985675d032fb8 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:20.306633 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103c7a8-4529-4fd9-a636-d1d02131626a admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:20.308505 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-9103c7a8-4529-4fd9-a636-d1d02131626a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:20.341904 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:20.423041 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 916/1822] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:20.432273 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4146c2a-badd-4eb7-bb59-0cacbb093484 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:20.432704 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4146c2a-badd-4eb7-bb59-0cacbb093484 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:20.433131 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4146c2a-badd-4eb7-bb59-0cacbb093484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:20.452530 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9103c7a8-4529-4fd9-a636-d1d02131626a admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:20.456671 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b4146c2a-badd-4eb7-bb59-0cacbb093484 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:20.457727 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b4146c2a-badd-4eb7-bb59-0cacbb093484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:20.459606 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec441fe-abfa-4c92-8d8f-80a96dc6271c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:20.460368 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec441fe-abfa-4c92-8d8f-80a96dc6271c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:20.460688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec441fe-abfa-4c92-8d8f-80a96dc6271c admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:20.460908 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec441fe-abfa-4c92-8d8f-80a96dc6271c admin admin] PATH_INFO: `/v3/users/d6683a5192634ad7a690b48c8f1003bd` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:20.462605 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec441fe-abfa-4c92-8d8f-80a96dc6271c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6683a5192634ad7a690b48c8f1003bd)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:20.464922 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec441fe-abfa-4c92-8d8f-80a96dc6271c admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:20.471974 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 917/1823] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:45:20.474421 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4146c2a-badd-4eb7-bb59-0cacbb093484 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:20.482885 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:20.503711 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4146c2a-badd-4eb7-bb59-0cacbb093484 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:20.512381 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ed774-6ba1-4b29-9e21-93cd0e07aa49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:20.513592 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ed774-6ba1-4b29-9e21-93cd0e07aa49 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:20.514133 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ed774-6ba1-4b29-9e21-93cd0e07aa49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:20.514911 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ed774-6ba1-4b29-9e21-93cd0e07aa49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:20.516238 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ed774-6ba1-4b29-9e21-93cd0e07aa49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:45:20.516741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ed774-6ba1-4b29-9e21-93cd0e07aa49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:20.520055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ed774-6ba1-4b29-9e21-93cd0e07aa49 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:20.544578 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 918/1824] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:45:20.553016 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ed774-6ba1-4b29-9e21-93cd0e07aa49 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:20.561367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6ec441fe-abfa-4c92-8d8f-80a96dc6271c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6683a5192634ad7a690b48c8f1003bd'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:20.570055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ed774-6ba1-4b29-9e21-93cd0e07aa49 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:20.576836 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6ec441fe-abfa-4c92-8d8f-80a96dc6271c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6683a5192634ad7a690b48c8f1003bd'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:20.577873 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0048cbf-ca5d-4626-9b90-c545d9b04c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:20.578685 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0048cbf-ca5d-4626-9b90-c545d9b04c06 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:20.579755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0048cbf-ca5d-4626-9b90-c545d9b04c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:20.579755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0048cbf-ca5d-4626-9b90-c545d9b04c06 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:20.580411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0048cbf-ca5d-4626-9b90-c545d9b04c06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:20.583181 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0048cbf-ca5d-4626-9b90-c545d9b04c06 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:20.603324 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6ec441fe-abfa-4c92-8d8f-80a96dc6271c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6683a5192634ad7a690b48c8f1003bd'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:20.604879 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6ec441fe-abfa-4c92-8d8f-80a96dc6271c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6683a5192634ad7a690b48c8f1003bd'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:20.634035 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6ec441fe-abfa-4c92-8d8f-80a96dc6271c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6683a5192634ad7a690b48c8f1003bd'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:20.656186 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 919/1825] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:45:20 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:20.657616 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 907/1826] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:45:20 2022] DELETE /identity/v3/users/d6683a5192634ad7a690b48c8f1003bd => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:20.670854 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0048cbf-ca5d-4626-9b90-c545d9b04c06 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:20.674101 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e0048cbf-ca5d-4626-9b90-c545d9b04c06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:20.775864 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0048cbf-ca5d-4626-9b90-c545d9b04c06 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:20.782246 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0239094-5dd7-4825-a195-b7302dfeba6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:20.782952 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0239094-5dd7-4825-a195-b7302dfeba6c admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:20.783232 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0239094-5dd7-4825-a195-b7302dfeba6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:20.783531 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0239094-5dd7-4825-a195-b7302dfeba6c admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:20.784277 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0239094-5dd7-4825-a195-b7302dfeba6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:20.786351 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0239094-5dd7-4825-a195-b7302dfeba6c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:20.819955 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 920/1827] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:45:20 2022] POST /identity/v3/users => generated 291 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:20.824993 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec441fe-abfa-4c92-8d8f-80a96dc6271c admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:20.952256 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0239094-5dd7-4825-a195-b7302dfeba6c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:20.954610 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f0239094-5dd7-4825-a195-b7302dfeba6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:20.994018 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0239094-5dd7-4825-a195-b7302dfeba6c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:21.022896 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee2f32-2edc-47da-987e-ed55695d6d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:21.024195 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee2f32-2edc-47da-987e-ed55695d6d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:21.026014 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee2f32-2edc-47da-987e-ed55695d6d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:21.026169 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee2f32-2edc-47da-987e-ed55695d6d91 admin admin] PATH_INFO: `/v3/projects/bade5a35b2014affb4dfb87c7368705f` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:21.029712 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee2f32-2edc-47da-987e-ed55695d6d91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bade5a35b2014affb4dfb87c7368705f)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:21.036706 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee2f32-2edc-47da-987e-ed55695d6d91 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:21.051411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec441fe-abfa-4c92-8d8f-80a96dc6271c admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:21.059484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27caf7a9-438a-4fe3-804e-34e55c6a4372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:21.062025 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27caf7a9-438a-4fe3-804e-34e55c6a4372 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:21.062626 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27caf7a9-438a-4fe3-804e-34e55c6a4372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:21.063356 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27caf7a9-438a-4fe3-804e-34e55c6a4372 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:21.069701 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27caf7a9-438a-4fe3-804e-34e55c6a4372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:21.076220 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27caf7a9-438a-4fe3-804e-34e55c6a4372 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:21.112646 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 908/1828] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:21.114920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27caf7a9-438a-4fe3-804e-34e55c6a4372 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:21.131576 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27caf7a9-438a-4fe3-804e-34e55c6a4372 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:21.151881 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-32ee2f32-2edc-47da-987e-ed55695d6d91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bade5a35b2014affb4dfb87c7368705f', 'request_id': 'req-32ee2f32-2edc-47da-987e-ed55695d6d91'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:21.161908 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-32ee2f32-2edc-47da-987e-ed55695d6d91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bade5a35b2014affb4dfb87c7368705f', 'request_id': 'req-32ee2f32-2edc-47da-987e-ed55695d6d91'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:21.173001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-32ee2f32-2edc-47da-987e-ed55695d6d91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bade5a35b2014affb4dfb87c7368705f', 'request_id': 'req-32ee2f32-2edc-47da-987e-ed55695d6d91'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:21.205168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-32ee2f32-2edc-47da-987e-ed55695d6d91 admin admin] The token cache is being invalidate because project bade5a35b2014affb4dfb87c7368705f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:45:21.205898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-32ee2f32-2edc-47da-987e-ed55695d6d91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:21.206847 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-32ee2f32-2edc-47da-987e-ed55695d6d91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:21.214872 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 921/1829] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:45:20 2022] DELETE /identity/v3/projects/bade5a35b2014affb4dfb87c7368705f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:21.217188 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071263fc-24ca-40ab-9e82-aab64e8eae73 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:21.217724 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071263fc-24ca-40ab-9e82-aab64e8eae73 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:21.218157 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071263fc-24ca-40ab-9e82-aab64e8eae73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:21.228444 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:21.249175 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-071263fc-24ca-40ab-9e82-aab64e8eae73 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:21.251812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-071263fc-24ca-40ab-9e82-aab64e8eae73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:21.281548 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f78709-f918-4967-91c8-02c6f4608dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:21.282604 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f78709-f918-4967-91c8-02c6f4608dbc admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:21.283120 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f78709-f918-4967-91c8-02c6f4608dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:21.283793 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f78709-f918-4967-91c8-02c6f4608dbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:21.284704 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f78709-f918-4967-91c8-02c6f4608dbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:21.286645 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f78709-f918-4967-91c8-02c6f4608dbc admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:21.301236 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 909/1830] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:21 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:21.306927 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f78709-f918-4967-91c8-02c6f4608dbc admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:21.309893 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-07f78709-f918-4967-91c8-02c6f4608dbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:21.329352 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f78709-f918-4967-91c8-02c6f4608dbc admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:21.344637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c300c33-7f9c-4232-9d5d-2d18a6025766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:21.348734 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c300c33-7f9c-4232-9d5d-2d18a6025766 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:21.349829 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c300c33-7f9c-4232-9d5d-2d18a6025766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:21.350294 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c300c33-7f9c-4232-9d5d-2d18a6025766 admin admin] PATH_INFO: `/v3/projects/1695944bf2fa470a967b83ef88efe074/users/afbfa29766db4156bcf7832194e23ba1/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:21.380833 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c300c33-7f9c-4232-9d5d-2d18a6025766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1695944bf2fa470a967b83ef88efe074, user_id=afbfa29766db4156bcf7832194e23ba1, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:21.385261 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c300c33-7f9c-4232-9d5d-2d18a6025766 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:21.391300 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:21.437078 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 922/1832] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:21.444504 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3b3a4-2dd5-4fa6-8da3-95ea939ad739 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:21.444504 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3b3a4-2dd5-4fa6-8da3-95ea939ad739 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:21.444504 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3b3a4-2dd5-4fa6-8da3-95ea939ad739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:21.445134 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 910/1832] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:21 2022] PUT /identity/v3/projects/1695944bf2fa470a967b83ef88efe074/users/afbfa29766db4156bcf7832194e23ba1/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:45:21.447221 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523bd06-5a58-40c5-bfbc-1af379582e09 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:21.447506 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523bd06-5a58-40c5-bfbc-1af379582e09 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:21.447820 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523bd06-5a58-40c5-bfbc-1af379582e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:21.506402 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-3523bd06-5a58-40c5-bfbc-1af379582e09 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:21.508057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-3523bd06-5a58-40c5-bfbc-1af379582e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:21.517646 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-25b3b3a4-2dd5-4fa6-8da3-95ea939ad739 None None] MFA Rules not processed for user `afbfa29766db4156bcf7832194e23ba1`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:21.519238 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-25b3b3a4-2dd5-4fa6-8da3-95ea939ad739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:21.655281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 923/1833] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:21.655281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3b3a4-2dd5-4fa6-8da3-95ea939ad739 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:21.661884 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-25b3b3a4-2dd5-4fa6-8da3-95ea939ad739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:21.672825 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 911/1834] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:21.672825 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523bd06-5a58-40c5-bfbc-1af379582e09 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:21.698727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523bd06-5a58-40c5-bfbc-1af379582e09 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:21.708468 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3b3a4-2dd5-4fa6-8da3-95ea939ad739 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:21.717826 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e96448-8cb9-4d14-8147-4fc8afb3a809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:21.718471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e96448-8cb9-4d14-8147-4fc8afb3a809 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:21.718751 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e96448-8cb9-4d14-8147-4fc8afb3a809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:21.719024 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e96448-8cb9-4d14-8147-4fc8afb3a809 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:21.719679 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e96448-8cb9-4d14-8147-4fc8afb3a809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:21.722066 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e96448-8cb9-4d14-8147-4fc8afb3a809 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:21.732255 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c8af6-6b05-4909-a2c3-98f9c78b73ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:21.733182 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c8af6-6b05-4909-a2c3-98f9c78b73ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:21.733588 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c8af6-6b05-4909-a2c3-98f9c78b73ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:21.734655 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c8af6-6b05-4909-a2c3-98f9c78b73ae admin admin] PATH_INFO: `/v3/projects/5b2900a59c3542efb9ab41c3550db964` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:21.735934 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c8af6-6b05-4909-a2c3-98f9c78b73ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b2900a59c3542efb9ab41c3550db964)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:21.738264 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c8af6-6b05-4909-a2c3-98f9c78b73ae admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:21.785535 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 912/1835] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:45:21 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:21.787020 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e96448-8cb9-4d14-8147-4fc8afb3a809 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:21.857498 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-620c8af6-6b05-4909-a2c3-98f9c78b73ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b2900a59c3542efb9ab41c3550db964', 'request_id': 'req-620c8af6-6b05-4909-a2c3-98f9c78b73ae'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:21.867218 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-620c8af6-6b05-4909-a2c3-98f9c78b73ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b2900a59c3542efb9ab41c3550db964', 'request_id': 'req-620c8af6-6b05-4909-a2c3-98f9c78b73ae'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:21.875719 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-620c8af6-6b05-4909-a2c3-98f9c78b73ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b2900a59c3542efb9ab41c3550db964', 'request_id': 'req-620c8af6-6b05-4909-a2c3-98f9c78b73ae'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:21.905774 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-620c8af6-6b05-4909-a2c3-98f9c78b73ae admin admin] The token cache is being invalidate because project 5b2900a59c3542efb9ab41c3550db964 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:45:21.906134 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-620c8af6-6b05-4909-a2c3-98f9c78b73ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:21.906931 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-620c8af6-6b05-4909-a2c3-98f9c78b73ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:21.913457 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 924/1836] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:45:21 2022] DELETE /identity/v3/projects/5b2900a59c3542efb9ab41c3550db964 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:21.913865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e96448-8cb9-4d14-8147-4fc8afb3a809 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:21.914287 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c8af6-6b05-4909-a2c3-98f9c78b73ae admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:21.916081 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-620c8af6-6b05-4909-a2c3-98f9c78b73ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:21.947870 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:22.038906 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c8af6-6b05-4909-a2c3-98f9c78b73ae admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:22.046252 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8781722-4f73-4637-897d-84f81a5aa87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:22.047425 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8781722-4f73-4637-897d-84f81a5aa87b admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:22.047708 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8781722-4f73-4637-897d-84f81a5aa87b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:22.048019 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8781722-4f73-4637-897d-84f81a5aa87b admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:22.048681 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8781722-4f73-4637-897d-84f81a5aa87b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:22.051228 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8781722-4f73-4637-897d-84f81a5aa87b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:22.075305 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8da72-8019-4506-aec2-3639fe4b74bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:22.075897 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8da72-8019-4506-aec2-3639fe4b74bd admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:22.076210 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8da72-8019-4506-aec2-3639fe4b74bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:22.076488 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8da72-8019-4506-aec2-3639fe4b74bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:22.077479 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae8da72-8019-4506-aec2-3639fe4b74bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:45:22.077780 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae8da72-8019-4506-aec2-3639fe4b74bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:22.079714 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae8da72-8019-4506-aec2-3639fe4b74bd admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:22.087694 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 925/1837] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:45:21 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:22.089204 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c882691-92d7-44d4-a162-c34c7fdbd051 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:22.089513 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c882691-92d7-44d4-a162-c34c7fdbd051 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:22.089792 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c882691-92d7-44d4-a162-c34c7fdbd051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:22.094262 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 913/1838] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:45:22.095250 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8da72-8019-4506-aec2-3639fe4b74bd admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:22.106986 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8da72-8019-4506-aec2-3639fe4b74bd admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:22.112323 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f861a8-0755-4ac6-aa37-ef1a00ce5818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:22.113712 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f861a8-0755-4ac6-aa37-ef1a00ce5818 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:22.113981 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f861a8-0755-4ac6-aa37-ef1a00ce5818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:22.114312 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f861a8-0755-4ac6-aa37-ef1a00ce5818 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:22.115143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f861a8-0755-4ac6-aa37-ef1a00ce5818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:22.117758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f861a8-0755-4ac6-aa37-ef1a00ce5818 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:22.119181 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-3c882691-92d7-44d4-a162-c34c7fdbd051 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:22.120493 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3c882691-92d7-44d4-a162-c34c7fdbd051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:22.131398 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 926/1839] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:22.132316 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c882691-92d7-44d4-a162-c34c7fdbd051 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:22.134018 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 914/1840] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:22.134996 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f861a8-0755-4ac6-aa37-ef1a00ce5818 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:22.137022 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3c882691-92d7-44d4-a162-c34c7fdbd051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:22.149518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:22.156389 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f861a8-0755-4ac6-aa37-ef1a00ce5818 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:22.167652 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc4c4e-5d0f-4cc5-ba1e-8696d01fd560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:22.170268 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c882691-92d7-44d4-a162-c34c7fdbd051 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:22.172896 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc4c4e-5d0f-4cc5-ba1e-8696d01fd560 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:22.173187 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc4c4e-5d0f-4cc5-ba1e-8696d01fd560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:22.173616 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc4c4e-5d0f-4cc5-ba1e-8696d01fd560 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:22.174798 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc4c4e-5d0f-4cc5-ba1e-8696d01fd560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:22.176315 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37eb2f-cf68-4c33-acfe-8c98e2ed837b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:22.176733 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37eb2f-cf68-4c33-acfe-8c98e2ed837b admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:22.176852 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37eb2f-cf68-4c33-acfe-8c98e2ed837b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:22.177018 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37eb2f-cf68-4c33-acfe-8c98e2ed837b admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:22.178239 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37eb2f-cf68-4c33-acfe-8c98e2ed837b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:22.178406 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc4c4e-5d0f-4cc5-ba1e-8696d01fd560 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:22.180031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c37eb2f-cf68-4c33-acfe-8c98e2ed837b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:22.204292 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 915/1841] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:22.207131 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630db2ed-ec40-4b1a-ae11-6c46c3876a5f None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:22.207937 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630db2ed-ec40-4b1a-ae11-6c46c3876a5f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:22.208422 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630db2ed-ec40-4b1a-ae11-6c46c3876a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:22.225559 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 927/1842] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:45:22 2022] POST /identity/v3/projects => generated 363 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:22.225559 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37eb2f-cf68-4c33-acfe-8c98e2ed837b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:22.242280 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-630db2ed-ec40-4b1a-ae11-6c46c3876a5f None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:22.243676 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-630db2ed-ec40-4b1a-ae11-6c46c3876a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:22.301232 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37eb2f-cf68-4c33-acfe-8c98e2ed837b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:22.306950 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206bbcde-e171-43d2-b89e-71fae54ea496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:22.307691 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bbcde-e171-43d2-b89e-71fae54ea496 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:22.308162 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bbcde-e171-43d2-b89e-71fae54ea496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:22.308379 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bbcde-e171-43d2-b89e-71fae54ea496 admin admin] PATH_INFO: `/v3/projects/fd185b62dcff4bf6802d83f92908bd1a/users/d88e72bab10842c9b86f527c8623cd53/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:22.325840 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206bbcde-e171-43d2-b89e-71fae54ea496 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd185b62dcff4bf6802d83f92908bd1a, user_id=d88e72bab10842c9b86f527c8623cd53, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:22.328919 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206bbcde-e171-43d2-b89e-71fae54ea496 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:22.346610 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 928/1843] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:22 2022] PUT /identity/v3/projects/fd185b62dcff4bf6802d83f92908bd1a/users/d88e72bab10842c9b86f527c8623cd53/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:22.347630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206bbcde-e171-43d2-b89e-71fae54ea496 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:22.349728 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 916/1844] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:22.353637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630db2ed-ec40-4b1a-ae11-6c46c3876a5f None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:22.366140 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630db2ed-ec40-4b1a-ae11-6c46c3876a5f None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:22.453546 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9acd9e5-3366-408d-a810-3af2cc5cedc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:22.454187 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acd9e5-3366-408d-a810-3af2cc5cedc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:22.454411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206bbcde-e171-43d2-b89e-71fae54ea496 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:22.454517 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acd9e5-3366-408d-a810-3af2cc5cedc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:22.454722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acd9e5-3366-408d-a810-3af2cc5cedc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:22.455377 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9acd9e5-3366-408d-a810-3af2cc5cedc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:45:22.455678 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9acd9e5-3366-408d-a810-3af2cc5cedc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:22.457336 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9acd9e5-3366-408d-a810-3af2cc5cedc6 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:22.459545 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bf3cc-0551-431f-aa9f-0a00dc5539ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:22.460219 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bf3cc-0551-431f-aa9f-0a00dc5539ea admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:22.460498 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bf3cc-0551-431f-aa9f-0a00dc5539ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:22.460799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525bf3cc-0551-431f-aa9f-0a00dc5539ea admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:22.461444 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525bf3cc-0551-431f-aa9f-0a00dc5539ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:22.463491 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525bf3cc-0551-431f-aa9f-0a00dc5539ea admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:22.476014 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 917/1845] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:45:22.476014 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681d5d8-5931-4bff-90fd-07a9516eb714 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:22.476014 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681d5d8-5931-4bff-90fd-07a9516eb714 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:22.476014 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681d5d8-5931-4bff-90fd-07a9516eb714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:22.476642 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:22.493794 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 929/1846] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:45:22 2022] POST /identity/v3/users => generated 282 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:22.494492 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bf3cc-0551-431f-aa9f-0a00dc5539ea admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:22.508547 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525bf3cc-0551-431f-aa9f-0a00dc5539ea admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:22.513869 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa4a57-588b-4a31-9155-952e82a1628e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:22.514650 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa4a57-588b-4a31-9155-952e82a1628e admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:22.514923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa4a57-588b-4a31-9155-952e82a1628e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:22.515394 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa4a57-588b-4a31-9155-952e82a1628e admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:22.516066 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa4a57-588b-4a31-9155-952e82a1628e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:22.518439 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa4a57-588b-4a31-9155-952e82a1628e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:22.530692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-b681d5d8-5931-4bff-90fd-07a9516eb714 None None] MFA Rules not processed for user `d88e72bab10842c9b86f527c8623cd53`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:22.532744 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b681d5d8-5931-4bff-90fd-07a9516eb714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:22.567846 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 930/1847] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:45:22 2022] POST /identity/v3/projects => generated 367 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:22.567846 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa4a57-588b-4a31-9155-952e82a1628e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:22.654451 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 918/1848] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:22.655515 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681d5d8-5931-4bff-90fd-07a9516eb714 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:22.668441 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa4a57-588b-4a31-9155-952e82a1628e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:22.671535 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681d5d8-5931-4bff-90fd-07a9516eb714 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:22.682266 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc7c95-7f12-463f-b2a5-86782115a949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:22.683413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc7c95-7f12-463f-b2a5-86782115a949 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:22.689181 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f27225-a13b-4a31-870b-908b259a6fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:22.689825 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f27225-a13b-4a31-870b-908b259a6fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:22.690102 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f27225-a13b-4a31-870b-908b259a6fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:22.690374 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f27225-a13b-4a31-870b-908b259a6fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:22.691047 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f27225-a13b-4a31-870b-908b259a6fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:22.692198 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc7c95-7f12-463f-b2a5-86782115a949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:22.692892 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc7c95-7f12-463f-b2a5-86782115a949 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:22.694061 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc7c95-7f12-463f-b2a5-86782115a949 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:22.699755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f27225-a13b-4a31-870b-908b259a6fc0 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:22.714281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 931/1849] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:22.715958 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f27225-a13b-4a31-870b-908b259a6fc0 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:22.720094 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc7c95-7f12-463f-b2a5-86782115a949 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:22.732132 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f27225-a13b-4a31-870b-908b259a6fc0 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:22.739177 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa4327-6a7b-4c2e-b696-5f4db66d41e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:22.740049 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa4327-6a7b-4c2e-b696-5f4db66d41e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:22.740692 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa4327-6a7b-4c2e-b696-5f4db66d41e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:22.740999 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa4327-6a7b-4c2e-b696-5f4db66d41e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:22.741558 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:22.741681 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa4327-6a7b-4c2e-b696-5f4db66d41e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:22.743607 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa4327-6a7b-4c2e-b696-5f4db66d41e2 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:22.747988 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 919/1850] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:45:22 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:22.749033 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc7c95-7f12-463f-b2a5-86782115a949 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:22.760529 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc7c95-7f12-463f-b2a5-86782115a949 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:22.766046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe69ed9-602c-4f59-804f-2fa6023673b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:22.766664 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe69ed9-602c-4f59-804f-2fa6023673b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:22.767066 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe69ed9-602c-4f59-804f-2fa6023673b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:22.767194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe69ed9-602c-4f59-804f-2fa6023673b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:22.767886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe69ed9-602c-4f59-804f-2fa6023673b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:22.769768 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe69ed9-602c-4f59-804f-2fa6023673b3 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:22.785147 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 920/1851] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:22.785147 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe69ed9-602c-4f59-804f-2fa6023673b3 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:22.787477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 932/1852] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:45:22 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:22.788472 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa4327-6a7b-4c2e-b696-5f4db66d41e2 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:22.795434 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe69ed9-602c-4f59-804f-2fa6023673b3 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:22.867754 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f7d71-ab54-4bdb-af39-0532d6b89930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:22.867754 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f7d71-ab54-4bdb-af39-0532d6b89930 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:22.868295 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f7d71-ab54-4bdb-af39-0532d6b89930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:22.868295 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7f7d71-ab54-4bdb-af39-0532d6b89930 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:22.868870 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f7d71-ab54-4bdb-af39-0532d6b89930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:22.870483 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7f7d71-ab54-4bdb-af39-0532d6b89930 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:22.877785 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa4327-6a7b-4c2e-b696-5f4db66d41e2 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:22.882750 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e082c-d630-4c25-9370-03efdc5003c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:22.883423 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e082c-d630-4c25-9370-03efdc5003c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:22.883697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e082c-d630-4c25-9370-03efdc5003c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:22.884016 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e082c-d630-4c25-9370-03efdc5003c1 admin admin] PATH_INFO: `/v3/projects/b072b78ed8be4eddab957d80ca557e9a/users/bd0a14c21be440719bb3fdeec4170693/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:22.887008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 921/1853] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:22.887857 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f7d71-ab54-4bdb-af39-0532d6b89930 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:22.898334 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7f7d71-ab54-4bdb-af39-0532d6b89930 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:22.903405 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e6e96-4850-4307-9bff-431d1fbb5638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:22.904070 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e6e96-4850-4307-9bff-431d1fbb5638 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:22.904415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e6e96-4850-4307-9bff-431d1fbb5638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:22.904667 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e6e96-4850-4307-9bff-431d1fbb5638 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:22.905316 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e6e96-4850-4307-9bff-431d1fbb5638 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:22.905524 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e082c-d630-4c25-9370-03efdc5003c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b072b78ed8be4eddab957d80ca557e9a, user_id=bd0a14c21be440719bb3fdeec4170693, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:22.907259 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e6e96-4850-4307-9bff-431d1fbb5638 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:22.908487 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006e082c-d630-4c25-9370-03efdc5003c1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:22.933010 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 933/1854] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:22 2022] PUT /identity/v3/projects/b072b78ed8be4eddab957d80ca557e9a/users/bd0a14c21be440719bb3fdeec4170693/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:22.937917 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e082c-d630-4c25-9370-03efdc5003c1 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:22.950957 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 922/1855] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:45:22 2022] POST /identity/v3/users => generated 299 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:22.955471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc6a59-1525-44c2-85cf-c5c3967a48cf None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:22.957476 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc6a59-1525-44c2-85cf-c5c3967a48cf None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:22.957954 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc6a59-1525-44c2-85cf-c5c3967a48cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:22.985219 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:22.992835 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-67bc6a59-1525-44c2-85cf-c5c3967a48cf None None] MFA Rules not processed for user `bd0a14c21be440719bb3fdeec4170693`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:22.994385 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-67bc6a59-1525-44c2-85cf-c5c3967a48cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:23.030486 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006e082c-d630-4c25-9370-03efdc5003c1 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:23.036384 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0821be4-4ea5-4880-93de-4d93c172a13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:23.036921 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0821be4-4ea5-4880-93de-4d93c172a13c admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:23.037672 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0821be4-4ea5-4880-93de-4d93c172a13c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:23.037961 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0821be4-4ea5-4880-93de-4d93c172a13c admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:23.038607 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0821be4-4ea5-4880-93de-4d93c172a13c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:23.040692 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0821be4-4ea5-4880-93de-4d93c172a13c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:23.058120 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 934/1856] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:22 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:23.059636 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0821be4-4ea5-4880-93de-4d93c172a13c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:23.075714 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 923/1857] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:23.077143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc6a59-1525-44c2-85cf-c5c3967a48cf None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:23.079617 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0821be4-4ea5-4880-93de-4d93c172a13c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:23.085545 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27095d-5d5d-4c41-aacf-c53998386197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:23.086167 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27095d-5d5d-4c41-aacf-c53998386197 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:23.086439 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27095d-5d5d-4c41-aacf-c53998386197 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:23.086704 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27095d-5d5d-4c41-aacf-c53998386197 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:23.087344 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27095d-5d5d-4c41-aacf-c53998386197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:23.089011 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27095d-5d5d-4c41-aacf-c53998386197 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:23.089285 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc6a59-1525-44c2-85cf-c5c3967a48cf None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:23.099690 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 935/1858] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:23.100591 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27095d-5d5d-4c41-aacf-c53998386197 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:23.106609 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc2f35-27f9-43c3-8f2b-550b50a55acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:23.108058 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc2f35-27f9-43c3-8f2b-550b50a55acb admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:23.108359 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc2f35-27f9-43c3-8f2b-550b50a55acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:23.108640 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc2f35-27f9-43c3-8f2b-550b50a55acb admin admin] PATH_INFO: `/v3/projects/31a770cfa8854517a659b3c0bccd0a54/users/07973949061b411694e729e89c58c2f9/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:23.111217 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27095d-5d5d-4c41-aacf-c53998386197 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:23.116433 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8e614-c4a9-4183-9344-33a3b72f0631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:23.117049 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8e614-c4a9-4183-9344-33a3b72f0631 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:23.117377 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8e614-c4a9-4183-9344-33a3b72f0631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:23.117641 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8e614-c4a9-4183-9344-33a3b72f0631 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:23.118280 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8e614-c4a9-4183-9344-33a3b72f0631 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:23.120251 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe8e614-c4a9-4183-9344-33a3b72f0631 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:23.125043 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc2f35-27f9-43c3-8f2b-550b50a55acb admin admin] RBAC: Authorizing `identity:create_grant(project_id=31a770cfa8854517a659b3c0bccd0a54, user_id=07973949061b411694e729e89c58c2f9, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:23.127727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc2f35-27f9-43c3-8f2b-550b50a55acb admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:23.155478 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 924/1859] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:23 2022] PUT /identity/v3/projects/31a770cfa8854517a659b3c0bccd0a54/users/07973949061b411694e729e89c58c2f9/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:23.155478 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc2f35-27f9-43c3-8f2b-550b50a55acb admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:23.157116 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 936/1860] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:45:23 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:23.158346 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07110e1-9bcb-4a0e-9aad-fbfdaab8e606 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:23.158617 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07110e1-9bcb-4a0e-9aad-fbfdaab8e606 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:23.158888 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07110e1-9bcb-4a0e-9aad-fbfdaab8e606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:23.194991 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c07110e1-9bcb-4a0e-9aad-fbfdaab8e606 None None] MFA Rules not processed for user `07973949061b411694e729e89c58c2f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:23.196267 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c07110e1-9bcb-4a0e-9aad-fbfdaab8e606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:23.199830 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:23.230654 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc2f35-27f9-43c3-8f2b-550b50a55acb admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:23.270813 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 937/1861] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:23.271641 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07110e1-9bcb-4a0e-9aad-fbfdaab8e606 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:23.300608 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf6d77-1a8b-41e8-b87a-2a1cae1bf7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:23.301755 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf6d77-1a8b-41e8-b87a-2a1cae1bf7fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:23.302284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf6d77-1a8b-41e8-b87a-2a1cae1bf7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:23.302772 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf6d77-1a8b-41e8-b87a-2a1cae1bf7fc admin admin] PATH_INFO: `/v3/projects/0b68ad1efef44e07848418b97cc031de/users/dc0b5e5f44334e5dae49dbf92cef2403/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:23.327619 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf6d77-1a8b-41e8-b87a-2a1cae1bf7fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b68ad1efef44e07848418b97cc031de, user_id=dc0b5e5f44334e5dae49dbf92cef2403, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:23.329888 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf6d77-1a8b-41e8-b87a-2a1cae1bf7fc admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:23.360918 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 925/1862] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:23 2022] PUT /identity/v3/projects/0b68ad1efef44e07848418b97cc031de/users/dc0b5e5f44334e5dae49dbf92cef2403/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:23.367412 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf6d77-1a8b-41e8-b87a-2a1cae1bf7fc admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:23.368322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07110e1-9bcb-4a0e-9aad-fbfdaab8e606 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:23.397295 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:23.451756 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2c914-fdb4-49a1-ae7e-1f41162e23fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:23.452468 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2c914-fdb4-49a1-ae7e-1f41162e23fe admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:23.452819 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2c914-fdb4-49a1-ae7e-1f41162e23fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:23.453577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2c914-fdb4-49a1-ae7e-1f41162e23fe admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:23.453914 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2c914-fdb4-49a1-ae7e-1f41162e23fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:23.456255 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2c914-fdb4-49a1-ae7e-1f41162e23fe admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:23.485986 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 938/1863] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:45:23 2022] POST /identity/v3/users => generated 289 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:23.487107 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2c914-fdb4-49a1-ae7e-1f41162e23fe admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:23.511035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2c914-fdb4-49a1-ae7e-1f41162e23fe admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:23.511210 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf6d77-1a8b-41e8-b87a-2a1cae1bf7fc admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:23.517084 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b8ff6-f0c4-403c-9572-200aee554d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:23.517703 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b8ff6-f0c4-403c-9572-200aee554d4a admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:23.517978 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b8ff6-f0c4-403c-9572-200aee554d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:23.518245 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b8ff6-f0c4-403c-9572-200aee554d4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:23.519001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b8ff6-f0c4-403c-9572-200aee554d4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:23.520716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b8ff6-f0c4-403c-9572-200aee554d4a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:23.523007 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161ed42-e808-4b61-bd7d-9331a991745a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:23.523968 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161ed42-e808-4b61-bd7d-9331a991745a admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:23.524445 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161ed42-e808-4b61-bd7d-9331a991745a admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:23.524903 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161ed42-e808-4b61-bd7d-9331a991745a admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:23.525757 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161ed42-e808-4b61-bd7d-9331a991745a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:23.528706 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161ed42-e808-4b61-bd7d-9331a991745a admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:23.535140 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 939/1864] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:23.535140 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b8ff6-f0c4-403c-9572-200aee554d4a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:23.543842 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b8ff6-f0c4-403c-9572-200aee554d4a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:23.551195 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af57f1-4e28-4ed2-8b94-680f70730e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:23.551855 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af57f1-4e28-4ed2-8b94-680f70730e19 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:23.552135 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af57f1-4e28-4ed2-8b94-680f70730e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:23.552405 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af57f1-4e28-4ed2-8b94-680f70730e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:23.553362 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af57f1-4e28-4ed2-8b94-680f70730e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:23.554685 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af57f1-4e28-4ed2-8b94-680f70730e19 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:23.566663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 940/1865] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:23.567520 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af57f1-4e28-4ed2-8b94-680f70730e19 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:23.580532 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 926/1866] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:45:23 2022] POST /identity/v3/projects => generated 369 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:23.580532 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161ed42-e808-4b61-bd7d-9331a991745a admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:23.594621 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af57f1-4e28-4ed2-8b94-680f70730e19 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:23.657480 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:23.684257 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161ed42-e808-4b61-bd7d-9331a991745a admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:23.690784 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8bd941-2105-4c01-ba9e-8be86b6eda68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:23.691494 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bd941-2105-4c01-ba9e-8be86b6eda68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:23.691785 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bd941-2105-4c01-ba9e-8be86b6eda68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:23.692059 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8bd941-2105-4c01-ba9e-8be86b6eda68 admin admin] PATH_INFO: `/v3/projects/55ce757b56c54c9fb706e455ab6844ed/users/159569b5237b4668bc0c593d5d67c10b/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:23.704620 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25659383-3468-4806-8f74-bb658fa24c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:23.705415 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25659383-3468-4806-8f74-bb658fa24c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:23.705725 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25659383-3468-4806-8f74-bb658fa24c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:23.705996 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25659383-3468-4806-8f74-bb658fa24c41 admin admin] PATH_INFO: `/v3/projects/0b68ad1efef44e07848418b97cc031de/users/dc0b5e5f44334e5dae49dbf92cef2403/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:23.708514 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25659383-3468-4806-8f74-bb658fa24c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b68ad1efef44e07848418b97cc031de, user_id=dc0b5e5f44334e5dae49dbf92cef2403, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:23.711903 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25659383-3468-4806-8f74-bb658fa24c41 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:23.717188 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8bd941-2105-4c01-ba9e-8be86b6eda68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55ce757b56c54c9fb706e455ab6844ed, user_id=159569b5237b4668bc0c593d5d67c10b, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:23.721171 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8bd941-2105-4c01-ba9e-8be86b6eda68 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:23.727326 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 941/1867] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:23 2022] PUT /identity/v3/projects/0b68ad1efef44e07848418b97cc031de/users/dc0b5e5f44334e5dae49dbf92cef2403/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:23.728241 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25659383-3468-4806-8f74-bb658fa24c41 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:23.752582 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 927/1868] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:23 2022] PUT /identity/v3/projects/55ce757b56c54c9fb706e455ab6844ed/users/159569b5237b4668bc0c593d5d67c10b/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:23.754509 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e430e7d-6f22-44ad-8119-05a1032a5682 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:23.754891 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e430e7d-6f22-44ad-8119-05a1032a5682 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:23.755345 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e430e7d-6f22-44ad-8119-05a1032a5682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:23.800912 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-9e430e7d-6f22-44ad-8119-05a1032a5682 None None] MFA Rules not processed for user `dc0b5e5f44334e5dae49dbf92cef2403`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:23.802154 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-9e430e7d-6f22-44ad-8119-05a1032a5682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:23.849668 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25659383-3468-4806-8f74-bb658fa24c41 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:23.904378 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:23.929563 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 928/1869] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:23 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:23.930509 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e430e7d-6f22-44ad-8119-05a1032a5682 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:23.976682 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8845ef0-3977-4036-a321-0c0a8b544c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:23.978024 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8845ef0-3977-4036-a321-0c0a8b544c1f admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:23.978502 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8845ef0-3977-4036-a321-0c0a8b544c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:23.979011 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8845ef0-3977-4036-a321-0c0a8b544c1f admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:23.980224 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8845ef0-3977-4036-a321-0c0a8b544c1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:23.984589 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8845ef0-3977-4036-a321-0c0a8b544c1f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:24.017007 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 942/1870] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:45:23 2022] POST /identity/v3/users => generated 291 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:24.018553 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8845ef0-3977-4036-a321-0c0a8b544c1f admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:24.021236 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a8845ef0-3977-4036-a321-0c0a8b544c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:24.021397 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e430e7d-6f22-44ad-8119-05a1032a5682 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:24.027235 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373201f-c06d-4368-a168-969f8dd2ab8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:24.028091 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373201f-c06d-4368-a168-969f8dd2ab8d admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:24.028267 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373201f-c06d-4368-a168-969f8dd2ab8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:24.028653 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373201f-c06d-4368-a168-969f8dd2ab8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:24.029548 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2373201f-c06d-4368-a168-969f8dd2ab8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:24.031262 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2373201f-c06d-4368-a168-969f8dd2ab8d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:24.042246 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 929/1871] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:24.043239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373201f-c06d-4368-a168-969f8dd2ab8d admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:24.055588 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373201f-c06d-4368-a168-969f8dd2ab8d admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:24.073034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598b40a-6570-4e76-abc1-eb32b56cd83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:24.073858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598b40a-6570-4e76-abc1-eb32b56cd83b admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:24.074148 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598b40a-6570-4e76-abc1-eb32b56cd83b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:24.074423 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598b40a-6570-4e76-abc1-eb32b56cd83b admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:24.075128 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598b40a-6570-4e76-abc1-eb32b56cd83b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:24.076998 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598b40a-6570-4e76-abc1-eb32b56cd83b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:24.097333 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 930/1872] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:24.098184 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598b40a-6570-4e76-abc1-eb32b56cd83b admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:24.106246 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8845ef0-3977-4036-a321-0c0a8b544c1f admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:24.113187 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3d16d-e039-4fc0-9de9-290893e676ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:24.113869 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598b40a-6570-4e76-abc1-eb32b56cd83b admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:24.114449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3d16d-e039-4fc0-9de9-290893e676ad service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:24.114855 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3d16d-e039-4fc0-9de9-290893e676ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:24.115301 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3d16d-e039-4fc0-9de9-290893e676ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:24.118367 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-48e3d16d-e039-4fc0-9de9-290893e676ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:24.121043 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4405e-ad59-4794-af11-fecad2ffeb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:24.122232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4405e-ad59-4794-af11-fecad2ffeb7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:24.122760 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4405e-ad59-4794-af11-fecad2ffeb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:24.123273 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c4405e-ad59-4794-af11-fecad2ffeb7e admin admin] PATH_INFO: `/v3/projects/55ce757b56c54c9fb706e455ab6844ed/users/159569b5237b4668bc0c593d5d67c10b/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:24.126809 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4405e-ad59-4794-af11-fecad2ffeb7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=55ce757b56c54c9fb706e455ab6844ed, user_id=159569b5237b4668bc0c593d5d67c10b, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:24.132440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c4405e-ad59-4794-af11-fecad2ffeb7e admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:24.146856 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 931/1873] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:24 2022] PUT /identity/v3/projects/55ce757b56c54c9fb706e455ab6844ed/users/159569b5237b4668bc0c593d5d67c10b/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:24.147987 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4405e-ad59-4794-af11-fecad2ffeb7e admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:24.200798 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:24.230719 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3d16d-e039-4fc0-9de9-290893e676ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:24.233459 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3d16d-e039-4fc0-9de9-290893e676ad service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:24.248550 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 943/1874] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:45:24.250243 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4206a5d-906d-4ea7-b582-c16cca38b66d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:24.250525 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4206a5d-906d-4ea7-b582-c16cca38b66d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:24.250794 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4206a5d-906d-4ea7-b582-c16cca38b66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:24.256167 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c4405e-ad59-4794-af11-fecad2ffeb7e admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:24.261282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369825c-6d05-4b54-aee3-9123ce6e8416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:24.261971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369825c-6d05-4b54-aee3-9123ce6e8416 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:24.262243 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369825c-6d05-4b54-aee3-9123ce6e8416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:24.262511 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c369825c-6d05-4b54-aee3-9123ce6e8416 admin admin] PATH_INFO: `/v3/projects/6767743ea04342339882401aa0b476a6/users/790b3fe26c3f4b48a034db0b563ead9c/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:24.281854 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369825c-6d05-4b54-aee3-9123ce6e8416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6767743ea04342339882401aa0b476a6, user_id=790b3fe26c3f4b48a034db0b563ead9c, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:24.295007 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c369825c-6d05-4b54-aee3-9123ce6e8416 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:24.297193 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-e4206a5d-906d-4ea7-b582-c16cca38b66d None None] MFA Rules not processed for user `159569b5237b4668bc0c593d5d67c10b`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:24.298608 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e4206a5d-906d-4ea7-b582-c16cca38b66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:24.324128 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 932/1875] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:24 2022] PUT /identity/v3/projects/6767743ea04342339882401aa0b476a6/users/790b3fe26c3f4b48a034db0b563ead9c/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:24.324128 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369825c-6d05-4b54-aee3-9123ce6e8416 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:24.400879 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 944/1876] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:24.411892 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4206a5d-906d-4ea7-b582-c16cca38b66d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:24.413943 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e4206a5d-906d-4ea7-b582-c16cca38b66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:24.416666 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c369825c-6d05-4b54-aee3-9123ce6e8416 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:24.420659 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:24.425014 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7737c9d-fba6-4d59-ac28-32df7715b22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:24.425781 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7737c9d-fba6-4d59-ac28-32df7715b22d admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:24.426124 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7737c9d-fba6-4d59-ac28-32df7715b22d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:24.426457 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7737c9d-fba6-4d59-ac28-32df7715b22d admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:24.427259 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7737c9d-fba6-4d59-ac28-32df7715b22d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:24.429190 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7737c9d-fba6-4d59-ac28-32df7715b22d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:24.448321 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 933/1877] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:45:24.455788 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7737c9d-fba6-4d59-ac28-32df7715b22d admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:24.473578 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7737c9d-fba6-4d59-ac28-32df7715b22d admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:24.484092 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de973e-8dd6-4cba-a29f-2c859176e68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:24.485350 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de973e-8dd6-4cba-a29f-2c859176e68c admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:24.485816 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de973e-8dd6-4cba-a29f-2c859176e68c admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:24.486265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de973e-8dd6-4cba-a29f-2c859176e68c admin admin] PATH_INFO: `/v3/projects/6767743ea04342339882401aa0b476a6/users/790b3fe26c3f4b48a034db0b563ead9c/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:24.489717 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de973e-8dd6-4cba-a29f-2c859176e68c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6767743ea04342339882401aa0b476a6, user_id=790b3fe26c3f4b48a034db0b563ead9c, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:24.495125 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de973e-8dd6-4cba-a29f-2c859176e68c admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:24.526171 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 934/1878] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:24 2022] PUT /identity/v3/projects/6767743ea04342339882401aa0b476a6/users/790b3fe26c3f4b48a034db0b563ead9c/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:24.528813 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4206a5d-906d-4ea7-b582-c16cca38b66d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:24.529319 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad29c1f-6e0b-4538-911f-067badf08627 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:24.529647 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad29c1f-6e0b-4538-911f-067badf08627 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:24.529826 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad29c1f-6e0b-4538-911f-067badf08627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:24.569670 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-aad29c1f-6e0b-4538-911f-067badf08627 None None] MFA Rules not processed for user `790b3fe26c3f4b48a034db0b563ead9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:24.572379 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-aad29c1f-6e0b-4538-911f-067badf08627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:24.612523 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dec534-4a3f-4de7-be6e-33ab9b2f8498 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:24.613710 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dec534-4a3f-4de7-be6e-33ab9b2f8498 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:24.613710 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dec534-4a3f-4de7-be6e-33ab9b2f8498 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:24.613932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dec534-4a3f-4de7-be6e-33ab9b2f8498 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:24.677044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 935/1879] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:24 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:45:24.695630 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad29c1f-6e0b-4538-911f-067badf08627 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:24.716246 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad29c1f-6e0b-4538-911f-067badf08627 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:24.726367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80449028-3919-4d25-b70b-feac190a1554 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:24.726959 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80449028-3919-4d25-b70b-feac190a1554 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:24.727230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80449028-3919-4d25-b70b-feac190a1554 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:24.727506 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80449028-3919-4d25-b70b-feac190a1554 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:24.739330 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dec534-4a3f-4de7-be6e-33ab9b2f8498 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:24.741270 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dec534-4a3f-4de7-be6e-33ab9b2f8498 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:24.749168 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80449028-3919-4d25-b70b-feac190a1554 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:24.752552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80449028-3919-4d25-b70b-feac190a1554 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:24.753230 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 945/1880] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:24 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:45:24.782333 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 936/1881] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:24 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:45:24.923475 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dec534-4a3f-4de7-be6e-33ab9b2f8498 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:24.934410 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dec534-4a3f-4de7-be6e-33ab9b2f8498 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:24.939628 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf29e4-bff4-41f5-b822-8097fad89f3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:24.940511 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf29e4-bff4-41f5-b822-8097fad89f3f service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:24.941052 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf29e4-bff4-41f5-b822-8097fad89f3f service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:24.941278 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf29e4-bff4-41f5-b822-8097fad89f3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:25.018837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf29e4-bff4-41f5-b822-8097fad89f3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:25.020442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf29e4-bff4-41f5-b822-8097fad89f3f service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:25.032942 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 946/1882] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:45:26.521402 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80449028-3919-4d25-b70b-feac190a1554 service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:26.541398 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80449028-3919-4d25-b70b-feac190a1554 service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:26.548849 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd394e0-433e-4e04-87c7-765c0c6af688 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:26.550561 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd394e0-433e-4e04-87c7-765c0c6af688 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:26.551050 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd394e0-433e-4e04-87c7-765c0c6af688 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:26.551571 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd394e0-433e-4e04-87c7-765c0c6af688 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:26.557860 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:26.643181 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd394e0-433e-4e04-87c7-765c0c6af688 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:26.644720 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd394e0-433e-4e04-87c7-765c0c6af688 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:26.655517 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 937/1883] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:45:27.947939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf29e4-bff4-41f5-b822-8097fad89f3f service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:27.963100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf29e4-bff4-41f5-b822-8097fad89f3f service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:27.970228 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30205a10-4548-4823-b3e9-7d09c00ff088 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:27.971156 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30205a10-4548-4823-b3e9-7d09c00ff088 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:27.971645 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30205a10-4548-4823-b3e9-7d09c00ff088 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:27.972160 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30205a10-4548-4823-b3e9-7d09c00ff088 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:27.979932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:28.120370 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30205a10-4548-4823-b3e9-7d09c00ff088 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:28.121899 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30205a10-4548-4823-b3e9-7d09c00ff088 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:28.140201 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 947/1884] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:45:29.068248 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff366ebf-362e-4e0a-98fe-f7435baa2c2a None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:29.068804 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff366ebf-362e-4e0a-98fe-f7435baa2c2a None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:29.068804 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff366ebf-362e-4e0a-98fe-f7435baa2c2a None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:29.070787 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 938/1885] 10.222.0.66 () {54 vars in 921 bytes} [Mon Sep 26 05:45:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:45:29.106342 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df272981-5360-4621-8723-2f92692c2eb7 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:29.108303 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df272981-5360-4621-8723-2f92692c2eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:29.109047 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df272981-5360-4621-8723-2f92692c2eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:29.241660 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-df272981-5360-4621-8723-2f92692c2eb7 None None] MFA Rules not processed for user `c559a36836be411b9afd076f4c9a0655`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:29.251291 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-df272981-5360-4621-8723-2f92692c2eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:29.443865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff366ebf-362e-4e0a-98fe-f7435baa2c2a None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:29.462594 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 948/1886] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Sep 26 05:45:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:29.597967 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff366ebf-362e-4e0a-98fe-f7435baa2c2a None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:29.605389 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb38ab5-42e9-4ed0-892c-cf7b97fcbb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:29.606315 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb38ab5-42e9-4ed0-892c-cf7b97fcbb85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:29.606874 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb38ab5-42e9-4ed0-892c-cf7b97fcbb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:29.607618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb38ab5-42e9-4ed0-892c-cf7b97fcbb85 admin admin] PATH_INFO: `/v3/users/bd0a14c21be440719bb3fdeec4170693` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:29.610959 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb38ab5-42e9-4ed0-892c-cf7b97fcbb85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd0a14c21be440719bb3fdeec4170693)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:29.614416 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb38ab5-42e9-4ed0-892c-cf7b97fcbb85 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:29.680148 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df272981-5360-4621-8723-2f92692c2eb7 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:29.695207 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df272981-5360-4621-8723-2f92692c2eb7 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:29.703250 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52fd94-23b6-4fc9-b002-bb54eaafb8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:29.704138 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52fd94-23b6-4fc9-b002-bb54eaafb8ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:29.704426 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52fd94-23b6-4fc9-b002-bb54eaafb8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:29.704746 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52fd94-23b6-4fc9-b002-bb54eaafb8ab admin admin] PATH_INFO: `/v3/users/07973949061b411694e729e89c58c2f9` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:29.713925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52fd94-23b6-4fc9-b002-bb54eaafb8ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=07973949061b411694e729e89c58c2f9)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:29.713925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52fd94-23b6-4fc9-b002-bb54eaafb8ab admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:29.775847 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3eb38ab5-42e9-4ed0-892c-cf7b97fcbb85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd0a14c21be440719bb3fdeec4170693'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:29.818721 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3eb38ab5-42e9-4ed0-892c-cf7b97fcbb85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd0a14c21be440719bb3fdeec4170693'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:29.845524 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3eb38ab5-42e9-4ed0-892c-cf7b97fcbb85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd0a14c21be440719bb3fdeec4170693'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:29.846692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3eb38ab5-42e9-4ed0-892c-cf7b97fcbb85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd0a14c21be440719bb3fdeec4170693'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:29.858599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3eb38ab5-42e9-4ed0-892c-cf7b97fcbb85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd0a14c21be440719bb3fdeec4170693'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:29.868992 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 939/1887] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:45:29 2022] DELETE /identity/v3/users/bd0a14c21be440719bb3fdeec4170693 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:29.871044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb38ab5-42e9-4ed0-892c-cf7b97fcbb85 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:29.873673 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-3eb38ab5-42e9-4ed0-892c-cf7b97fcbb85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:29.882291 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0c52fd94-23b6-4fc9-b002-bb54eaafb8ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07973949061b411694e729e89c58c2f9'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:29.902482 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0c52fd94-23b6-4fc9-b002-bb54eaafb8ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07973949061b411694e729e89c58c2f9'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:29.904921 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0c52fd94-23b6-4fc9-b002-bb54eaafb8ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07973949061b411694e729e89c58c2f9'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:29.918402 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:29.933884 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0c52fd94-23b6-4fc9-b002-bb54eaafb8ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07973949061b411694e729e89c58c2f9'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:29.944905 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0c52fd94-23b6-4fc9-b002-bb54eaafb8ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07973949061b411694e729e89c58c2f9'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:29.955932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 949/1888] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:45:29 2022] DELETE /identity/v3/users/07973949061b411694e729e89c58c2f9 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:45:29.957848 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf8175-bf3d-4ba7-9c3a-b78963f4a4f4 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:29.958394 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf8175-bf3d-4ba7-9c3a-b78963f4a4f4 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:29.958825 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf8175-bf3d-4ba7-9c3a-b78963f4a4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:29.972506 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:30.010866 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-a6cf8175-bf3d-4ba7-9c3a-b78963f4a4f4 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:30.016399 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a6cf8175-bf3d-4ba7-9c3a-b78963f4a4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:30.033955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb38ab5-42e9-4ed0-892c-cf7b97fcbb85 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:30.201249 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401b48c-be9b-4d89-9766-895477eff3e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:30.202442 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401b48c-be9b-4d89-9766-895477eff3e2 service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:30.203142 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401b48c-be9b-4d89-9766-895477eff3e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:30.204834 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401b48c-be9b-4d89-9766-895477eff3e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:30.212718 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-3401b48c-be9b-4d89-9766-895477eff3e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:30.220351 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 950/1889] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:30.226374 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3b9f1-72e7-4774-b3f0-9396ff411352 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:30.227206 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3b9f1-72e7-4774-b3f0-9396ff411352 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:30.228063 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3b9f1-72e7-4774-b3f0-9396ff411352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:30.271102 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-50e3b9f1-72e7-4774-b3f0-9396ff411352 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:30.271290 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401b48c-be9b-4d89-9766-895477eff3e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:30.273778 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-50e3b9f1-72e7-4774-b3f0-9396ff411352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:30.279984 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3401b48c-be9b-4d89-9766-895477eff3e2 service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:30.298267 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 951/1890] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:30.299318 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3b9f1-72e7-4774-b3f0-9396ff411352 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:30.303377 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-50e3b9f1-72e7-4774-b3f0-9396ff411352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:30.320782 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 940/1891] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:45:30.323826 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401b48c-be9b-4d89-9766-895477eff3e2 service nova] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:30.338817 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-3401b48c-be9b-4d89-9766-895477eff3e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:30.472920 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3b9f1-72e7-4774-b3f0-9396ff411352 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:30.477444 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401b48c-be9b-4d89-9766-895477eff3e2 service nova] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:30.477900 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00b400-7b74-4588-ba8a-c316fd7ae85a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:30.478815 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00b400-7b74-4588-ba8a-c316fd7ae85a service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:30.479093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00b400-7b74-4588-ba8a-c316fd7ae85a service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:30.479359 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d00b400-7b74-4588-ba8a-c316fd7ae85a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:30.487214 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d7370-7811-4ac4-b376-c03e2f755d19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:30.489414 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d7370-7811-4ac4-b376-c03e2f755d19 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:30.489697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d7370-7811-4ac4-b376-c03e2f755d19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:30.489970 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d7370-7811-4ac4-b376-c03e2f755d19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:30.507967 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d7370-7811-4ac4-b376-c03e2f755d19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:30.508130 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d00b400-7b74-4588-ba8a-c316fd7ae85a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:30.509659 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d00b400-7b74-4588-ba8a-c316fd7ae85a service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:30.509923 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d7370-7811-4ac4-b376-c03e2f755d19 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:30.525042 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 941/1892] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:45:30.530654 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 952/1893] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:45:31.279091 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d7370-7811-4ac4-b376-c03e2f755d19 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:31.281545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-639d7370-7811-4ac4-b376-c03e2f755d19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:31.305209 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d7370-7811-4ac4-b376-c03e2f755d19 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:31.315345 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9a7bc-8644-4ca2-ae5d-3ddcfb664cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:31.316183 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9a7bc-8644-4ca2-ae5d-3ddcfb664cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:31.316516 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9a7bc-8644-4ca2-ae5d-3ddcfb664cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:31.316792 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9a7bc-8644-4ca2-ae5d-3ddcfb664cd4 admin admin] PATH_INFO: `/v3/projects/31a770cfa8854517a659b3c0bccd0a54` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:31.320884 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9a7bc-8644-4ca2-ae5d-3ddcfb664cd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31a770cfa8854517a659b3c0bccd0a54)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:31.323066 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f9a7bc-8644-4ca2-ae5d-3ddcfb664cd4 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:31.415476 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:31.420658 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d8f9a7bc-8644-4ca2-ae5d-3ddcfb664cd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31a770cfa8854517a659b3c0bccd0a54', 'request_id': 'req-d8f9a7bc-8644-4ca2-ae5d-3ddcfb664cd4'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:31.426373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00b400-7b74-4588-ba8a-c316fd7ae85a service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:31.428718 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2d00b400-7b74-4588-ba8a-c316fd7ae85a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:31.446539 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d00b400-7b74-4588-ba8a-c316fd7ae85a service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:31.457920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d8f9a7bc-8644-4ca2-ae5d-3ddcfb664cd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31a770cfa8854517a659b3c0bccd0a54', 'request_id': 'req-d8f9a7bc-8644-4ca2-ae5d-3ddcfb664cd4'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:31.468923 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d8f9a7bc-8644-4ca2-ae5d-3ddcfb664cd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31a770cfa8854517a659b3c0bccd0a54', 'request_id': 'req-d8f9a7bc-8644-4ca2-ae5d-3ddcfb664cd4'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:31.486443 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d8f9a7bc-8644-4ca2-ae5d-3ddcfb664cd4 admin admin] The token cache is being invalidate because project 31a770cfa8854517a659b3c0bccd0a54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:45:31.486782 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d8f9a7bc-8644-4ca2-ae5d-3ddcfb664cd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:31.487577 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d8f9a7bc-8644-4ca2-ae5d-3ddcfb664cd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:31.493249 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 942/1894] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:45:31 2022] DELETE /identity/v3/projects/31a770cfa8854517a659b3c0bccd0a54 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:31.494352 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9a7bc-8644-4ca2-ae5d-3ddcfb664cd4 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:31.495964 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d8f9a7bc-8644-4ca2-ae5d-3ddcfb664cd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:31.558587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d37c0-02d7-42e1-ae9c-9f3591458bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:31.560450 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d37c0-02d7-42e1-ae9c-9f3591458bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:31.560728 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d37c0-02d7-42e1-ae9c-9f3591458bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:31.560998 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d37c0-02d7-42e1-ae9c-9f3591458bc8 admin admin] PATH_INFO: `/v3/projects/b072b78ed8be4eddab957d80ca557e9a` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:31.562569 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d37c0-02d7-42e1-ae9c-9f3591458bc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b072b78ed8be4eddab957d80ca557e9a)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:31.565257 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d37c0-02d7-42e1-ae9c-9f3591458bc8 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:31.612275 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9a7bc-8644-4ca2-ae5d-3ddcfb664cd4 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:31.620449 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c6db8-f08b-4100-9e47-dd4e86cc26ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:31.621340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c6db8-f08b-4100-9e47-dd4e86cc26ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:31.621740 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c6db8-f08b-4100-9e47-dd4e86cc26ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:31.622303 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c6db8-f08b-4100-9e47-dd4e86cc26ad admin admin] PATH_INFO: `/v3/users/790b3fe26c3f4b48a034db0b563ead9c` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:31.623905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c6db8-f08b-4100-9e47-dd4e86cc26ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=790b3fe26c3f4b48a034db0b563ead9c)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:31.626036 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c6db8-f08b-4100-9e47-dd4e86cc26ad admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:31.696685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-837c6db8-f08b-4100-9e47-dd4e86cc26ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '790b3fe26c3f4b48a034db0b563ead9c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:31.711321 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-837c6db8-f08b-4100-9e47-dd4e86cc26ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '790b3fe26c3f4b48a034db0b563ead9c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:31.718985 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:31.731949 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-bf5d37c0-02d7-42e1-ae9c-9f3591458bc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b072b78ed8be4eddab957d80ca557e9a', 'request_id': 'req-bf5d37c0-02d7-42e1-ae9c-9f3591458bc8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:31.752820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-bf5d37c0-02d7-42e1-ae9c-9f3591458bc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b072b78ed8be4eddab957d80ca557e9a', 'request_id': 'req-bf5d37c0-02d7-42e1-ae9c-9f3591458bc8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:31.775082 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-bf5d37c0-02d7-42e1-ae9c-9f3591458bc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b072b78ed8be4eddab957d80ca557e9a', 'request_id': 'req-bf5d37c0-02d7-42e1-ae9c-9f3591458bc8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:31.791399 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-837c6db8-f08b-4100-9e47-dd4e86cc26ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '790b3fe26c3f4b48a034db0b563ead9c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:31.793233 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-837c6db8-f08b-4100-9e47-dd4e86cc26ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '790b3fe26c3f4b48a034db0b563ead9c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:31.825378 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-bf5d37c0-02d7-42e1-ae9c-9f3591458bc8 admin admin] The token cache is being invalidate because project b072b78ed8be4eddab957d80ca557e9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:45:31.825704 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-bf5d37c0-02d7-42e1-ae9c-9f3591458bc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:31.830326 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-bf5d37c0-02d7-42e1-ae9c-9f3591458bc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:31.835948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 953/1895] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:45:31 2022] DELETE /identity/v3/projects/b072b78ed8be4eddab957d80ca557e9a => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:45:31.836519 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-837c6db8-f08b-4100-9e47-dd4e86cc26ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '790b3fe26c3f4b48a034db0b563ead9c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:31.841642 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d37c0-02d7-42e1-ae9c-9f3591458bc8 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:31.847827 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-bf5d37c0-02d7-42e1-ae9c-9f3591458bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:31.868849 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 943/1896] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:45:31 2022] DELETE /identity/v3/users/790b3fe26c3f4b48a034db0b563ead9c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:32.094478 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d37c0-02d7-42e1-ae9c-9f3591458bc8 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:32.283958 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549498c-7e9b-4bf2-94b1-dd673b693c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:32.285193 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549498c-7e9b-4bf2-94b1-dd673b693c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:32.285641 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549498c-7e9b-4bf2-94b1-dd673b693c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:32.286090 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549498c-7e9b-4bf2-94b1-dd673b693c7d admin admin] PATH_INFO: `/v3/users/159569b5237b4668bc0c593d5d67c10b` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:32.288217 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549498c-7e9b-4bf2-94b1-dd673b693c7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=159569b5237b4668bc0c593d5d67c10b)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:32.292546 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549498c-7e9b-4bf2-94b1-dd673b693c7d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:32.438283 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7549498c-7e9b-4bf2-94b1-dd673b693c7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '159569b5237b4668bc0c593d5d67c10b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:32.453864 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7549498c-7e9b-4bf2-94b1-dd673b693c7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '159569b5237b4668bc0c593d5d67c10b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:32.454959 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7549498c-7e9b-4bf2-94b1-dd673b693c7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '159569b5237b4668bc0c593d5d67c10b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:32.488966 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7549498c-7e9b-4bf2-94b1-dd673b693c7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '159569b5237b4668bc0c593d5d67c10b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:32.514770 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7549498c-7e9b-4bf2-94b1-dd673b693c7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '159569b5237b4668bc0c593d5d67c10b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:32.523012 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:32.538448 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 954/1897] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:45:31 2022] DELETE /identity/v3/users/159569b5237b4668bc0c593d5d67c10b => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:32.806408 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c6db8-f08b-4100-9e47-dd4e86cc26ad admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:32.814309 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-837c6db8-f08b-4100-9e47-dd4e86cc26ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:32.853921 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c6db8-f08b-4100-9e47-dd4e86cc26ad admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:32.969617 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:32.995067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d55a74-acc4-45d9-8c5e-027be00f71de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:32.996305 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d55a74-acc4-45d9-8c5e-027be00f71de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:32.997193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d55a74-acc4-45d9-8c5e-027be00f71de admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:32.997705 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d55a74-acc4-45d9-8c5e-027be00f71de admin admin] PATH_INFO: `/v3/users/d69e005f799b4a74946aa34729825c09` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:33.001646 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d55a74-acc4-45d9-8c5e-027be00f71de admin admin] RBAC: Authorizing `identity:delete_user(user_id=d69e005f799b4a74946aa34729825c09)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:33.006479 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d55a74-acc4-45d9-8c5e-027be00f71de admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:33.122971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a5d55a74-acc4-45d9-8c5e-027be00f71de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd69e005f799b4a74946aa34729825c09'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:33.151666 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a5d55a74-acc4-45d9-8c5e-027be00f71de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd69e005f799b4a74946aa34729825c09'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:33.152517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549498c-7e9b-4bf2-94b1-dd673b693c7d admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:33.155814 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7549498c-7e9b-4bf2-94b1-dd673b693c7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:33.193022 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a5d55a74-acc4-45d9-8c5e-027be00f71de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd69e005f799b4a74946aa34729825c09'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:33.194353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a5d55a74-acc4-45d9-8c5e-027be00f71de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd69e005f799b4a74946aa34729825c09'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:33.199478 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549498c-7e9b-4bf2-94b1-dd673b693c7d admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:33.241394 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a5d55a74-acc4-45d9-8c5e-027be00f71de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd69e005f799b4a74946aa34729825c09'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:33.245782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec61a5f-c4f4-47af-9368-bb2f7d89735a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:33.246620 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec61a5f-c4f4-47af-9368-bb2f7d89735a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:33.247091 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec61a5f-c4f4-47af-9368-bb2f7d89735a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:33.247450 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec61a5f-c4f4-47af-9368-bb2f7d89735a admin admin] PATH_INFO: `/v3/projects/6767743ea04342339882401aa0b476a6` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:33.250718 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec61a5f-c4f4-47af-9368-bb2f7d89735a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6767743ea04342339882401aa0b476a6)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:33.254323 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec61a5f-c4f4-47af-9368-bb2f7d89735a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:33.266988 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 944/1898] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:45:32 2022] DELETE /identity/v3/users/d69e005f799b4a74946aa34729825c09 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:33.273215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9413c4-57a8-461a-99d3-bad13f14022b None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:33.273728 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9413c4-57a8-461a-99d3-bad13f14022b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:33.274153 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9413c4-57a8-461a-99d3-bad13f14022b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:33.351771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-6b9413c4-57a8-461a-99d3-bad13f14022b None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:33.351771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-6b9413c4-57a8-461a-99d3-bad13f14022b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:33.352262 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7ec61a5f-c4f4-47af-9368-bb2f7d89735a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6767743ea04342339882401aa0b476a6', 'request_id': 'req-7ec61a5f-c4f4-47af-9368-bb2f7d89735a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:33.366817 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7ec61a5f-c4f4-47af-9368-bb2f7d89735a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6767743ea04342339882401aa0b476a6', 'request_id': 'req-7ec61a5f-c4f4-47af-9368-bb2f7d89735a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:33.376547 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7ec61a5f-c4f4-47af-9368-bb2f7d89735a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6767743ea04342339882401aa0b476a6', 'request_id': 'req-7ec61a5f-c4f4-47af-9368-bb2f7d89735a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:33.394018 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7ec61a5f-c4f4-47af-9368-bb2f7d89735a admin admin] The token cache is being invalidate because project 6767743ea04342339882401aa0b476a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:45:33.396172 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7ec61a5f-c4f4-47af-9368-bb2f7d89735a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:33.397102 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7ec61a5f-c4f4-47af-9368-bb2f7d89735a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:33.402769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 955/1899] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:45:33 2022] DELETE /identity/v3/projects/6767743ea04342339882401aa0b476a6 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:33.405618 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea1f46-ecae-482b-b23f-4d99b2b98b0b None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:33.405990 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea1f46-ecae-482b-b23f-4d99b2b98b0b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:33.406336 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea1f46-ecae-482b-b23f-4d99b2b98b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:33.455789 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 945/1900] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:33.465510 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9413c4-57a8-461a-99d3-bad13f14022b None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:33.468236 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-6b9413c4-57a8-461a-99d3-bad13f14022b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:33.476559 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-0dea1f46-ecae-482b-b23f-4d99b2b98b0b None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:33.480572 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0dea1f46-ecae-482b-b23f-4d99b2b98b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:33.503019 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 956/1901] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:33.510905 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea1f46-ecae-482b-b23f-4d99b2b98b0b None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:33.512676 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0dea1f46-ecae-482b-b23f-4d99b2b98b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:33.526077 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea1f46-ecae-482b-b23f-4d99b2b98b0b None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:33.531965 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d84ce1-290a-47de-850a-3aa6ae044096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:33.532675 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d84ce1-290a-47de-850a-3aa6ae044096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:33.532953 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d84ce1-290a-47de-850a-3aa6ae044096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:33.533224 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d84ce1-290a-47de-850a-3aa6ae044096 admin admin] PATH_INFO: `/v3/projects/55ce757b56c54c9fb706e455ab6844ed` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:33.534480 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d84ce1-290a-47de-850a-3aa6ae044096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55ce757b56c54c9fb706e455ab6844ed)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:33.536591 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d84ce1-290a-47de-850a-3aa6ae044096 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:33.552663 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9413c4-57a8-461a-99d3-bad13f14022b None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:33.557106 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb33027-e746-4601-b14e-a7c3b5e2ead7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:33.557998 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb33027-e746-4601-b14e-a7c3b5e2ead7 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:33.558343 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb33027-e746-4601-b14e-a7c3b5e2ead7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:33.558678 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb33027-e746-4601-b14e-a7c3b5e2ead7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:33.569444 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb33027-e746-4601-b14e-a7c3b5e2ead7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:33.571035 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb33027-e746-4601-b14e-a7c3b5e2ead7 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:33.586418 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 946/1902] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:45:33.587432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb33027-e746-4601-b14e-a7c3b5e2ead7 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:33.589624 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5bb33027-e746-4601-b14e-a7c3b5e2ead7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:33.607801 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb33027-e746-4601-b14e-a7c3b5e2ead7 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:33.610663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f4d84ce1-290a-47de-850a-3aa6ae044096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55ce757b56c54c9fb706e455ab6844ed', 'request_id': 'req-f4d84ce1-290a-47de-850a-3aa6ae044096'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:33.619632 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f4d84ce1-290a-47de-850a-3aa6ae044096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55ce757b56c54c9fb706e455ab6844ed', 'request_id': 'req-f4d84ce1-290a-47de-850a-3aa6ae044096'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:33.632053 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f4d84ce1-290a-47de-850a-3aa6ae044096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55ce757b56c54c9fb706e455ab6844ed', 'request_id': 'req-f4d84ce1-290a-47de-850a-3aa6ae044096'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:33.634608 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:33.654417 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f4d84ce1-290a-47de-850a-3aa6ae044096 admin admin] The token cache is being invalidate because project 55ce757b56c54c9fb706e455ab6844ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:45:33.654799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f4d84ce1-290a-47de-850a-3aa6ae044096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:33.656434 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f4d84ce1-290a-47de-850a-3aa6ae044096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:33.658507 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 957/1903] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:45:33 2022] DELETE /identity/v3/projects/55ce757b56c54c9fb706e455ab6844ed => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:33.659823 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88038b4f-5e72-4080-81da-2a642bc9b6b3 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:33.660108 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88038b4f-5e72-4080-81da-2a642bc9b6b3 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:33.660899 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88038b4f-5e72-4080-81da-2a642bc9b6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:33.686446 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-88038b4f-5e72-4080-81da-2a642bc9b6b3 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:33.689349 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-88038b4f-5e72-4080-81da-2a642bc9b6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:33.720765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e008a9-e4ef-44b1-9b83-4091d6909e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:33.722314 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e008a9-e4ef-44b1-9b83-4091d6909e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:33.722688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e008a9-e4ef-44b1-9b83-4091d6909e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:33.723078 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e008a9-e4ef-44b1-9b83-4091d6909e81 admin admin] PATH_INFO: `/v3/users/afbfa29766db4156bcf7832194e23ba1` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:33.725026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e008a9-e4ef-44b1-9b83-4091d6909e81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afbfa29766db4156bcf7832194e23ba1)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:33.728120 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e008a9-e4ef-44b1-9b83-4091d6909e81 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:33.775245 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:33.793194 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 958/1904] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:33.795720 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39937b28-dd75-4b41-b82e-498abd3ec45c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:33.796016 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39937b28-dd75-4b41-b82e-498abd3ec45c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:33.796489 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39937b28-dd75-4b41-b82e-498abd3ec45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:33.827784 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-39937b28-dd75-4b41-b82e-498abd3ec45c None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:33.829070 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-39937b28-dd75-4b41-b82e-498abd3ec45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:33.830540 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-22e008a9-e4ef-44b1-9b83-4091d6909e81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afbfa29766db4156bcf7832194e23ba1'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:33.845198 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-22e008a9-e4ef-44b1-9b83-4091d6909e81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afbfa29766db4156bcf7832194e23ba1'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:33.848699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 959/1905] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:33.849972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39937b28-dd75-4b41-b82e-498abd3ec45c None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:33.866648 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-22e008a9-e4ef-44b1-9b83-4091d6909e81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afbfa29766db4156bcf7832194e23ba1'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:33.867365 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39937b28-dd75-4b41-b82e-498abd3ec45c None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:33.867873 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-22e008a9-e4ef-44b1-9b83-4091d6909e81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afbfa29766db4156bcf7832194e23ba1'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:33.873029 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e2db1-d3e7-4444-a675-29309e9300b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:33.873645 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e2db1-d3e7-4444-a675-29309e9300b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:33.873990 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e2db1-d3e7-4444-a675-29309e9300b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:33.874327 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e2db1-d3e7-4444-a675-29309e9300b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:33.875232 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e2db1-d3e7-4444-a675-29309e9300b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:45:33.875604 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e2db1-d3e7-4444-a675-29309e9300b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:33.878661 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-22e008a9-e4ef-44b1-9b83-4091d6909e81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afbfa29766db4156bcf7832194e23ba1'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:33.879037 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e2db1-d3e7-4444-a675-29309e9300b1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:33.891144 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 947/1906] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:45:33 2022] DELETE /identity/v3/users/afbfa29766db4156bcf7832194e23ba1 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:33.892806 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77aa98a-da3f-4194-950d-a0d949e99812 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:33.893161 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77aa98a-da3f-4194-950d-a0d949e99812 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:33.893498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77aa98a-da3f-4194-950d-a0d949e99812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:33.895290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 960/1907] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:45:33.896924 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1adc40c-8e7b-4dd9-ae66-a8ccede48889 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:33.897232 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1adc40c-8e7b-4dd9-ae66-a8ccede48889 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:33.897562 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1adc40c-8e7b-4dd9-ae66-a8ccede48889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:33.923110 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-f1adc40c-8e7b-4dd9-ae66-a8ccede48889 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:33.925116 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f1adc40c-8e7b-4dd9-ae66-a8ccede48889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:33.932655 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-f77aa98a-da3f-4194-950d-a0d949e99812 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:33.934335 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f77aa98a-da3f-4194-950d-a0d949e99812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:34.017348 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 948/1908] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:34.018344 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77aa98a-da3f-4194-950d-a0d949e99812 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:34.019832 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f77aa98a-da3f-4194-950d-a0d949e99812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:34.036182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77aa98a-da3f-4194-950d-a0d949e99812 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:34.044228 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c9fc6-7158-4c32-82f6-af95c8abf572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:34.045120 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c9fc6-7158-4c32-82f6-af95c8abf572 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:34.045500 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c9fc6-7158-4c32-82f6-af95c8abf572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:34.046023 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c9fc6-7158-4c32-82f6-af95c8abf572 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:34.046911 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c9fc6-7158-4c32-82f6-af95c8abf572 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:34.049457 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c9fc6-7158-4c32-82f6-af95c8abf572 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:34.064870 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 961/1909] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:34.066095 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1adc40c-8e7b-4dd9-ae66-a8ccede48889 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:34.082007 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1adc40c-8e7b-4dd9-ae66-a8ccede48889 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:34.091876 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82e047-e09f-4e5c-b13b-7a2f15efec9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:34.093174 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82e047-e09f-4e5c-b13b-7a2f15efec9e admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:34.093771 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82e047-e09f-4e5c-b13b-7a2f15efec9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:34.094340 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82e047-e09f-4e5c-b13b-7a2f15efec9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:34.095190 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82e047-e09f-4e5c-b13b-7a2f15efec9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:45:34.096077 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82e047-e09f-4e5c-b13b-7a2f15efec9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:34.096258 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 949/1910] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:45:34 2022] POST /identity/v3/projects => generated 385 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:34.097159 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c9fc6-7158-4c32-82f6-af95c8abf572 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:34.098599 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82e047-e09f-4e5c-b13b-7a2f15efec9e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:34.117953 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:34.124029 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 962/1911] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:45:34.124029 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82e047-e09f-4e5c-b13b-7a2f15efec9e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:34.124029 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9d82e047-e09f-4e5c-b13b-7a2f15efec9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:34.202437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c9fc6-7158-4c32-82f6-af95c8abf572 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:34.207865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26855e8d-a2e8-47e8-ba1d-b89f3fe09bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:34.208599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26855e8d-a2e8-47e8-ba1d-b89f3fe09bdb admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:34.209080 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26855e8d-a2e8-47e8-ba1d-b89f3fe09bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:34.209417 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26855e8d-a2e8-47e8-ba1d-b89f3fe09bdb admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:34.210356 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26855e8d-a2e8-47e8-ba1d-b89f3fe09bdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:34.212435 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26855e8d-a2e8-47e8-ba1d-b89f3fe09bdb admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:34.232735 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82e047-e09f-4e5c-b13b-7a2f15efec9e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:34.238000 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 950/1912] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:45:34 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:34.238926 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26855e8d-a2e8-47e8-ba1d-b89f3fe09bdb admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:34.256048 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26855e8d-a2e8-47e8-ba1d-b89f3fe09bdb admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:34.265584 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b31244-25f3-4322-8a8d-4b0a90ca9da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:34.267362 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b31244-25f3-4322-8a8d-4b0a90ca9da0 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:34.268877 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b31244-25f3-4322-8a8d-4b0a90ca9da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:34.269727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b31244-25f3-4322-8a8d-4b0a90ca9da0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:34.274907 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b31244-25f3-4322-8a8d-4b0a90ca9da0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:34.278182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b31244-25f3-4322-8a8d-4b0a90ca9da0 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:34.329206 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b069eb3-79a1-46fa-bd3c-6898deded717 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:34.330352 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b069eb3-79a1-46fa-bd3c-6898deded717 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:34.330874 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b069eb3-79a1-46fa-bd3c-6898deded717 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:34.331348 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b069eb3-79a1-46fa-bd3c-6898deded717 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:34.337000 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 951/1913] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:45:34 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:34.338849 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b31244-25f3-4322-8a8d-4b0a90ca9da0 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:34.348305 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b069eb3-79a1-46fa-bd3c-6898deded717 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:34.350465 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b069eb3-79a1-46fa-bd3c-6898deded717 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:34.366137 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 963/1914] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:45:34.367464 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b069eb3-79a1-46fa-bd3c-6898deded717 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:34.370608 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8b069eb3-79a1-46fa-bd3c-6898deded717 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:34.387790 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b069eb3-79a1-46fa-bd3c-6898deded717 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:34.418995 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:34.477881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b31244-25f3-4322-8a8d-4b0a90ca9da0 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:34.484345 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cab30-181a-4f7d-a265-0b16b900a3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:34.485142 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cab30-181a-4f7d-a265-0b16b900a3be admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:34.485561 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cab30-181a-4f7d-a265-0b16b900a3be admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:34.485935 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cab30-181a-4f7d-a265-0b16b900a3be admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:34.487191 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5cab30-181a-4f7d-a265-0b16b900a3be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:34.489064 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5cab30-181a-4f7d-a265-0b16b900a3be admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:34.491408 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9106d6-bb9b-4060-b9d8-453a0bf29d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:34.492561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9106d6-bb9b-4060-b9d8-453a0bf29d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:34.492838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9106d6-bb9b-4060-b9d8-453a0bf29d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:34.493110 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9106d6-bb9b-4060-b9d8-453a0bf29d05 admin admin] PATH_INFO: `/v3/projects/90bd5d04f6ff466c9cf7c55f7f8784a3` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:34.494387 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9106d6-bb9b-4060-b9d8-453a0bf29d05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90bd5d04f6ff466c9cf7c55f7f8784a3)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:34.496432 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9106d6-bb9b-4060-b9d8-453a0bf29d05 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:34.516431 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 952/1915] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:34.516431 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cab30-181a-4f7d-a265-0b16b900a3be admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:34.544646 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cab30-181a-4f7d-a265-0b16b900a3be admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:34.567785 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ed9106d6-bb9b-4060-b9d8-453a0bf29d05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90bd5d04f6ff466c9cf7c55f7f8784a3', 'request_id': 'req-ed9106d6-bb9b-4060-b9d8-453a0bf29d05'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:34.580186 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ed9106d6-bb9b-4060-b9d8-453a0bf29d05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90bd5d04f6ff466c9cf7c55f7f8784a3', 'request_id': 'req-ed9106d6-bb9b-4060-b9d8-453a0bf29d05'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:34.596301 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ed9106d6-bb9b-4060-b9d8-453a0bf29d05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90bd5d04f6ff466c9cf7c55f7f8784a3', 'request_id': 'req-ed9106d6-bb9b-4060-b9d8-453a0bf29d05'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:34.627008 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ed9106d6-bb9b-4060-b9d8-453a0bf29d05 admin admin] The token cache is being invalidate because project 90bd5d04f6ff466c9cf7c55f7f8784a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:45:34.628239 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ed9106d6-bb9b-4060-b9d8-453a0bf29d05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:34.630004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ed9106d6-bb9b-4060-b9d8-453a0bf29d05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:34.634837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 964/1916] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:45:34 2022] DELETE /identity/v3/projects/90bd5d04f6ff466c9cf7c55f7f8784a3 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:34.637078 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9106d6-bb9b-4060-b9d8-453a0bf29d05 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:34.640167 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ed9106d6-bb9b-4060-b9d8-453a0bf29d05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:34.674544 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953eaf38-545e-44b9-9b81-77ddce47afc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:34.675966 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953eaf38-545e-44b9-9b81-77ddce47afc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:34.676652 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953eaf38-545e-44b9-9b81-77ddce47afc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:34.677370 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953eaf38-545e-44b9-9b81-77ddce47afc2 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:34.678773 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953eaf38-545e-44b9-9b81-77ddce47afc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:34.683338 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953eaf38-545e-44b9-9b81-77ddce47afc2 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:34.741042 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 953/1917] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:45:34 2022] POST /identity/v3/users => generated 289 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:34.747575 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953eaf38-545e-44b9-9b81-77ddce47afc2 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:34.750934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-953eaf38-545e-44b9-9b81-77ddce47afc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:34.799373 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953eaf38-545e-44b9-9b81-77ddce47afc2 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:34.810760 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a648d-ca9c-48ad-bf7d-7a41028759f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:34.811908 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a648d-ca9c-48ad-bf7d-7a41028759f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:34.812405 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a648d-ca9c-48ad-bf7d-7a41028759f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:34.812886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a648d-ca9c-48ad-bf7d-7a41028759f2 admin admin] PATH_INFO: `/v3/users/004555d591dd4f13a5ee4656e5016873` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:34.814150 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9106d6-bb9b-4060-b9d8-453a0bf29d05 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:34.815435 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a648d-ca9c-48ad-bf7d-7a41028759f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=004555d591dd4f13a5ee4656e5016873)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:34.822163 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581ef82-2854-4e79-84e2-faea1f554f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:34.823135 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581ef82-2854-4e79-84e2-faea1f554f22 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:34.823553 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581ef82-2854-4e79-84e2-faea1f554f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:34.824128 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6581ef82-2854-4e79-84e2-faea1f554f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:34.826025 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581ef82-2854-4e79-84e2-faea1f554f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:34.828351 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6581ef82-2854-4e79-84e2-faea1f554f22 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:34.832921 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a648d-ca9c-48ad-bf7d-7a41028759f2 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:34.842915 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:34.846669 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 965/1918] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:34.850719 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581ef82-2854-4e79-84e2-faea1f554f22 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:34.856692 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6581ef82-2854-4e79-84e2-faea1f554f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:34.890060 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6581ef82-2854-4e79-84e2-faea1f554f22 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:34.896350 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7742f8-4ecb-4eb1-be29-24463e8e034a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:34.897034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7742f8-4ecb-4eb1-be29-24463e8e034a admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:34.897337 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7742f8-4ecb-4eb1-be29-24463e8e034a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:34.897822 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7742f8-4ecb-4eb1-be29-24463e8e034a admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:34.898490 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7742f8-4ecb-4eb1-be29-24463e8e034a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:34.900308 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7742f8-4ecb-4eb1-be29-24463e8e034a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:34.916033 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 966/1919] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:34.917138 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7742f8-4ecb-4eb1-be29-24463e8e034a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:34.930838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7742f8-4ecb-4eb1-be29-24463e8e034a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:34.956784 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf58a8d-71e5-40b5-8724-b2dbf0448ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:34.960008 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf58a8d-71e5-40b5-8724-b2dbf0448ed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:34.965171 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf58a8d-71e5-40b5-8724-b2dbf0448ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:34.965723 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf58a8d-71e5-40b5-8724-b2dbf0448ed5 admin admin] PATH_INFO: `/v3/projects/81c276a9500946cdba4d270d640ba3e6/users/e38ff7d39a3346d0b6f4d6339812a573/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:34.994361 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1f4a648d-ca9c-48ad-bf7d-7a41028759f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '004555d591dd4f13a5ee4656e5016873'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:35.011925 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1f4a648d-ca9c-48ad-bf7d-7a41028759f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '004555d591dd4f13a5ee4656e5016873'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:35.023606 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf58a8d-71e5-40b5-8724-b2dbf0448ed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81c276a9500946cdba4d270d640ba3e6, user_id=e38ff7d39a3346d0b6f4d6339812a573, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:35.036300 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf58a8d-71e5-40b5-8724-b2dbf0448ed5 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:35.063590 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1f4a648d-ca9c-48ad-bf7d-7a41028759f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '004555d591dd4f13a5ee4656e5016873'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:35.065490 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1f4a648d-ca9c-48ad-bf7d-7a41028759f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '004555d591dd4f13a5ee4656e5016873'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:35.084731 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 967/1920] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:34 2022] PUT /identity/v3/projects/81c276a9500946cdba4d270d640ba3e6/users/e38ff7d39a3346d0b6f4d6339812a573/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:35.086792 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf58a8d-71e5-40b5-8724-b2dbf0448ed5 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:35.100449 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1f4a648d-ca9c-48ad-bf7d-7a41028759f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '004555d591dd4f13a5ee4656e5016873'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:35.104215 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3cf58a8d-71e5-40b5-8724-b2dbf0448ed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:35.140633 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 954/1921] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:45:34 2022] DELETE /identity/v3/users/004555d591dd4f13a5ee4656e5016873 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:35.142068 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547d8f5-1e9d-4d93-abf5-93a096325999 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:35.142349 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547d8f5-1e9d-4d93-abf5-93a096325999 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:35.142617 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547d8f5-1e9d-4d93-abf5-93a096325999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:35.167300 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:35.204845 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-4547d8f5-1e9d-4d93-abf5-93a096325999 None None] MFA Rules not processed for user `e38ff7d39a3346d0b6f4d6339812a573`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:35.206135 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4547d8f5-1e9d-4d93-abf5-93a096325999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:35.340816 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 955/1922] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:35.347485 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547d8f5-1e9d-4d93-abf5-93a096325999 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:35.349019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4547d8f5-1e9d-4d93-abf5-93a096325999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:35.379188 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf58a8d-71e5-40b5-8724-b2dbf0448ed5 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:35.571404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547d8f5-1e9d-4d93-abf5-93a096325999 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:35.584914 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d501c6c-eafa-46ff-9f61-aca50c62c867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:35.585898 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d501c6c-eafa-46ff-9f61-aca50c62c867 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:35.586322 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d501c6c-eafa-46ff-9f61-aca50c62c867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:35.586935 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d501c6c-eafa-46ff-9f61-aca50c62c867 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:35.587860 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d501c6c-eafa-46ff-9f61-aca50c62c867 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:35.590249 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d501c6c-eafa-46ff-9f61-aca50c62c867 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:35.608705 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0583fa-c217-4534-bb57-b4daf3b3a2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:35.609883 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0583fa-c217-4534-bb57-b4daf3b3a2d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:35.610365 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0583fa-c217-4534-bb57-b4daf3b3a2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:35.610793 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0583fa-c217-4534-bb57-b4daf3b3a2d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:35.612245 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0583fa-c217-4534-bb57-b4daf3b3a2d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:35.615392 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0583fa-c217-4534-bb57-b4daf3b3a2d2 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:35.628894 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:35.647839 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 968/1923] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 562 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:35.653738 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0583fa-c217-4534-bb57-b4daf3b3a2d2 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:35.683443 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 956/1924] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:45:35 2022] POST /identity/v3/projects => generated 385 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:35.686233 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d501c6c-eafa-46ff-9f61-aca50c62c867 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:35.691896 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0583fa-c217-4534-bb57-b4daf3b3a2d2 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:35.865554 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96954c0a-62be-447b-968a-7bd102aad91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:35.866269 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96954c0a-62be-447b-968a-7bd102aad91b admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:35.866544 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96954c0a-62be-447b-968a-7bd102aad91b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:35.866813 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96954c0a-62be-447b-968a-7bd102aad91b admin admin] PATH_INFO: `/v3/projects/970dba232b2d4ae5947677f2ebd1f5e7/users/87f4b7aa15c542bfa691d48f38f23b77/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:35.867832 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d501c6c-eafa-46ff-9f61-aca50c62c867 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:35.875460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069aea02-afba-43a7-927b-de4ec46bbe12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:35.876525 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069aea02-afba-43a7-927b-de4ec46bbe12 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:35.877175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069aea02-afba-43a7-927b-de4ec46bbe12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:35.877599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069aea02-afba-43a7-927b-de4ec46bbe12 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:35.878386 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069aea02-afba-43a7-927b-de4ec46bbe12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:35.881005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069aea02-afba-43a7-927b-de4ec46bbe12 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:35.902605 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96954c0a-62be-447b-968a-7bd102aad91b admin admin] RBAC: Authorizing `identity:create_grant(project_id=970dba232b2d4ae5947677f2ebd1f5e7, user_id=87f4b7aa15c542bfa691d48f38f23b77, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:35.905465 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96954c0a-62be-447b-968a-7bd102aad91b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:35.949587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 969/1925] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:35 2022] PUT /identity/v3/projects/970dba232b2d4ae5947677f2ebd1f5e7/users/87f4b7aa15c542bfa691d48f38f23b77/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:35.949587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96954c0a-62be-447b-968a-7bd102aad91b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:35.949587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-96954c0a-62be-447b-968a-7bd102aad91b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:35.970929 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 957/1926] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:45:35 2022] POST /identity/v3/users => generated 299 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:35.977953 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a98cd1-fb1d-4468-80d0-49045e33ff88 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:35.979764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a98cd1-fb1d-4468-80d0-49045e33ff88 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:35.980676 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a98cd1-fb1d-4468-80d0-49045e33ff88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:36.061114 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:36.106278 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-e8a98cd1-fb1d-4468-80d0-49045e33ff88 None None] MFA Rules not processed for user `87f4b7aa15c542bfa691d48f38f23b77`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:36.108813 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e8a98cd1-fb1d-4468-80d0-49045e33ff88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:36.143416 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96954c0a-62be-447b-968a-7bd102aad91b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:36.176622 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced23c4-eb34-4877-8014-fa3a84e87e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:36.178477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced23c4-eb34-4877-8014-fa3a84e87e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:36.179143 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced23c4-eb34-4877-8014-fa3a84e87e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:36.179713 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced23c4-eb34-4877-8014-fa3a84e87e9d admin admin] PATH_INFO: `/v3/projects/1695944bf2fa470a967b83ef88efe074` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:36.185007 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced23c4-eb34-4877-8014-fa3a84e87e9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1695944bf2fa470a967b83ef88efe074)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:36.186997 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced23c4-eb34-4877-8014-fa3a84e87e9d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:36.345413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 958/1927] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:36.356102 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a98cd1-fb1d-4468-80d0-49045e33ff88 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:36.363524 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7ced23c4-eb34-4877-8014-fa3a84e87e9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1695944bf2fa470a967b83ef88efe074', 'request_id': 'req-7ced23c4-eb34-4877-8014-fa3a84e87e9d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:36.382017 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a98cd1-fb1d-4468-80d0-49045e33ff88 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:36.401212 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7ced23c4-eb34-4877-8014-fa3a84e87e9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1695944bf2fa470a967b83ef88efe074', 'request_id': 'req-7ced23c4-eb34-4877-8014-fa3a84e87e9d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:36.419912 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7ced23c4-eb34-4877-8014-fa3a84e87e9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1695944bf2fa470a967b83ef88efe074', 'request_id': 'req-7ced23c4-eb34-4877-8014-fa3a84e87e9d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:36.462218 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7ced23c4-eb34-4877-8014-fa3a84e87e9d admin admin] The token cache is being invalidate because project 1695944bf2fa470a967b83ef88efe074 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:45:36.465140 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7ced23c4-eb34-4877-8014-fa3a84e87e9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:36.468659 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7ced23c4-eb34-4877-8014-fa3a84e87e9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:36.476955 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 970/1928] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:45:35 2022] DELETE /identity/v3/projects/1695944bf2fa470a967b83ef88efe074 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:36.482083 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced23c4-eb34-4877-8014-fa3a84e87e9d admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:36.488168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7ced23c4-eb34-4877-8014-fa3a84e87e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:36.558961 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60e8c4-7ea1-4864-9d2a-ff6a7d3bfdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:36.560077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60e8c4-7ea1-4864-9d2a-ff6a7d3bfdd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:36.560516 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60e8c4-7ea1-4864-9d2a-ff6a7d3bfdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:36.560957 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60e8c4-7ea1-4864-9d2a-ff6a7d3bfdd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:36.562666 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60e8c4-7ea1-4864-9d2a-ff6a7d3bfdd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:36.565091 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60e8c4-7ea1-4864-9d2a-ff6a7d3bfdd2 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:36.582920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 959/1929] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:36.584451 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60e8c4-7ea1-4864-9d2a-ff6a7d3bfdd2 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:36.588074 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2a60e8c4-7ea1-4864-9d2a-ff6a7d3bfdd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:36.607935 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60e8c4-7ea1-4864-9d2a-ff6a7d3bfdd2 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:36.615534 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f140e-cbe0-4027-950e-592fee0889ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:36.616489 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f140e-cbe0-4027-950e-592fee0889ae admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:36.616929 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f140e-cbe0-4027-950e-592fee0889ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:36.617375 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f140e-cbe0-4027-950e-592fee0889ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:36.618363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f140e-cbe0-4027-950e-592fee0889ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:36.621549 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900f140e-cbe0-4027-950e-592fee0889ae admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:36.630046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:36.643414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced23c4-eb34-4877-8014-fa3a84e87e9d admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:36.648895 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4450ea-c6b6-4f0a-8be7-e2dd0bbd4abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:36.649649 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4450ea-c6b6-4f0a-8be7-e2dd0bbd4abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:36.650017 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4450ea-c6b6-4f0a-8be7-e2dd0bbd4abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:36.650314 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4450ea-c6b6-4f0a-8be7-e2dd0bbd4abf admin admin] PATH_INFO: `/v3/projects/ada8e3ede4f14d33b1adb62b804c16fd` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:36.651507 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4450ea-c6b6-4f0a-8be7-e2dd0bbd4abf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ada8e3ede4f14d33b1adb62b804c16fd)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:36.653569 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4450ea-c6b6-4f0a-8be7-e2dd0bbd4abf admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:36.660122 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 960/1930] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:45:36 2022] POST /identity/v3/projects => generated 375 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:36.661004 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f140e-cbe0-4027-950e-592fee0889ae admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:36.662849 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-900f140e-cbe0-4027-950e-592fee0889ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:36.728012 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fb4450ea-c6b6-4f0a-8be7-e2dd0bbd4abf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ada8e3ede4f14d33b1adb62b804c16fd', 'request_id': 'req-fb4450ea-c6b6-4f0a-8be7-e2dd0bbd4abf'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:36.736808 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fb4450ea-c6b6-4f0a-8be7-e2dd0bbd4abf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ada8e3ede4f14d33b1adb62b804c16fd', 'request_id': 'req-fb4450ea-c6b6-4f0a-8be7-e2dd0bbd4abf'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:36.743784 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f140e-cbe0-4027-950e-592fee0889ae admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:36.744745 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fb4450ea-c6b6-4f0a-8be7-e2dd0bbd4abf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ada8e3ede4f14d33b1adb62b804c16fd', 'request_id': 'req-fb4450ea-c6b6-4f0a-8be7-e2dd0bbd4abf'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:36.762211 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fb4450ea-c6b6-4f0a-8be7-e2dd0bbd4abf admin admin] The token cache is being invalidate because project ada8e3ede4f14d33b1adb62b804c16fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:45:36.762656 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fb4450ea-c6b6-4f0a-8be7-e2dd0bbd4abf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:36.763662 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fb4450ea-c6b6-4f0a-8be7-e2dd0bbd4abf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:36.766576 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 971/1931] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:45:36 2022] DELETE /identity/v3/projects/ada8e3ede4f14d33b1adb62b804c16fd => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:36.766779 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4450ea-c6b6-4f0a-8be7-e2dd0bbd4abf admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:36.768877 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-fb4450ea-c6b6-4f0a-8be7-e2dd0bbd4abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:36.775240 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:36.820011 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8ad42-c3d4-430e-b129-618e94ce27c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:36.820781 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8ad42-c3d4-430e-b129-618e94ce27c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:36.821070 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8ad42-c3d4-430e-b129-618e94ce27c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:36.821340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8ad42-c3d4-430e-b129-618e94ce27c3 admin admin] PATH_INFO: `/v3/users/d88e72bab10842c9b86f527c8623cd53` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:36.822598 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8ad42-c3d4-430e-b129-618e94ce27c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d88e72bab10842c9b86f527c8623cd53)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:36.824604 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8ad42-c3d4-430e-b129-618e94ce27c3 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:36.847820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4450ea-c6b6-4f0a-8be7-e2dd0bbd4abf admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:36.855350 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5ad1b-3c6d-4374-b00f-4bb7d6595b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:36.856410 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5ad1b-3c6d-4374-b00f-4bb7d6595b6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:36.856909 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5ad1b-3c6d-4374-b00f-4bb7d6595b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:36.857262 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5ad1b-3c6d-4374-b00f-4bb7d6595b6a admin admin] PATH_INFO: `/v3/projects/74d5a642d1114f39bb1ce3513c249cae/users/847db1e94f3e43c8824540e4893815fa/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:36.878392 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5ad1b-3c6d-4374-b00f-4bb7d6595b6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=74d5a642d1114f39bb1ce3513c249cae, user_id=847db1e94f3e43c8824540e4893815fa, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:36.881282 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5ad1b-3c6d-4374-b00f-4bb7d6595b6a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:36.884338 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c2e8ad42-c3d4-430e-b129-618e94ce27c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd88e72bab10842c9b86f527c8623cd53'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:36.893577 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c2e8ad42-c3d4-430e-b129-618e94ce27c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd88e72bab10842c9b86f527c8623cd53'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:36.897324 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 972/1932] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:36 2022] PUT /identity/v3/projects/74d5a642d1114f39bb1ce3513c249cae/users/847db1e94f3e43c8824540e4893815fa/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:36.898265 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5ad1b-3c6d-4374-b00f-4bb7d6595b6a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:36.899973 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1fc5ad1b-3c6d-4374-b00f-4bb7d6595b6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:36.910827 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c2e8ad42-c3d4-430e-b129-618e94ce27c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd88e72bab10842c9b86f527c8623cd53'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:36.911756 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c2e8ad42-c3d4-430e-b129-618e94ce27c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd88e72bab10842c9b86f527c8623cd53'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:36.923233 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c2e8ad42-c3d4-430e-b129-618e94ce27c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd88e72bab10842c9b86f527c8623cd53'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:36.936794 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 961/1933] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:45:36 2022] DELETE /identity/v3/users/d88e72bab10842c9b86f527c8623cd53 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:36.936794 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e3e70-fd76-4f4a-99bd-5ef83f6e9bb5 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:36.936794 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e3e70-fd76-4f4a-99bd-5ef83f6e9bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:36.936794 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e3e70-fd76-4f4a-99bd-5ef83f6e9bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:36.962079 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-034e3e70-fd76-4f4a-99bd-5ef83f6e9bb5 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:36.964237 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-034e3e70-fd76-4f4a-99bd-5ef83f6e9bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:36.979183 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:36.986657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5ad1b-3c6d-4374-b00f-4bb7d6595b6a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:37.086085 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b612a-c618-4b21-b244-0887bb6faab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:37.086946 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b612a-c618-4b21-b244-0887bb6faab2 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:37.087225 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b612a-c618-4b21-b244-0887bb6faab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:37.087557 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b612a-c618-4b21-b244-0887bb6faab2 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:37.088243 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b612a-c618-4b21-b244-0887bb6faab2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:37.090327 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b612a-c618-4b21-b244-0887bb6faab2 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:37.127821 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 962/1934] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:37.127821 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e3e70-fd76-4f4a-99bd-5ef83f6e9bb5 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:37.127821 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-034e3e70-fd76-4f4a-99bd-5ef83f6e9bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:37.134465 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 973/1935] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:45:36 2022] POST /identity/v3/users => generated 294 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:37.136272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b612a-c618-4b21-b244-0887bb6faab2 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:37.139258 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b90b612a-c618-4b21-b244-0887bb6faab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:37.146416 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e3e70-fd76-4f4a-99bd-5ef83f6e9bb5 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:37.153587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b612a-c618-4b21-b244-0887bb6faab2 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:37.157558 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292d7b5-4bce-4443-bddf-5ebb9af3f591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:37.158404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292d7b5-4bce-4443-bddf-5ebb9af3f591 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:37.158903 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292d7b5-4bce-4443-bddf-5ebb9af3f591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:37.159302 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292d7b5-4bce-4443-bddf-5ebb9af3f591 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:37.160665 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292d7b5-4bce-4443-bddf-5ebb9af3f591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:37.163852 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292d7b5-4bce-4443-bddf-5ebb9af3f591 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:37.166678 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770bbe5-23c9-4b17-bd8a-9b9dcaacb979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:37.168098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770bbe5-23c9-4b17-bd8a-9b9dcaacb979 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:37.168512 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770bbe5-23c9-4b17-bd8a-9b9dcaacb979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:37.168668 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770bbe5-23c9-4b17-bd8a-9b9dcaacb979 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:37.171498 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770bbe5-23c9-4b17-bd8a-9b9dcaacb979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:37.175690 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770bbe5-23c9-4b17-bd8a-9b9dcaacb979 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:37.187595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 963/1936] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:37.187595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321c480-d744-467c-ad1e-68223a45870b None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:37.187595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321c480-d744-467c-ad1e-68223a45870b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:37.187595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321c480-d744-467c-ad1e-68223a45870b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:37.196716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 974/1937] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:45:37.197374 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770bbe5-23c9-4b17-bd8a-9b9dcaacb979 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:37.210487 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770bbe5-23c9-4b17-bd8a-9b9dcaacb979 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:37.217716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3ef22-8855-41e5-a885-a286de354978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:37.219187 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3ef22-8855-41e5-a885-a286de354978 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:37.219670 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3ef22-8855-41e5-a885-a286de354978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:37.220282 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a3ef22-8855-41e5-a885-a286de354978 admin admin] PATH_INFO: `/v3/projects/74d5a642d1114f39bb1ce3513c249cae/users/847db1e94f3e43c8824540e4893815fa/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:37.222809 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3ef22-8855-41e5-a885-a286de354978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74d5a642d1114f39bb1ce3513c249cae, user_id=847db1e94f3e43c8824540e4893815fa, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:37.226091 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a3ef22-8855-41e5-a885-a286de354978 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:37.233815 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-d321c480-d744-467c-ad1e-68223a45870b None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:37.234619 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:37.236386 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d321c480-d744-467c-ad1e-68223a45870b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:37.245873 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 975/1938] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:37 2022] PUT /identity/v3/projects/74d5a642d1114f39bb1ce3513c249cae/users/847db1e94f3e43c8824540e4893815fa/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:37.247097 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3ef22-8855-41e5-a885-a286de354978 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:37.380091 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 964/1939] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:37.380996 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e8526-4882-4e5f-8296-aec1c6b0acfe None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:37.381459 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e8526-4882-4e5f-8296-aec1c6b0acfe None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:37.381744 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e8526-4882-4e5f-8296-aec1c6b0acfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:37.436254 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-ca3e8526-4882-4e5f-8296-aec1c6b0acfe None None] MFA Rules not processed for user `847db1e94f3e43c8824540e4893815fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:37.441381 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ca3e8526-4882-4e5f-8296-aec1c6b0acfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:37.452731 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a3ef22-8855-41e5-a885-a286de354978 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:37.472951 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378c627-7a26-4ec6-9857-c1414e71b726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:37.473998 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378c627-7a26-4ec6-9857-c1414e71b726 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:37.474961 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378c627-7a26-4ec6-9857-c1414e71b726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:37.475372 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378c627-7a26-4ec6-9857-c1414e71b726 admin admin] PATH_INFO: `/v3/projects/6d83be6d7aa341e9b994ea438b6e2a69/users/9b2cf1a409724835a2305664d4adac6a/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:37.499278 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378c627-7a26-4ec6-9857-c1414e71b726 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d83be6d7aa341e9b994ea438b6e2a69, user_id=9b2cf1a409724835a2305664d4adac6a, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:37.503674 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378c627-7a26-4ec6-9857-c1414e71b726 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:37.537944 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 976/1940] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:37 2022] PUT /identity/v3/projects/6d83be6d7aa341e9b994ea438b6e2a69/users/9b2cf1a409724835a2305664d4adac6a/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:37.539352 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378c627-7a26-4ec6-9857-c1414e71b726 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:37.562339 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 965/1941] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:37.563360 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e8526-4882-4e5f-8296-aec1c6b0acfe None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:37.575579 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e8526-4882-4e5f-8296-aec1c6b0acfe None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:37.619827 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:37.693576 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378c627-7a26-4ec6-9857-c1414e71b726 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:37.704110 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ee801-d7e2-4dfe-816d-19cd4d8d7a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:37.704790 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ee801-d7e2-4dfe-816d-19cd4d8d7a59 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:37.705076 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ee801-d7e2-4dfe-816d-19cd4d8d7a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:37.709833 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ee801-d7e2-4dfe-816d-19cd4d8d7a59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:37.710593 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ee801-d7e2-4dfe-816d-19cd4d8d7a59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:45:37.710900 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ee801-d7e2-4dfe-816d-19cd4d8d7a59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:37.719793 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ee801-d7e2-4dfe-816d-19cd4d8d7a59 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:37.725343 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03866db8-535e-465a-9f13-d24510191496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:37.726005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03866db8-535e-465a-9f13-d24510191496 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:37.726255 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03866db8-535e-465a-9f13-d24510191496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:37.726529 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03866db8-535e-465a-9f13-d24510191496 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:37.727194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03866db8-535e-465a-9f13-d24510191496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:37.729927 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03866db8-535e-465a-9f13-d24510191496 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:37.757083 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 966/1942] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:37.757083 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03866db8-535e-465a-9f13-d24510191496 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:37.760904 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-03866db8-535e-465a-9f13-d24510191496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:37.802497 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 977/1943] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:45:37.807348 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ee801-d7e2-4dfe-816d-19cd4d8d7a59 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:37.825567 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ca5ee801-d7e2-4dfe-816d-19cd4d8d7a59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:37.884598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ee801-d7e2-4dfe-816d-19cd4d8d7a59 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:37.899958 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96c367-ee68-442e-9b34-385664ccee55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:37.901320 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96c367-ee68-442e-9b34-385664ccee55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:37.901953 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96c367-ee68-442e-9b34-385664ccee55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:37.902597 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96c367-ee68-442e-9b34-385664ccee55 admin admin] PATH_INFO: `/v3/projects/fd185b62dcff4bf6802d83f92908bd1a` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:37.909719 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c96c367-ee68-442e-9b34-385664ccee55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd185b62dcff4bf6802d83f92908bd1a)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:37.912783 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c96c367-ee68-442e-9b34-385664ccee55 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:37.941859 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03866db8-535e-465a-9f13-d24510191496 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:37.950410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a4375-7369-498b-bea4-d758af83f4dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:37.951947 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a4375-7369-498b-bea4-d758af83f4dd service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:37.952653 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a4375-7369-498b-bea4-d758af83f4dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:37.953336 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a4375-7369-498b-bea4-d758af83f4dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:38.098591 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1c96c367-ee68-442e-9b34-385664ccee55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd185b62dcff4bf6802d83f92908bd1a', 'request_id': 'req-1c96c367-ee68-442e-9b34-385664ccee55'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:38.111537 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a4375-7369-498b-bea4-d758af83f4dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:38.113801 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a4375-7369-498b-bea4-d758af83f4dd service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:38.127340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 967/1944] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:37 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:45:38.127340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a4375-7369-498b-bea4-d758af83f4dd service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:38.137504 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1c96c367-ee68-442e-9b34-385664ccee55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd185b62dcff4bf6802d83f92908bd1a', 'request_id': 'req-1c96c367-ee68-442e-9b34-385664ccee55'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:38.149773 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a4375-7369-498b-bea4-d758af83f4dd service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:38.174213 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1c96c367-ee68-442e-9b34-385664ccee55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd185b62dcff4bf6802d83f92908bd1a', 'request_id': 'req-1c96c367-ee68-442e-9b34-385664ccee55'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:38.188783 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:38.200877 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1c96c367-ee68-442e-9b34-385664ccee55 admin admin] The token cache is being invalidate because project fd185b62dcff4bf6802d83f92908bd1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:45:38.204270 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1c96c367-ee68-442e-9b34-385664ccee55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:38.207307 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1c96c367-ee68-442e-9b34-385664ccee55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:38.210911 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 978/1945] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:45:37 2022] DELETE /identity/v3/projects/fd185b62dcff4bf6802d83f92908bd1a => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:38.216908 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96c367-ee68-442e-9b34-385664ccee55 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:38.218896 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1c96c367-ee68-442e-9b34-385664ccee55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:38.288579 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d612fd-8073-49f1-b750-8c913f670fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:38.289416 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d612fd-8073-49f1-b750-8c913f670fb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:38.290530 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d612fd-8073-49f1-b750-8c913f670fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:38.290720 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d612fd-8073-49f1-b750-8c913f670fb5 admin admin] PATH_INFO: `/v3/projects/6d83be6d7aa341e9b994ea438b6e2a69/users/9b2cf1a409724835a2305664d4adac6a/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:38.293791 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d612fd-8073-49f1-b750-8c913f670fb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d83be6d7aa341e9b994ea438b6e2a69, user_id=9b2cf1a409724835a2305664d4adac6a, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:38.301593 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d612fd-8073-49f1-b750-8c913f670fb5 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:38.322721 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 968/1946] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:38 2022] PUT /identity/v3/projects/6d83be6d7aa341e9b994ea438b6e2a69/users/9b2cf1a409724835a2305664d4adac6a/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:38.327474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d612fd-8073-49f1-b750-8c913f670fb5 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:38.333729 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-56d612fd-8073-49f1-b750-8c913f670fb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:38.353892 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96c367-ee68-442e-9b34-385664ccee55 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:38.355837 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:38.495048 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef3440-c5c5-49ed-9ff0-f1bd79d11cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:38.498713 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef3440-c5c5-49ed-9ff0-f1bd79d11cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:38.499147 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef3440-c5c5-49ed-9ff0-f1bd79d11cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:38.499470 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef3440-c5c5-49ed-9ff0-f1bd79d11cf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:38.500513 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef3440-c5c5-49ed-9ff0-f1bd79d11cf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:38.502590 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef3440-c5c5-49ed-9ff0-f1bd79d11cf1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:38.504513 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d612fd-8073-49f1-b750-8c913f670fb5 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:38.523864 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13f0ea5-f095-4411-a02c-99d84a953d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:38.536968 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f0ea5-f095-4411-a02c-99d84a953d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:38.537480 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f0ea5-f095-4411-a02c-99d84a953d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:38.538623 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13f0ea5-f095-4411-a02c-99d84a953d2d admin admin] PATH_INFO: `/v3/users/dc0b5e5f44334e5dae49dbf92cef2403` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:38.541805 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f0ea5-f095-4411-a02c-99d84a953d2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc0b5e5f44334e5dae49dbf92cef2403)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:38.545366 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13f0ea5-f095-4411-a02c-99d84a953d2d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:38.581069 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 979/1947] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:45:38 2022] POST /identity/v3/projects => generated 369 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:38.582485 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef3440-c5c5-49ed-9ff0-f1bd79d11cf1 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:38.590718 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-aeef3440-c5c5-49ed-9ff0-f1bd79d11cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:38.629194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c13f0ea5-f095-4411-a02c-99d84a953d2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc0b5e5f44334e5dae49dbf92cef2403'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:38.642484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c13f0ea5-f095-4411-a02c-99d84a953d2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc0b5e5f44334e5dae49dbf92cef2403'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:38.658275 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c13f0ea5-f095-4411-a02c-99d84a953d2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc0b5e5f44334e5dae49dbf92cef2403'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:38.659047 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c13f0ea5-f095-4411-a02c-99d84a953d2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc0b5e5f44334e5dae49dbf92cef2403'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:38.668721 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-c13f0ea5-f095-4411-a02c-99d84a953d2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc0b5e5f44334e5dae49dbf92cef2403'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:38.677586 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 969/1948] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:45:38 2022] DELETE /identity/v3/users/dc0b5e5f44334e5dae49dbf92cef2403 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:38.679654 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54395a-ee8b-4b4a-8439-b91d98c0c6d6 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:38.680487 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54395a-ee8b-4b4a-8439-b91d98c0c6d6 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:38.680943 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54395a-ee8b-4b4a-8439-b91d98c0c6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:38.738158 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef3440-c5c5-49ed-9ff0-f1bd79d11cf1 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:38.741731 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-1a54395a-ee8b-4b4a-8439-b91d98c0c6d6 None None] MFA Rules not processed for user `9b2cf1a409724835a2305664d4adac6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:38.745101 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1a54395a-ee8b-4b4a-8439-b91d98c0c6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:38.812683 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:38.852992 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f489c61-fb7c-40ca-94a1-ebbe43a1f0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:38.854250 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f489c61-fb7c-40ca-94a1-ebbe43a1f0b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:38.854863 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f489c61-fb7c-40ca-94a1-ebbe43a1f0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:38.855409 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f489c61-fb7c-40ca-94a1-ebbe43a1f0b8 admin admin] PATH_INFO: `/v3/users/e38ff7d39a3346d0b6f4d6339812a573` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:38.858248 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f489c61-fb7c-40ca-94a1-ebbe43a1f0b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e38ff7d39a3346d0b6f4d6339812a573)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:38.863977 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f489c61-fb7c-40ca-94a1-ebbe43a1f0b8 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:38.865973 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 970/1949] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:38.867174 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54395a-ee8b-4b4a-8439-b91d98c0c6d6 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:38.872904 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1a54395a-ee8b-4b4a-8439-b91d98c0c6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:38.889781 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54395a-ee8b-4b4a-8439-b91d98c0c6d6 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:38.896064 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591c821-b1e5-4a0e-bf39-79f738e6f815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:38.897045 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591c821-b1e5-4a0e-bf39-79f738e6f815 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:38.897315 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591c821-b1e5-4a0e-bf39-79f738e6f815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:38.897588 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591c821-b1e5-4a0e-bf39-79f738e6f815 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:38.898309 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591c821-b1e5-4a0e-bf39-79f738e6f815 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:38.900344 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591c821-b1e5-4a0e-bf39-79f738e6f815 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:38.916270 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:38.938714 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 971/1950] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:45:38 2022] POST /identity/v3/users => generated 285 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:38.941956 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591c821-b1e5-4a0e-bf39-79f738e6f815 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:38.945024 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5591c821-b1e5-4a0e-bf39-79f738e6f815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:38.964109 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1f489c61-fb7c-40ca-94a1-ebbe43a1f0b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e38ff7d39a3346d0b6f4d6339812a573'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:38.977645 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1f489c61-fb7c-40ca-94a1-ebbe43a1f0b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e38ff7d39a3346d0b6f4d6339812a573'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:38.978716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1f489c61-fb7c-40ca-94a1-ebbe43a1f0b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e38ff7d39a3346d0b6f4d6339812a573'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:39.001885 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1f489c61-fb7c-40ca-94a1-ebbe43a1f0b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e38ff7d39a3346d0b6f4d6339812a573'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:39.018317 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1f489c61-fb7c-40ca-94a1-ebbe43a1f0b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e38ff7d39a3346d0b6f4d6339812a573'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:39.024692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591c821-b1e5-4a0e-bf39-79f738e6f815 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:39.030074 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd05250-f10f-4f03-8a6a-0b7305bcb51b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:39.030392 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 980/1951] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:45:38 2022] DELETE /identity/v3/users/e38ff7d39a3346d0b6f4d6339812a573 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:39.030888 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd05250-f10f-4f03-8a6a-0b7305bcb51b service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:39.031179 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd05250-f10f-4f03-8a6a-0b7305bcb51b service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:39.031456 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd05250-f10f-4f03-8a6a-0b7305bcb51b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:39.031634 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f489c61-fb7c-40ca-94a1-ebbe43a1f0b8 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:39.033953 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1bd05250-f10f-4f03-8a6a-0b7305bcb51b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:39.034697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1f489c61-fb7c-40ca-94a1-ebbe43a1f0b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:39.127787 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd05250-f10f-4f03-8a6a-0b7305bcb51b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:39.129245 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd05250-f10f-4f03-8a6a-0b7305bcb51b service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:39.144413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 972/1952] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:45:39.146835 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb30d7d-c537-4232-8b4b-4f684f878c29 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:39.147387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb30d7d-c537-4232-8b4b-4f684f878c29 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:39.147974 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb30d7d-c537-4232-8b4b-4f684f878c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:39.191347 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-6eb30d7d-c537-4232-8b4b-4f684f878c29 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:39.192761 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f489c61-fb7c-40ca-94a1-ebbe43a1f0b8 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:39.195464 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-6eb30d7d-c537-4232-8b4b-4f684f878c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:39.197925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a723f7c-8f22-4503-ae61-535a0cf52707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:39.198796 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a723f7c-8f22-4503-ae61-535a0cf52707 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:39.199076 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a723f7c-8f22-4503-ae61-535a0cf52707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:39.199352 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a723f7c-8f22-4503-ae61-535a0cf52707 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:39.200389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a723f7c-8f22-4503-ae61-535a0cf52707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:39.203321 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a723f7c-8f22-4503-ae61-535a0cf52707 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:39.213501 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 973/1953] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:39.216012 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb30d7d-c537-4232-8b4b-4f684f878c29 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:39.218660 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-6eb30d7d-c537-4232-8b4b-4f684f878c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:39.237608 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb30d7d-c537-4232-8b4b-4f684f878c29 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:39.241293 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 981/1954] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:39.242652 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a723f7c-8f22-4503-ae61-535a0cf52707 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:39.246380 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fa118-3f9e-48bc-9678-976c6da2322d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:39.250461 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fa118-3f9e-48bc-9678-976c6da2322d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:39.251329 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fa118-3f9e-48bc-9678-976c6da2322d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:39.251518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4a723f7c-8f22-4503-ae61-535a0cf52707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:39.252332 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fa118-3f9e-48bc-9678-976c6da2322d admin admin] PATH_INFO: `/v3/projects/0b68ad1efef44e07848418b97cc031de` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:39.260647 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fa118-3f9e-48bc-9678-976c6da2322d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b68ad1efef44e07848418b97cc031de)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:39.262931 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fa118-3f9e-48bc-9678-976c6da2322d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:39.358949 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a723f7c-8f22-4503-ae61-535a0cf52707 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:39.371164 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:39.386716 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-748fa118-3f9e-48bc-9678-976c6da2322d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b68ad1efef44e07848418b97cc031de', 'request_id': 'req-748fa118-3f9e-48bc-9678-976c6da2322d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:39.417052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-748fa118-3f9e-48bc-9678-976c6da2322d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b68ad1efef44e07848418b97cc031de', 'request_id': 'req-748fa118-3f9e-48bc-9678-976c6da2322d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:39.442462 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-748fa118-3f9e-48bc-9678-976c6da2322d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b68ad1efef44e07848418b97cc031de', 'request_id': 'req-748fa118-3f9e-48bc-9678-976c6da2322d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:39.465448 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce700c-cc23-4585-923a-9bfb8a5c5929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:39.466250 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce700c-cc23-4585-923a-9bfb8a5c5929 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:39.466629 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce700c-cc23-4585-923a-9bfb8a5c5929 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:39.469826 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce700c-cc23-4585-923a-9bfb8a5c5929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:39.489798 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-748fa118-3f9e-48bc-9678-976c6da2322d admin admin] The token cache is being invalidate because project 0b68ad1efef44e07848418b97cc031de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:45:39.490078 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-748fa118-3f9e-48bc-9678-976c6da2322d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:39.495201 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-748fa118-3f9e-48bc-9678-976c6da2322d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:39.497184 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 974/1955] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:45:39 2022] DELETE /identity/v3/projects/0b68ad1efef44e07848418b97cc031de => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:39.502025 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fa118-3f9e-48bc-9678-976c6da2322d admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:39.503558 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-748fa118-3f9e-48bc-9678-976c6da2322d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:39.561366 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:39.621669 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ce700c-cc23-4585-923a-9bfb8a5c5929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:39.623460 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ce700c-cc23-4585-923a-9bfb8a5c5929 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:39.647906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fa118-3f9e-48bc-9678-976c6da2322d admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:39.655537 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921795f-aedc-4f12-b7a9-64dac1b4f247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:39.656235 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921795f-aedc-4f12-b7a9-64dac1b4f247 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:39.656527 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921795f-aedc-4f12-b7a9-64dac1b4f247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:39.656776 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921795f-aedc-4f12-b7a9-64dac1b4f247 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:39.656933 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 982/1956] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:45:39.657581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921795f-aedc-4f12-b7a9-64dac1b4f247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:39.659254 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921795f-aedc-4f12-b7a9-64dac1b4f247 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:39.678490 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad2486-a8fc-4d15-b36d-b6f38c303ce9 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:39.678826 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad2486-a8fc-4d15-b36d-b6f38c303ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:39.679076 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad2486-a8fc-4d15-b36d-b6f38c303ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:39.693628 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 975/1957] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:39.729864 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921795f-aedc-4f12-b7a9-64dac1b4f247 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:39.740427 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-5aad2486-a8fc-4d15-b36d-b6f38c303ce9 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:39.743561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5aad2486-a8fc-4d15-b36d-b6f38c303ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:39.763021 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921795f-aedc-4f12-b7a9-64dac1b4f247 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:39.777870 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 983/1958] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:39.778949 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79f152-8ba9-4f9c-b570-d8faa8603acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:39.779675 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79f152-8ba9-4f9c-b570-d8faa8603acb admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:39.781470 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791bc2d-bd93-4850-8a6d-29e9a1690288 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:39.782046 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791bc2d-bd93-4850-8a6d-29e9a1690288 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:39.782525 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79f152-8ba9-4f9c-b570-d8faa8603acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:39.782646 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791bc2d-bd93-4850-8a6d-29e9a1690288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:39.782821 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79f152-8ba9-4f9c-b570-d8faa8603acb admin admin] PATH_INFO: `/v3/projects/1d7c1d0377784591b9b75455b9e5df39/users/23bb328c6c374eed88aeda09fb3b35cc/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:39.824563 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f79f152-8ba9-4f9c-b570-d8faa8603acb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d7c1d0377784591b9b75455b9e5df39, user_id=23bb328c6c374eed88aeda09fb3b35cc, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:39.829909 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f79f152-8ba9-4f9c-b570-d8faa8603acb admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:39.861532 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-5791bc2d-bd93-4850-8a6d-29e9a1690288 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:39.866199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 976/1959] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:39 2022] PUT /identity/v3/projects/1d7c1d0377784591b9b75455b9e5df39/users/23bb328c6c374eed88aeda09fb3b35cc/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:39.873243 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5791bc2d-bd93-4850-8a6d-29e9a1690288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:39.891386 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0540e1-abab-4412-af53-e7f3b57a0c0e None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:39.891936 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0540e1-abab-4412-af53-e7f3b57a0c0e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:39.892421 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0540e1-abab-4412-af53-e7f3b57a0c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:39.986902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-ec0540e1-abab-4412-af53-e7f3b57a0c0e None None] MFA Rules not processed for user `23bb328c6c374eed88aeda09fb3b35cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:39.993688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ec0540e1-abab-4412-af53-e7f3b57a0c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:40.135356 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 977/1960] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:40.140349 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0540e1-abab-4412-af53-e7f3b57a0c0e None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:40.183819 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 984/1961] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:40.192296 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791bc2d-bd93-4850-8a6d-29e9a1690288 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:40.225439 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5791bc2d-bd93-4850-8a6d-29e9a1690288 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:40.238059 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2caf626-aed0-4a02-809c-9c6bad3c7cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:40.239493 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2caf626-aed0-4a02-809c-9c6bad3c7cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:40.240098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2caf626-aed0-4a02-809c-9c6bad3c7cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:40.242274 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2caf626-aed0-4a02-809c-9c6bad3c7cc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:40.244513 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2caf626-aed0-4a02-809c-9c6bad3c7cc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:45:40.245334 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2caf626-aed0-4a02-809c-9c6bad3c7cc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:40.249009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2caf626-aed0-4a02-809c-9c6bad3c7cc8 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:40.290826 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 985/1962] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:45:40.295234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2caf626-aed0-4a02-809c-9c6bad3c7cc8 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:40.306427 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2caf626-aed0-4a02-809c-9c6bad3c7cc8 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:40.311999 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581f6eb-0826-4015-95c4-97a9844c290e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:40.312649 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581f6eb-0826-4015-95c4-97a9844c290e admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:40.312931 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581f6eb-0826-4015-95c4-97a9844c290e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:40.313205 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581f6eb-0826-4015-95c4-97a9844c290e admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:40.313888 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581f6eb-0826-4015-95c4-97a9844c290e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:40.321683 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581f6eb-0826-4015-95c4-97a9844c290e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:40.374410 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 986/1963] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:45:40 2022] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:40.374667 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0540e1-abab-4412-af53-e7f3b57a0c0e None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:40.376144 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581f6eb-0826-4015-95c4-97a9844c290e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:40.431342 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:40.447074 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:40.513923 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a238be-10b9-4833-9b86-f89dcedda658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:40.514602 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a238be-10b9-4833-9b86-f89dcedda658 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:40.516753 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a238be-10b9-4833-9b86-f89dcedda658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:40.517532 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a238be-10b9-4833-9b86-f89dcedda658 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:40.518309 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a238be-10b9-4833-9b86-f89dcedda658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:40.520472 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a238be-10b9-4833-9b86-f89dcedda658 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:40.608479 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581f6eb-0826-4015-95c4-97a9844c290e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:40.645952 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf42f1-2e48-4e76-bf0c-00d3bdc7ad99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:40.678853 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf42f1-2e48-4e76-bf0c-00d3bdc7ad99 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:40.679338 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf42f1-2e48-4e76-bf0c-00d3bdc7ad99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:40.679622 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf42f1-2e48-4e76-bf0c-00d3bdc7ad99 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:40.680713 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 978/1964] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:45:40 2022] POST /identity/v3/projects => generated 369 bytes in 541 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:45:40.683488 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf42f1-2e48-4e76-bf0c-00d3bdc7ad99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:40.685284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a238be-10b9-4833-9b86-f89dcedda658 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:40.685752 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf42f1-2e48-4e76-bf0c-00d3bdc7ad99 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:40.782482 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 987/1965] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:45:40 2022] POST /identity/v3/users => generated 286 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:45:40.783861 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf42f1-2e48-4e76-bf0c-00d3bdc7ad99 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:40.817452 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf42f1-2e48-4e76-bf0c-00d3bdc7ad99 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:40.901595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a238be-10b9-4833-9b86-f89dcedda658 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:40.926608 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b311e-4636-48aa-b7e2-7a1f20cbabb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:40.927247 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b311e-4636-48aa-b7e2-7a1f20cbabb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:40.927533 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b311e-4636-48aa-b7e2-7a1f20cbabb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:40.927930 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b311e-4636-48aa-b7e2-7a1f20cbabb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:40.928767 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b311e-4636-48aa-b7e2-7a1f20cbabb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:40.931172 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b311e-4636-48aa-b7e2-7a1f20cbabb6 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:40.985789 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 979/1966] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:45:40 2022] POST /identity/v3/users => generated 291 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:40.997327 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b311e-4636-48aa-b7e2-7a1f20cbabb6 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:41.006804 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afa8ee-6759-4631-a470-5017e7ae6922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:41.007600 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afa8ee-6759-4631-a470-5017e7ae6922 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:41.008008 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afa8ee-6759-4631-a470-5017e7ae6922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:41.008380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afa8ee-6759-4631-a470-5017e7ae6922 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:41.009155 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afa8ee-6759-4631-a470-5017e7ae6922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:41.011316 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afa8ee-6759-4631-a470-5017e7ae6922 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:41.026898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 988/1967] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:45:41.038658 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afa8ee-6759-4631-a470-5017e7ae6922 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:41.051482 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afa8ee-6759-4631-a470-5017e7ae6922 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:41.053898 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b311e-4636-48aa-b7e2-7a1f20cbabb6 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:41.058795 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a52cd-259d-4c82-bb5a-4c187157850a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:41.059839 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a52cd-259d-4c82-bb5a-4c187157850a admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:41.060346 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a52cd-259d-4c82-bb5a-4c187157850a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:41.060863 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a52cd-259d-4c82-bb5a-4c187157850a admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:41.062454 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a52cd-259d-4c82-bb5a-4c187157850a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:41.065192 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05cb7b-18b0-41a1-9b19-e825fee6024f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:41.065438 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581a52cd-259d-4c82-bb5a-4c187157850a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:41.066230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05cb7b-18b0-41a1-9b19-e825fee6024f admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:41.066673 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05cb7b-18b0-41a1-9b19-e825fee6024f admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:41.067103 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05cb7b-18b0-41a1-9b19-e825fee6024f admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:41.068636 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05cb7b-18b0-41a1-9b19-e825fee6024f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:41.071947 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05cb7b-18b0-41a1-9b19-e825fee6024f admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:41.082019 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 989/1968] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:45:41.089624 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a52cd-259d-4c82-bb5a-4c187157850a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:41.096816 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 980/1969] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:41.101829 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05cb7b-18b0-41a1-9b19-e825fee6024f admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:41.116545 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a52cd-259d-4c82-bb5a-4c187157850a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:41.120051 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05cb7b-18b0-41a1-9b19-e825fee6024f admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:41.125993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391ac65-2bb0-4c43-b43c-28df5fdc6265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:41.127339 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391ac65-2bb0-4c43-b43c-28df5fdc6265 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:41.128202 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391ac65-2bb0-4c43-b43c-28df5fdc6265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:41.128766 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391ac65-2bb0-4c43-b43c-28df5fdc6265 admin admin] PATH_INFO: `/v3/projects/2110ac49bfef4ae1a2852cb68416806c/users/867510e21fed4ac68228500d540081e5/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:41.130252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6acf064-c784-4cb4-8071-15fd43175419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:41.131058 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acf064-c784-4cb4-8071-15fd43175419 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:41.131444 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acf064-c784-4cb4-8071-15fd43175419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:41.131849 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acf064-c784-4cb4-8071-15fd43175419 admin admin] PATH_INFO: `/v3/projects/53edc44e1dc04e0badd395ebbb30cda5/users/91df20604174463588342cb4eb1397f6/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:41.159905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6acf064-c784-4cb4-8071-15fd43175419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53edc44e1dc04e0badd395ebbb30cda5, user_id=91df20604174463588342cb4eb1397f6, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:41.163383 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6acf064-c784-4cb4-8071-15fd43175419 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:41.176040 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391ac65-2bb0-4c43-b43c-28df5fdc6265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2110ac49bfef4ae1a2852cb68416806c, user_id=867510e21fed4ac68228500d540081e5, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:41.184097 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391ac65-2bb0-4c43-b43c-28df5fdc6265 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:41.189871 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 981/1970] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:41 2022] PUT /identity/v3/projects/53edc44e1dc04e0badd395ebbb30cda5/users/91df20604174463588342cb4eb1397f6/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:41.192697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6acf064-c784-4cb4-8071-15fd43175419 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:41.204303 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d6acf064-c784-4cb4-8071-15fd43175419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:41.223841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 990/1971] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:41 2022] PUT /identity/v3/projects/2110ac49bfef4ae1a2852cb68416806c/users/867510e21fed4ac68228500d540081e5/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:41.226973 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391ac65-2bb0-4c43-b43c-28df5fdc6265 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:41.354187 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6acf064-c784-4cb4-8071-15fd43175419 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:41.404514 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:41.436354 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391ac65-2bb0-4c43-b43c-28df5fdc6265 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:41.442739 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afde8e-a2ae-43f0-b7e8-ddf3514aa15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:41.443419 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afde8e-a2ae-43f0-b7e8-ddf3514aa15f admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:41.443692 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afde8e-a2ae-43f0-b7e8-ddf3514aa15f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:41.443996 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afde8e-a2ae-43f0-b7e8-ddf3514aa15f admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:41.444870 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afde8e-a2ae-43f0-b7e8-ddf3514aa15f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:41.447557 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afde8e-a2ae-43f0-b7e8-ddf3514aa15f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:41.462645 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 991/1972] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:41.464998 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e053a5-8ae5-4da3-a22e-593b79a4acaf None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:41.464998 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e053a5-8ae5-4da3-a22e-593b79a4acaf None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:41.464998 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e053a5-8ae5-4da3-a22e-593b79a4acaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:41.476056 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:41.494596 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-31e053a5-8ae5-4da3-a22e-593b79a4acaf None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:41.495967 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-31e053a5-8ae5-4da3-a22e-593b79a4acaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:41.505963 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 992/1973] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:41.506427 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e54378-acba-4e0f-a4a6-89d82a91d434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:41.507090 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e053a5-8ae5-4da3-a22e-593b79a4acaf None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:41.507646 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e54378-acba-4e0f-a4a6-89d82a91d434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:41.508133 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e54378-acba-4e0f-a4a6-89d82a91d434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:41.509249 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e54378-acba-4e0f-a4a6-89d82a91d434 admin admin] PATH_INFO: `/v3/projects/81c276a9500946cdba4d270d640ba3e6` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:41.511871 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e54378-acba-4e0f-a4a6-89d82a91d434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81c276a9500946cdba4d270d640ba3e6)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:41.515237 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e54378-acba-4e0f-a4a6-89d82a91d434 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:41.527080 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e053a5-8ae5-4da3-a22e-593b79a4acaf None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:41.534813 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe2a45-b0aa-488a-af11-14b02411e4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:41.535650 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe2a45-b0aa-488a-af11-14b02411e4a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:41.536030 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe2a45-b0aa-488a-af11-14b02411e4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:41.536378 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe2a45-b0aa-488a-af11-14b02411e4a2 admin admin] PATH_INFO: `/v3/projects/53edc44e1dc04e0badd395ebbb30cda5/users/91df20604174463588342cb4eb1397f6/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:41.538766 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe2a45-b0aa-488a-af11-14b02411e4a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53edc44e1dc04e0badd395ebbb30cda5, user_id=91df20604174463588342cb4eb1397f6, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:41.551911 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe2a45-b0aa-488a-af11-14b02411e4a2 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:41.588667 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-03e54378-acba-4e0f-a4a6-89d82a91d434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81c276a9500946cdba4d270d640ba3e6', 'request_id': 'req-03e54378-acba-4e0f-a4a6-89d82a91d434'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:41.589827 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 993/1974] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:41 2022] PUT /identity/v3/projects/53edc44e1dc04e0badd395ebbb30cda5/users/91df20604174463588342cb4eb1397f6/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:41.590992 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe2a45-b0aa-488a-af11-14b02411e4a2 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:41.598758 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1dfe2a45-b0aa-488a-af11-14b02411e4a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:41.606845 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-03e54378-acba-4e0f-a4a6-89d82a91d434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81c276a9500946cdba4d270d640ba3e6', 'request_id': 'req-03e54378-acba-4e0f-a4a6-89d82a91d434'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:41.620356 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-03e54378-acba-4e0f-a4a6-89d82a91d434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81c276a9500946cdba4d270d640ba3e6', 'request_id': 'req-03e54378-acba-4e0f-a4a6-89d82a91d434'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:41.637074 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-03e54378-acba-4e0f-a4a6-89d82a91d434 admin admin] The token cache is being invalidate because project 81c276a9500946cdba4d270d640ba3e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:45:41.637406 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-03e54378-acba-4e0f-a4a6-89d82a91d434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:41.638177 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-03e54378-acba-4e0f-a4a6-89d82a91d434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:41.644621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 982/1975] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:45:41 2022] DELETE /identity/v3/projects/81c276a9500946cdba4d270d640ba3e6 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:41.644621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a73c1-76cb-439f-b243-7b8f7254e0bb None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:41.644621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a73c1-76cb-439f-b243-7b8f7254e0bb None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:41.644621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a73c1-76cb-439f-b243-7b8f7254e0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:41.691323 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-9c8a73c1-76cb-439f-b243-7b8f7254e0bb None None] MFA Rules not processed for user `91df20604174463588342cb4eb1397f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:41.694124 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-9c8a73c1-76cb-439f-b243-7b8f7254e0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:41.714569 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe2a45-b0aa-488a-af11-14b02411e4a2 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:41.785991 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a50a4-e06a-4535-9b6f-5bb8d81ab702 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:41.787244 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a50a4-e06a-4535-9b6f-5bb8d81ab702 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:41.787529 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a50a4-e06a-4535-9b6f-5bb8d81ab702 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:41.787858 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a50a4-e06a-4535-9b6f-5bb8d81ab702 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:41.789926 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b94a50a4-e06a-4535-9b6f-5bb8d81ab702 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:41.932009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a50a4-e06a-4535-9b6f-5bb8d81ab702 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:41.933783 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a50a4-e06a-4535-9b6f-5bb8d81ab702 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:41.946202 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 983/1976] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:41 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:41.950065 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a73c1-76cb-439f-b243-7b8f7254e0bb None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:41.952768 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 994/1977] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:45:41.954746 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-9c8a73c1-76cb-439f-b243-7b8f7254e0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:41.960392 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a50a4-e06a-4535-9b6f-5bb8d81ab702 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:41.962505 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b94a50a4-e06a-4535-9b6f-5bb8d81ab702 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:42.026069 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a73c1-76cb-439f-b243-7b8f7254e0bb None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:42.056324 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ef88e-3024-446b-bbfa-bdd44a32edbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:42.057368 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ef88e-3024-446b-bbfa-bdd44a32edbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:42.064462 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ef88e-3024-446b-bbfa-bdd44a32edbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:42.066185 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ef88e-3024-446b-bbfa-bdd44a32edbb admin admin] PATH_INFO: `/v3/users/847db1e94f3e43c8824540e4893815fa` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:42.070312 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2ef88e-3024-446b-bbfa-bdd44a32edbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=847db1e94f3e43c8824540e4893815fa)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:42.077822 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a50a4-e06a-4535-9b6f-5bb8d81ab702 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:42.079605 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2ef88e-3024-446b-bbfa-bdd44a32edbb admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:42.085377 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9e174-421e-480b-bdc7-40e0fc61f106 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:42.087279 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9e174-421e-480b-bdc7-40e0fc61f106 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:42.087971 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9e174-421e-480b-bdc7-40e0fc61f106 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:42.088695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9e174-421e-480b-bdc7-40e0fc61f106 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:42.108889 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:42.123410 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9e174-421e-480b-bdc7-40e0fc61f106 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:42.132589 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9e174-421e-480b-bdc7-40e0fc61f106 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:42.142520 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:42.146842 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 995/1978] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:45:42.173731 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1c2ef88e-3024-446b-bbfa-bdd44a32edbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '847db1e94f3e43c8824540e4893815fa'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:42.186920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1c2ef88e-3024-446b-bbfa-bdd44a32edbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '847db1e94f3e43c8824540e4893815fa'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:42.210347 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1c2ef88e-3024-446b-bbfa-bdd44a32edbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '847db1e94f3e43c8824540e4893815fa'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:42.211651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1c2ef88e-3024-446b-bbfa-bdd44a32edbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '847db1e94f3e43c8824540e4893815fa'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:42.221530 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1c2ef88e-3024-446b-bbfa-bdd44a32edbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '847db1e94f3e43c8824540e4893815fa'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:42.229794 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 984/1979] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:45:41 2022] DELETE /identity/v3/users/847db1e94f3e43c8824540e4893815fa => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:42.256574 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9e174-421e-480b-bdc7-40e0fc61f106 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:42.259470 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d0a9e174-421e-480b-bdc7-40e0fc61f106 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:42.282490 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9e174-421e-480b-bdc7-40e0fc61f106 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:42.430699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d5c40-c597-44ef-8c2a-9743e877630f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:42.431680 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d5c40-c597-44ef-8c2a-9743e877630f service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:42.433311 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d5c40-c597-44ef-8c2a-9743e877630f service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:42.433936 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d5c40-c597-44ef-8c2a-9743e877630f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:42.437880 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ac4d5c40-c597-44ef-8c2a-9743e877630f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:42.559529 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d5c40-c597-44ef-8c2a-9743e877630f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:42.562899 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d5c40-c597-44ef-8c2a-9743e877630f service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:42.588595 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 996/1980] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:45:42.804869 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ef88e-3024-446b-bbfa-bdd44a32edbb admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:42.807522 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1c2ef88e-3024-446b-bbfa-bdd44a32edbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:42.836938 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ef88e-3024-446b-bbfa-bdd44a32edbb admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:42.848471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05724a0-edfe-409f-a2c0-3674a66b0d31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:42.849116 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05724a0-edfe-409f-a2c0-3674a66b0d31 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:42.849396 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05724a0-edfe-409f-a2c0-3674a66b0d31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:42.849667 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05724a0-edfe-409f-a2c0-3674a66b0d31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:42.852353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d05724a0-edfe-409f-a2c0-3674a66b0d31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:43.084263 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05724a0-edfe-409f-a2c0-3674a66b0d31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:43.089404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05724a0-edfe-409f-a2c0-3674a66b0d31 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:43.126985 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 985/1981] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:45:43.520537 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d5c40-c597-44ef-8c2a-9743e877630f service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:43.524451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ac4d5c40-c597-44ef-8c2a-9743e877630f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:43.680740 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d5c40-c597-44ef-8c2a-9743e877630f service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:43.689830 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f69e57-f1ec-4bc8-83e7-63fef8de7be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:43.690937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f69e57-f1ec-4bc8-83e7-63fef8de7be1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:43.691566 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f69e57-f1ec-4bc8-83e7-63fef8de7be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:43.691874 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f69e57-f1ec-4bc8-83e7-63fef8de7be1 admin admin] PATH_INFO: `/v3/projects/74d5a642d1114f39bb1ce3513c249cae` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:43.694438 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f69e57-f1ec-4bc8-83e7-63fef8de7be1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74d5a642d1114f39bb1ce3513c249cae)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:43.699050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f69e57-f1ec-4bc8-83e7-63fef8de7be1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:43.863816 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-c2f69e57-f1ec-4bc8-83e7-63fef8de7be1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74d5a642d1114f39bb1ce3513c249cae', 'request_id': 'req-c2f69e57-f1ec-4bc8-83e7-63fef8de7be1'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:43.866879 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:43.879930 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-c2f69e57-f1ec-4bc8-83e7-63fef8de7be1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74d5a642d1114f39bb1ce3513c249cae', 'request_id': 'req-c2f69e57-f1ec-4bc8-83e7-63fef8de7be1'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:43.903360 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-c2f69e57-f1ec-4bc8-83e7-63fef8de7be1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74d5a642d1114f39bb1ce3513c249cae', 'request_id': 'req-c2f69e57-f1ec-4bc8-83e7-63fef8de7be1'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:43.960219 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-c2f69e57-f1ec-4bc8-83e7-63fef8de7be1 admin admin] The token cache is being invalidate because project 74d5a642d1114f39bb1ce3513c249cae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:45:43.960529 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-c2f69e57-f1ec-4bc8-83e7-63fef8de7be1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:43.964107 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-c2f69e57-f1ec-4bc8-83e7-63fef8de7be1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:43.972154 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 997/1982] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:45:43 2022] DELETE /identity/v3/projects/74d5a642d1114f39bb1ce3513c249cae => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:43.975452 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3734e77-ad00-480e-bf15-464c09fd6daf None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:43.976217 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3734e77-ad00-480e-bf15-464c09fd6daf None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:43.976947 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3734e77-ad00-480e-bf15-464c09fd6daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:43.978748 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff44918-52a3-4985-b365-55d41bb94e22 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:43.979028 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff44918-52a3-4985-b365-55d41bb94e22 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:43.979324 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff44918-52a3-4985-b365-55d41bb94e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:44.052835 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-1ff44918-52a3-4985-b365-55d41bb94e22 None None] MFA Rules not processed for user `867510e21fed4ac68228500d540081e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:44.054393 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1ff44918-52a3-4985-b365-55d41bb94e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:44.098714 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-e3734e77-ad00-480e-bf15-464c09fd6daf None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:44.105306 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e3734e77-ad00-480e-bf15-464c09fd6daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:44.282917 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 998/1983] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:45:44.285847 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff44918-52a3-4985-b365-55d41bb94e22 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:44.292224 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1ff44918-52a3-4985-b365-55d41bb94e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:44.300499 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 986/1984] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:44.303294 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4804f9-b430-4729-86e8-5ae022d259f6 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:44.303979 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4804f9-b430-4729-86e8-5ae022d259f6 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:44.304701 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4804f9-b430-4729-86e8-5ae022d259f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:44.337126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-7b4804f9-b430-4729-86e8-5ae022d259f6 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:44.338604 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-7b4804f9-b430-4729-86e8-5ae022d259f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:44.377575 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 987/1985] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:44.380727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4804f9-b430-4729-86e8-5ae022d259f6 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:44.405581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4804f9-b430-4729-86e8-5ae022d259f6 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:44.415414 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6fdbc-78a6-46bd-9ca4-e3c47a5d3e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:44.416932 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6fdbc-78a6-46bd-9ca4-e3c47a5d3e59 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:44.417492 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6fdbc-78a6-46bd-9ca4-e3c47a5d3e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:44.418072 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6fdbc-78a6-46bd-9ca4-e3c47a5d3e59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:44.419814 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6fdbc-78a6-46bd-9ca4-e3c47a5d3e59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:45:44.420310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6fdbc-78a6-46bd-9ca4-e3c47a5d3e59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:44.421399 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff44918-52a3-4985-b365-55d41bb94e22 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:44.424391 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6fdbc-78a6-46bd-9ca4-e3c47a5d3e59 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:44.426333 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f098f-db18-452b-a8a0-9d2544c55ac5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:44.427157 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f098f-db18-452b-a8a0-9d2544c55ac5 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:44.427585 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f098f-db18-452b-a8a0-9d2544c55ac5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:44.427973 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f098f-db18-452b-a8a0-9d2544c55ac5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:44.445655 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f098f-db18-452b-a8a0-9d2544c55ac5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:44.453085 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 988/1986] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:45:44.453298 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f098f-db18-452b-a8a0-9d2544c55ac5 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:44.455500 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6fdbc-78a6-46bd-9ca4-e3c47a5d3e59 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:44.469780 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 999/1987] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:45:44.483446 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6fdbc-78a6-46bd-9ca4-e3c47a5d3e59 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:44.490473 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c81506-88f1-4060-88ee-df7a2183d43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:44.492568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c81506-88f1-4060-88ee-df7a2183d43e admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:44.493079 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c81506-88f1-4060-88ee-df7a2183d43e admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:44.493570 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c81506-88f1-4060-88ee-df7a2183d43e admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:44.494579 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c81506-88f1-4060-88ee-df7a2183d43e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:44.498110 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c81506-88f1-4060-88ee-df7a2183d43e admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:44.560565 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 989/1988] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:45:44 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:44.565721 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f098f-db18-452b-a8a0-9d2544c55ac5 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:44.587516 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f098f-db18-452b-a8a0-9d2544c55ac5 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:44.711267 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1c772-8636-4450-9f53-656ba95d53af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:44.712091 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1c772-8636-4450-9f53-656ba95d53af admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:44.712522 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1c772-8636-4450-9f53-656ba95d53af admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:44.712995 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1c772-8636-4450-9f53-656ba95d53af admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:44.714338 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1c772-8636-4450-9f53-656ba95d53af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:44.718578 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1c772-8636-4450-9f53-656ba95d53af admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:44.756296 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:44.785273 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c81506-88f1-4060-88ee-df7a2183d43e admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:44.792003 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1000/1989] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:45:44 2022] POST /identity/v3/users => generated 294 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:44.800378 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:44.820181 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c81506-88f1-4060-88ee-df7a2183d43e admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:44.845651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21381518-1272-4523-9066-e3ababe764f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:44.846937 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21381518-1272-4523-9066-e3ababe764f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:44.848711 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21381518-1272-4523-9066-e3ababe764f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:44.850767 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21381518-1272-4523-9066-e3ababe764f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:44.852207 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21381518-1272-4523-9066-e3ababe764f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:44.860310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21381518-1272-4523-9066-e3ababe764f4 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:44.903914 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 990/1990] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:44.904140 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1c772-8636-4450-9f53-656ba95d53af admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:44.917142 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1c772-8636-4450-9f53-656ba95d53af admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:44.925203 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a98c1-bcb5-455c-a41e-5ad0f1b886e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:44.926385 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a98c1-bcb5-455c-a41e-5ad0f1b886e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:44.926987 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a98c1-bcb5-455c-a41e-5ad0f1b886e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:44.927407 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a98c1-bcb5-455c-a41e-5ad0f1b886e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:44.943110 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a98c1-bcb5-455c-a41e-5ad0f1b886e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:44.945197 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a98c1-bcb5-455c-a41e-5ad0f1b886e0 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:44.968310 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1001/1991] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:45:44.975716 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21381518-1272-4523-9066-e3ababe764f4 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:44.999435 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21381518-1272-4523-9066-e3ababe764f4 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:45.021048 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7d89b-3f32-4158-bae1-2d30ccf4704b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:45.022991 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7d89b-3f32-4158-bae1-2d30ccf4704b admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:45.023698 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7d89b-3f32-4158-bae1-2d30ccf4704b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:45.024306 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7d89b-3f32-4158-bae1-2d30ccf4704b admin admin] PATH_INFO: `/v3/projects/4cdf8bf097ae4868ba5ac0378663abb4/users/f072b747656c42aba94bbe3ddbcbb142/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:45.059819 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7d89b-3f32-4158-bae1-2d30ccf4704b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cdf8bf097ae4868ba5ac0378663abb4, user_id=f072b747656c42aba94bbe3ddbcbb142, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:45.068167 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7d89b-3f32-4158-bae1-2d30ccf4704b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:45.105521 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 991/1992] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:44 2022] PUT /identity/v3/projects/4cdf8bf097ae4868ba5ac0378663abb4/users/f072b747656c42aba94bbe3ddbcbb142/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:45.113754 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b4ffb-a01f-4dce-a8d1-3c7dbca57c74 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:45.114677 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b4ffb-a01f-4dce-a8d1-3c7dbca57c74 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:45.115903 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b4ffb-a01f-4dce-a8d1-3c7dbca57c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:45.175183 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-7c9b4ffb-a01f-4dce-a8d1-3c7dbca57c74 None None] MFA Rules not processed for user `f072b747656c42aba94bbe3ddbcbb142`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:45.176681 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7c9b4ffb-a01f-4dce-a8d1-3c7dbca57c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:45.413438 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1002/1993] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:45:45.419486 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7d89b-3f32-4158-bae1-2d30ccf4704b admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:45.633065 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7d89b-3f32-4158-bae1-2d30ccf4704b admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:45.669033 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc45d2-c0b3-44e5-ab92-740719a43835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:45.669683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc45d2-c0b3-44e5-ab92-740719a43835 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:45.669968 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc45d2-c0b3-44e5-ab92-740719a43835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:45.670233 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fc45d2-c0b3-44e5-ab92-740719a43835 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:45.671277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc45d2-c0b3-44e5-ab92-740719a43835 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:45.673745 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fc45d2-c0b3-44e5-ab92-740719a43835 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:45.741954 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 992/1994] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:45:45 2022] POST /identity/v3/projects => generated 387 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:45.747567 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b4ffb-a01f-4dce-a8d1-3c7dbca57c74 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:45.764194 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b4ffb-a01f-4dce-a8d1-3c7dbca57c74 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:45.954627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7221b15-1b8a-41ec-80da-0939ad26b34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:45.955707 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7221b15-1b8a-41ec-80da-0939ad26b34d admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:45.956256 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7221b15-1b8a-41ec-80da-0939ad26b34d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:45.956733 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7221b15-1b8a-41ec-80da-0939ad26b34d admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:45.957906 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7221b15-1b8a-41ec-80da-0939ad26b34d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:45.961810 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7221b15-1b8a-41ec-80da-0939ad26b34d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:46.035398 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1003/1995] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:45:45 2022] POST /identity/v3/users => generated 294 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:46.036584 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc45d2-c0b3-44e5-ab92-740719a43835 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:46.054256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fc45d2-c0b3-44e5-ab92-740719a43835 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:46.063093 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0764d5-c353-44bd-9082-168879524b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:46.064715 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0764d5-c353-44bd-9082-168879524b5d admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:46.065053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0764d5-c353-44bd-9082-168879524b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:46.065343 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0764d5-c353-44bd-9082-168879524b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:46.068434 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0764d5-c353-44bd-9082-168879524b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:46.072646 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0764d5-c353-44bd-9082-168879524b5d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:46.103804 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 993/1996] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:46.112573 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7221b15-1b8a-41ec-80da-0939ad26b34d admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:46.155644 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7221b15-1b8a-41ec-80da-0939ad26b34d admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:46.171897 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1d7b8-b805-4441-b9b6-6a3fe78c1dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:46.172957 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1d7b8-b805-4441-b9b6-6a3fe78c1dbd admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:46.173728 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1d7b8-b805-4441-b9b6-6a3fe78c1dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:46.174265 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1d7b8-b805-4441-b9b6-6a3fe78c1dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:46.175437 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae1d7b8-b805-4441-b9b6-6a3fe78c1dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:46.178647 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae1d7b8-b805-4441-b9b6-6a3fe78c1dbd admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:46.199351 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1004/1997] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:45:46.209144 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0764d5-c353-44bd-9082-168879524b5d admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:46.226370 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0764d5-c353-44bd-9082-168879524b5d admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:46.232464 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23855a15-30e0-4f67-b18b-66c32427fadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:46.233250 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23855a15-30e0-4f67-b18b-66c32427fadb admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:46.233525 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23855a15-30e0-4f67-b18b-66c32427fadb admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:46.233809 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23855a15-30e0-4f67-b18b-66c32427fadb admin admin] PATH_INFO: `/v3/projects/1a06bdf2432143e1b84e997fdbe19d2c/users/f406d98445a94acf8406b6790dca95f3/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:46.250717 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23855a15-30e0-4f67-b18b-66c32427fadb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a06bdf2432143e1b84e997fdbe19d2c, user_id=f406d98445a94acf8406b6790dca95f3, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:46.253843 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23855a15-30e0-4f67-b18b-66c32427fadb admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:46.271694 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 994/1998] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:46 2022] PUT /identity/v3/projects/1a06bdf2432143e1b84e997fdbe19d2c/users/f406d98445a94acf8406b6790dca95f3/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:46.291578 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1f5d5-6f1c-418e-a4e2-a7e2bc6e5334 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:46.291923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1f5d5-6f1c-418e-a4e2-a7e2bc6e5334 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:46.292221 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1f5d5-6f1c-418e-a4e2-a7e2bc6e5334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:46.343812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-6ba1f5d5-6f1c-418e-a4e2-a7e2bc6e5334 None None] MFA Rules not processed for user `f406d98445a94acf8406b6790dca95f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:46.344988 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6ba1f5d5-6f1c-418e-a4e2-a7e2bc6e5334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:46.398416 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:46.439197 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1005/1999] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:46.440711 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23855a15-30e0-4f67-b18b-66c32427fadb admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:46.514620 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23855a15-30e0-4f67-b18b-66c32427fadb admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:46.531063 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f283cb-f5bf-4765-bfc4-4af7cb295f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:46.531712 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f283cb-f5bf-4765-bfc4-4af7cb295f13 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:46.532010 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f283cb-f5bf-4765-bfc4-4af7cb295f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:46.532279 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f283cb-f5bf-4765-bfc4-4af7cb295f13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:46.532938 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f283cb-f5bf-4765-bfc4-4af7cb295f13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:46.534948 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f283cb-f5bf-4765-bfc4-4af7cb295f13 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:46.571811 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 995/2000] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:45:46 2022] POST /identity/v3/projects => generated 387 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:46.573308 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1f5d5-6f1c-418e-a4e2-a7e2bc6e5334 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:46.587593 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1f5d5-6f1c-418e-a4e2-a7e2bc6e5334 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:46.658500 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072fdc3-4607-45b1-bc91-eb5e1758a6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:46.659020 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072fdc3-4607-45b1-bc91-eb5e1758a6c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:46.659293 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072fdc3-4607-45b1-bc91-eb5e1758a6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:46.659559 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072fdc3-4607-45b1-bc91-eb5e1758a6c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:46.660235 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072fdc3-4607-45b1-bc91-eb5e1758a6c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:46.662230 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072fdc3-4607-45b1-bc91-eb5e1758a6c8 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:46.691274 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1006/2001] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:45:46 2022] POST /identity/v3/users => generated 300 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:46.696460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f283cb-f5bf-4765-bfc4-4af7cb295f13 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:46.706971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:46.719513 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f283cb-f5bf-4765-bfc4-4af7cb295f13 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:46.733041 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b725d-406b-473b-ae27-b0e3378a2f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:46.733725 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b725d-406b-473b-ae27-b0e3378a2f36 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:46.733992 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b725d-406b-473b-ae27-b0e3378a2f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:46.734284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b725d-406b-473b-ae27-b0e3378a2f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:46.734996 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b725d-406b-473b-ae27-b0e3378a2f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:46.736767 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b725d-406b-473b-ae27-b0e3378a2f36 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:46.754081 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 996/2002] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:46.760017 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072fdc3-4607-45b1-bc91-eb5e1758a6c8 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:46.774392 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072fdc3-4607-45b1-bc91-eb5e1758a6c8 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:46.780976 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d9fb7-298c-48bb-ba5a-1014d0cf4a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:46.781978 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d9fb7-298c-48bb-ba5a-1014d0cf4a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:46.782383 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d9fb7-298c-48bb-ba5a-1014d0cf4a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:46.782747 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d9fb7-298c-48bb-ba5a-1014d0cf4a11 admin admin] PATH_INFO: `/v3/projects/73341e6d204f4694b76fb4a346e5faf6/users/bdf6e845b6404fd3944b3d47054de14f/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:46.806436 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff4071-fd5d-4949-a8f8-cc79c04726f8 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:46.806894 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff4071-fd5d-4949-a8f8-cc79c04726f8 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:46.807370 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff4071-fd5d-4949-a8f8-cc79c04726f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:46.816774 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d9fb7-298c-48bb-ba5a-1014d0cf4a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73341e6d204f4694b76fb4a346e5faf6, user_id=bdf6e845b6404fd3944b3d47054de14f, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:46.820652 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d9fb7-298c-48bb-ba5a-1014d0cf4a11 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:46.845322 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-f2ff4071-fd5d-4949-a8f8-cc79c04726f8 None None] MFA Rules not processed for user `867510e21fed4ac68228500d540081e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:46.847594 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f2ff4071-fd5d-4949-a8f8-cc79c04726f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:46.852529 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1007/2003] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:46 2022] PUT /identity/v3/projects/73341e6d204f4694b76fb4a346e5faf6/users/bdf6e845b6404fd3944b3d47054de14f/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:46.857805 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d9fb7-298c-48bb-ba5a-1014d0cf4a11 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:46.978719 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d9fb7-298c-48bb-ba5a-1014d0cf4a11 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:46.996615 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc7648-f8be-4190-92a7-ac7f64fcc8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:46.997320 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc7648-f8be-4190-92a7-ac7f64fcc8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:46.998161 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc7648-f8be-4190-92a7-ac7f64fcc8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:46.998161 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc7648-f8be-4190-92a7-ac7f64fcc8f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:46.999678 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc7648-f8be-4190-92a7-ac7f64fcc8f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:47.002262 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc7648-f8be-4190-92a7-ac7f64fcc8f1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:47.023000 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1008/2004] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:45:47.028703 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc7648-f8be-4190-92a7-ac7f64fcc8f1 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:47.031067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 997/2005] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:47.048775 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc7648-f8be-4190-92a7-ac7f64fcc8f1 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:47.055389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c5c59-5d36-43fb-a455-03a9cb86fa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:47.056367 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c5c59-5d36-43fb-a455-03a9cb86fa42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:47.057074 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c5c59-5d36-43fb-a455-03a9cb86fa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:47.057769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c5c59-5d36-43fb-a455-03a9cb86fa42 admin admin] PATH_INFO: `/v3/projects/73341e6d204f4694b76fb4a346e5faf6/users/bdf6e845b6404fd3944b3d47054de14f/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:47.061115 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c5c59-5d36-43fb-a455-03a9cb86fa42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73341e6d204f4694b76fb4a346e5faf6, user_id=bdf6e845b6404fd3944b3d47054de14f, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:47.064819 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c5c59-5d36-43fb-a455-03a9cb86fa42 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:47.090440 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1009/2006] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:47 2022] PUT /identity/v3/projects/73341e6d204f4694b76fb4a346e5faf6/users/bdf6e845b6404fd3944b3d47054de14f/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:45:47.094919 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47e59e-6aa2-4469-8a3e-69d2751afeb9 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:47.095476 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47e59e-6aa2-4469-8a3e-69d2751afeb9 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:47.096060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47e59e-6aa2-4469-8a3e-69d2751afeb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:47.197403 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-4c47e59e-6aa2-4469-8a3e-69d2751afeb9 None None] MFA Rules not processed for user `bdf6e845b6404fd3944b3d47054de14f`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:47.205724 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4c47e59e-6aa2-4469-8a3e-69d2751afeb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:47.495723 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 998/2007] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:47 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:47.600114 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c5c59-5d36-43fb-a455-03a9cb86fa42 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:47.690868 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:47.759968 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c5c59-5d36-43fb-a455-03a9cb86fa42 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:47.764853 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad38be-64ca-4122-9e82-00608e0d2915 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:47.766418 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad38be-64ca-4122-9e82-00608e0d2915 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:47.766848 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad38be-64ca-4122-9e82-00608e0d2915 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:47.767252 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad38be-64ca-4122-9e82-00608e0d2915 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:47.787402 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad38be-64ca-4122-9e82-00608e0d2915 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:47.792540 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ad38be-64ca-4122-9e82-00608e0d2915 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:47.821478 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1010/2008] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:47 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:45:48.179722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47e59e-6aa2-4469-8a3e-69d2751afeb9 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:48.181913 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4c47e59e-6aa2-4469-8a3e-69d2751afeb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:48.303966 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47e59e-6aa2-4469-8a3e-69d2751afeb9 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:48.313052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fd82f-5512-46e7-970b-a4e4730bf83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:48.315255 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fd82f-5512-46e7-970b-a4e4730bf83d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:48.316465 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fd82f-5512-46e7-970b-a4e4730bf83d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:48.317395 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fd82f-5512-46e7-970b-a4e4730bf83d admin admin] PATH_INFO: `/v3/users/23bb328c6c374eed88aeda09fb3b35cc` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:48.319974 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851fd82f-5512-46e7-970b-a4e4730bf83d admin admin] RBAC: Authorizing `identity:delete_user(user_id=23bb328c6c374eed88aeda09fb3b35cc)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:48.324240 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851fd82f-5512-46e7-970b-a4e4730bf83d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:48.368142 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:48.408167 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-851fd82f-5512-46e7-970b-a4e4730bf83d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23bb328c6c374eed88aeda09fb3b35cc'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:48.425370 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-851fd82f-5512-46e7-970b-a4e4730bf83d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23bb328c6c374eed88aeda09fb3b35cc'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:48.502041 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-851fd82f-5512-46e7-970b-a4e4730bf83d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23bb328c6c374eed88aeda09fb3b35cc'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:48.504469 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-851fd82f-5512-46e7-970b-a4e4730bf83d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23bb328c6c374eed88aeda09fb3b35cc'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:48.594182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-851fd82f-5512-46e7-970b-a4e4730bf83d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23bb328c6c374eed88aeda09fb3b35cc'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:48.613897 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 999/2009] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:45:48 2022] DELETE /identity/v3/users/23bb328c6c374eed88aeda09fb3b35cc => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:48.618831 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e8b70-410e-4460-8d37-02a84e5909b6 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:48.619243 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e8b70-410e-4460-8d37-02a84e5909b6 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:48.619612 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e8b70-410e-4460-8d37-02a84e5909b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:48.666767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-566e8b70-410e-4460-8d37-02a84e5909b6 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:48.670739 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-566e8b70-410e-4460-8d37-02a84e5909b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:48.788943 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1011/2010] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:48.798835 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fd82f-5512-46e7-970b-a4e4730bf83d admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:48.803504 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-851fd82f-5512-46e7-970b-a4e4730bf83d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:48.964101 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fd82f-5512-46e7-970b-a4e4730bf83d admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:48.971419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e560da4-f47f-4d37-b144-8f51b03d2b11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:48.971419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e560da4-f47f-4d37-b144-8f51b03d2b11 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:48.984262 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e560da4-f47f-4d37-b144-8f51b03d2b11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:48.984624 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e560da4-f47f-4d37-b144-8f51b03d2b11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:48.993481 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e8b70-410e-4460-8d37-02a84e5909b6 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:48.995872 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-566e8b70-410e-4460-8d37-02a84e5909b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:49.015561 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e560da4-f47f-4d37-b144-8f51b03d2b11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:49.017638 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e560da4-f47f-4d37-b144-8f51b03d2b11 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:49.039256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1000/2011] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:45:49.135817 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e8b70-410e-4460-8d37-02a84e5909b6 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:49.148365 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcaf274-fad4-48df-be09-c6714a92bed4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:49.149787 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcaf274-fad4-48df-be09-c6714a92bed4 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:49.151706 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcaf274-fad4-48df-be09-c6714a92bed4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:49.152852 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcaf274-fad4-48df-be09-c6714a92bed4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:49.159847 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-cdcaf274-fad4-48df-be09-c6714a92bed4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:49.316537 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcaf274-fad4-48df-be09-c6714a92bed4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:49.318001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcaf274-fad4-48df-be09-c6714a92bed4 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:49.342587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1012/2012] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:48 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:45:49.562566 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e560da4-f47f-4d37-b144-8f51b03d2b11 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:49.564138 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-8e560da4-f47f-4d37-b144-8f51b03d2b11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:49.591448 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e560da4-f47f-4d37-b144-8f51b03d2b11 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:49.616909 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8aea6-74d2-4719-960d-1a9e86f09f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:49.625107 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8aea6-74d2-4719-960d-1a9e86f09f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:49.625107 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8aea6-74d2-4719-960d-1a9e86f09f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:49.625107 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8aea6-74d2-4719-960d-1a9e86f09f27 admin admin] PATH_INFO: `/v3/projects/1d7c1d0377784591b9b75455b9e5df39` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:49.635667 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8aea6-74d2-4719-960d-1a9e86f09f27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d7c1d0377784591b9b75455b9e5df39)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:49.645758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e8aea6-74d2-4719-960d-1a9e86f09f27 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:49.837890 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-28e8aea6-74d2-4719-960d-1a9e86f09f27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d7c1d0377784591b9b75455b9e5df39', 'request_id': 'req-28e8aea6-74d2-4719-960d-1a9e86f09f27'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:49.861467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-28e8aea6-74d2-4719-960d-1a9e86f09f27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d7c1d0377784591b9b75455b9e5df39', 'request_id': 'req-28e8aea6-74d2-4719-960d-1a9e86f09f27'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:49.874426 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-28e8aea6-74d2-4719-960d-1a9e86f09f27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d7c1d0377784591b9b75455b9e5df39', 'request_id': 'req-28e8aea6-74d2-4719-960d-1a9e86f09f27'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:49.955131 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-28e8aea6-74d2-4719-960d-1a9e86f09f27 admin admin] The token cache is being invalidate because project 1d7c1d0377784591b9b75455b9e5df39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:45:49.955635 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-28e8aea6-74d2-4719-960d-1a9e86f09f27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:49.956939 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-28e8aea6-74d2-4719-960d-1a9e86f09f27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:49.960648 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1001/2013] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:45:49 2022] DELETE /identity/v3/projects/1d7c1d0377784591b9b75455b9e5df39 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:49.965080 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcaf274-fad4-48df-be09-c6714a92bed4 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:49.983421 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcaf274-fad4-48df-be09-c6714a92bed4 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:50.111560 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:50.148277 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f2143-8811-42ff-bad2-d1dbcbf62f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:50.149814 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f2143-8811-42ff-bad2-d1dbcbf62f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:50.150095 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f2143-8811-42ff-bad2-d1dbcbf62f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:50.150391 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f2143-8811-42ff-bad2-d1dbcbf62f8e admin admin] PATH_INFO: `/v3/users/91df20604174463588342cb4eb1397f6` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:50.151592 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f2143-8811-42ff-bad2-d1dbcbf62f8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=91df20604174463588342cb4eb1397f6)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:50.154731 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f2143-8811-42ff-bad2-d1dbcbf62f8e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:50.251701 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-429f2143-8811-42ff-bad2-d1dbcbf62f8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91df20604174463588342cb4eb1397f6'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:50.264709 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-429f2143-8811-42ff-bad2-d1dbcbf62f8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91df20604174463588342cb4eb1397f6'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:50.265593 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-429f2143-8811-42ff-bad2-d1dbcbf62f8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91df20604174463588342cb4eb1397f6'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:50.284072 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-429f2143-8811-42ff-bad2-d1dbcbf62f8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91df20604174463588342cb4eb1397f6'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:50.300821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-429f2143-8811-42ff-bad2-d1dbcbf62f8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91df20604174463588342cb4eb1397f6'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:50.308003 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1013/2014] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:45:49 2022] DELETE /identity/v3/users/91df20604174463588342cb4eb1397f6 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:50.673973 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8aea6-74d2-4719-960d-1a9e86f09f27 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:50.675466 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-28e8aea6-74d2-4719-960d-1a9e86f09f27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:50.689191 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8aea6-74d2-4719-960d-1a9e86f09f27 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:50.719917 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:50.753559 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72017625-8485-4e32-9a58-b0766c7cd529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:50.754198 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72017625-8485-4e32-9a58-b0766c7cd529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:50.754509 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72017625-8485-4e32-9a58-b0766c7cd529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:50.754776 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72017625-8485-4e32-9a58-b0766c7cd529 admin admin] PATH_INFO: `/v3/projects/53edc44e1dc04e0badd395ebbb30cda5` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:50.755932 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72017625-8485-4e32-9a58-b0766c7cd529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53edc44e1dc04e0badd395ebbb30cda5)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:50.757854 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72017625-8485-4e32-9a58-b0766c7cd529 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:50.809692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-72017625-8485-4e32-9a58-b0766c7cd529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53edc44e1dc04e0badd395ebbb30cda5', 'request_id': 'req-72017625-8485-4e32-9a58-b0766c7cd529'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:50.818743 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-72017625-8485-4e32-9a58-b0766c7cd529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53edc44e1dc04e0badd395ebbb30cda5', 'request_id': 'req-72017625-8485-4e32-9a58-b0766c7cd529'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:50.824790 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-72017625-8485-4e32-9a58-b0766c7cd529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53edc44e1dc04e0badd395ebbb30cda5', 'request_id': 'req-72017625-8485-4e32-9a58-b0766c7cd529'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:50.836585 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-72017625-8485-4e32-9a58-b0766c7cd529 admin admin] The token cache is being invalidate because project 53edc44e1dc04e0badd395ebbb30cda5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:45:50.836917 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-72017625-8485-4e32-9a58-b0766c7cd529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:50.837601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-72017625-8485-4e32-9a58-b0766c7cd529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:50.839189 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1002/2015] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:45:50 2022] DELETE /identity/v3/projects/53edc44e1dc04e0badd395ebbb30cda5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:50.844322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6af44a-78d0-4a69-8e7b-63c519e303fd None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:50.844601 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6af44a-78d0-4a69-8e7b-63c519e303fd None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:50.844870 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6af44a-78d0-4a69-8e7b-63c519e303fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:50.866115 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-1a6af44a-78d0-4a69-8e7b-63c519e303fd None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:50.867350 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1a6af44a-78d0-4a69-8e7b-63c519e303fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:50.939851 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1014/2016] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:50.948536 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46692714-64a8-4d63-a2c6-34714cf499d5 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:50.948789 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46692714-64a8-4d63-a2c6-34714cf499d5 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:50.949060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46692714-64a8-4d63-a2c6-34714cf499d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:50.972352 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-46692714-64a8-4d63-a2c6-34714cf499d5 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:50.973733 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-46692714-64a8-4d63-a2c6-34714cf499d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:50.983555 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1003/2017] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:50.988458 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6af44a-78d0-4a69-8e7b-63c519e303fd None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:50.999844 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6af44a-78d0-4a69-8e7b-63c519e303fd None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:51.006631 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5745e-f189-4095-b1c8-9b953ed16941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:51.007344 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5745e-f189-4095-b1c8-9b953ed16941 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:51.007618 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5745e-f189-4095-b1c8-9b953ed16941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:51.007922 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b5745e-f189-4095-b1c8-9b953ed16941 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:51.008608 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5745e-f189-4095-b1c8-9b953ed16941 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:45:51.008902 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5745e-f189-4095-b1c8-9b953ed16941 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:51.010612 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b5745e-f189-4095-b1c8-9b953ed16941 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:51.040161 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1015/2018] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:45:51.049337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46692714-64a8-4d63-a2c6-34714cf499d5 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:51.060823 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46692714-64a8-4d63-a2c6-34714cf499d5 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:51.065470 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f006b06-3dd9-40ce-88c2-303fac064b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:51.066090 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f006b06-3dd9-40ce-88c2-303fac064b0e admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:51.066383 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f006b06-3dd9-40ce-88c2-303fac064b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:51.066626 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f006b06-3dd9-40ce-88c2-303fac064b0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:51.067256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f006b06-3dd9-40ce-88c2-303fac064b0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:51.069170 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f006b06-3dd9-40ce-88c2-303fac064b0e admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:51.097935 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1004/2019] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:45:51 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:45:51.102492 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5745e-f189-4095-b1c8-9b953ed16941 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:51.113251 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b5745e-f189-4095-b1c8-9b953ed16941 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:51.182432 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:51.208489 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fa607-3585-4b3b-b8f0-7a4b9932cd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:51.209123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fa607-3585-4b3b-b8f0-7a4b9932cd97 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:51.209396 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fa607-3585-4b3b-b8f0-7a4b9932cd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:51.209663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0fa607-3585-4b3b-b8f0-7a4b9932cd97 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:51.210432 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fa607-3585-4b3b-b8f0-7a4b9932cd97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:51.212482 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0fa607-3585-4b3b-b8f0-7a4b9932cd97 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:51.239822 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1016/2020] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:45:51 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:51.246024 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f006b06-3dd9-40ce-88c2-303fac064b0e admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:51.263006 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f006b06-3dd9-40ce-88c2-303fac064b0e admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:51.268938 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b223c-0d10-4f73-a40f-43a61eec7057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:51.269720 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b223c-0d10-4f73-a40f-43a61eec7057 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:51.270201 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b223c-0d10-4f73-a40f-43a61eec7057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:51.270617 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b223c-0d10-4f73-a40f-43a61eec7057 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:51.273078 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b223c-0d10-4f73-a40f-43a61eec7057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:51.276639 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b223c-0d10-4f73-a40f-43a61eec7057 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:51.306422 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1005/2021] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:51.310756 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fa607-3585-4b3b-b8f0-7a4b9932cd97 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:51.325776 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0fa607-3585-4b3b-b8f0-7a4b9932cd97 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:51.331067 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0821372-35e4-473f-b6e7-21c9f085848a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:51.331722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0821372-35e4-473f-b6e7-21c9f085848a admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:51.332018 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0821372-35e4-473f-b6e7-21c9f085848a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:51.332345 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0821372-35e4-473f-b6e7-21c9f085848a admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:51.333019 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0821372-35e4-473f-b6e7-21c9f085848a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:51.337685 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0821372-35e4-473f-b6e7-21c9f085848a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:51.354535 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1017/2022] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:51.355891 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b223c-0d10-4f73-a40f-43a61eec7057 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:51.379798 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b223c-0d10-4f73-a40f-43a61eec7057 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:51.394960 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef2923-f8de-4d90-8bf0-e1343e3863b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:51.395982 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef2923-f8de-4d90-8bf0-e1343e3863b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:51.396417 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef2923-f8de-4d90-8bf0-e1343e3863b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:51.396851 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef2923-f8de-4d90-8bf0-e1343e3863b8 admin admin] PATH_INFO: `/v3/projects/57cf1b0d1d7e4161a715acd39bfc90fb/users/9025f83f375b433ebbb70a5598af67a8/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:51.420206 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef2923-f8de-4d90-8bf0-e1343e3863b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57cf1b0d1d7e4161a715acd39bfc90fb, user_id=9025f83f375b433ebbb70a5598af67a8, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:51.423270 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef2923-f8de-4d90-8bf0-e1343e3863b8 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:51.443803 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1006/2023] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:51 2022] PUT /identity/v3/projects/57cf1b0d1d7e4161a715acd39bfc90fb/users/9025f83f375b433ebbb70a5598af67a8/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:51.452688 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85889a0f-68f5-4271-9244-efab48f5cf66 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:51.453086 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85889a0f-68f5-4271-9244-efab48f5cf66 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:51.453514 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85889a0f-68f5-4271-9244-efab48f5cf66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:51.486376 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-85889a0f-68f5-4271-9244-efab48f5cf66 None None] MFA Rules not processed for user `9025f83f375b433ebbb70a5598af67a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:51.487707 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-85889a0f-68f5-4271-9244-efab48f5cf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:51.572444 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1018/2024] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:51.577450 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef2923-f8de-4d90-8bf0-e1343e3863b8 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:51.643327 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:51.662942 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef2923-f8de-4d90-8bf0-e1343e3863b8 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:51.669917 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb76cc9-1089-4165-91bf-1bf797d64f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:51.670719 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb76cc9-1089-4165-91bf-1bf797d64f9d admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:51.671188 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb76cc9-1089-4165-91bf-1bf797d64f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:51.671686 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb76cc9-1089-4165-91bf-1bf797d64f9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:51.672301 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb76cc9-1089-4165-91bf-1bf797d64f9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:51.674754 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb76cc9-1089-4165-91bf-1bf797d64f9d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:51.708616 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1007/2025] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:45:51 2022] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:51.712575 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85889a0f-68f5-4271-9244-efab48f5cf66 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:51.725698 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85889a0f-68f5-4271-9244-efab48f5cf66 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:51.786116 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1223e6-17bd-405f-9606-b54e4ff562e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:51.786891 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1223e6-17bd-405f-9606-b54e4ff562e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:51.787012 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1223e6-17bd-405f-9606-b54e4ff562e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:51.787244 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1223e6-17bd-405f-9606-b54e4ff562e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:51.787920 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1223e6-17bd-405f-9606-b54e4ff562e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:51.789832 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1223e6-17bd-405f-9606-b54e4ff562e7 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:51.818363 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1019/2026] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:45:51 2022] POST /identity/v3/users => generated 297 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:51.829646 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb76cc9-1089-4165-91bf-1bf797d64f9d admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:51.840817 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb76cc9-1089-4165-91bf-1bf797d64f9d admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:51.846326 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2c430-d937-4b0f-bf10-4621bd4d11cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:51.846953 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2c430-d937-4b0f-bf10-4621bd4d11cd admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:51.847275 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2c430-d937-4b0f-bf10-4621bd4d11cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:51.847540 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2c430-d937-4b0f-bf10-4621bd4d11cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:51.848256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2c430-d937-4b0f-bf10-4621bd4d11cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:51.849926 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2c430-d937-4b0f-bf10-4621bd4d11cd admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:51.864530 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1008/2027] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:45:51.868940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1223e6-17bd-405f-9606-b54e4ff562e7 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:51.881365 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1223e6-17bd-405f-9606-b54e4ff562e7 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:51.886313 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b0388-9a6e-4dec-8e67-c457d6d3c895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:51.887084 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b0388-9a6e-4dec-8e67-c457d6d3c895 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:51.887609 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b0388-9a6e-4dec-8e67-c457d6d3c895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:51.887984 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b0388-9a6e-4dec-8e67-c457d6d3c895 admin admin] PATH_INFO: `/v3/projects/20b569d9d64a4fd3a856d78401401b3a/users/ddd526f3372d42e29fb07c74232802fb/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:51.906422 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b0388-9a6e-4dec-8e67-c457d6d3c895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b569d9d64a4fd3a856d78401401b3a, user_id=ddd526f3372d42e29fb07c74232802fb, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:51.909548 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b0388-9a6e-4dec-8e67-c457d6d3c895 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:51.937959 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1020/2028] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:51 2022] PUT /identity/v3/projects/20b569d9d64a4fd3a856d78401401b3a/users/ddd526f3372d42e29fb07c74232802fb/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:45:51.939536 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2c430-d937-4b0f-bf10-4621bd4d11cd admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:51.952034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2c430-d937-4b0f-bf10-4621bd4d11cd admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:52.023444 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925f9f1-51a5-47b0-8a82-f05b463ce40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:52.024171 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925f9f1-51a5-47b0-8a82-f05b463ce40c admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:52.024515 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925f9f1-51a5-47b0-8a82-f05b463ce40c admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:52.024893 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925f9f1-51a5-47b0-8a82-f05b463ce40c admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:52.025556 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925f9f1-51a5-47b0-8a82-f05b463ce40c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:52.027388 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925f9f1-51a5-47b0-8a82-f05b463ce40c admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:52.043308 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1009/2029] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:51 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:45:52.044844 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b0388-9a6e-4dec-8e67-c457d6d3c895 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:52.058544 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b0388-9a6e-4dec-8e67-c457d6d3c895 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:52.066227 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1e8f2-bc04-4703-948f-9bd9280f3395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:52.066931 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1e8f2-bc04-4703-948f-9bd9280f3395 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:52.067200 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1e8f2-bc04-4703-948f-9bd9280f3395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:52.067464 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1e8f2-bc04-4703-948f-9bd9280f3395 admin admin] PATH_INFO: `/v3/projects/20b569d9d64a4fd3a856d78401401b3a/users/ddd526f3372d42e29fb07c74232802fb/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:52.078138 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e1e8f2-bc04-4703-948f-9bd9280f3395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b569d9d64a4fd3a856d78401401b3a, user_id=ddd526f3372d42e29fb07c74232802fb, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:52.084320 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e1e8f2-bc04-4703-948f-9bd9280f3395 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:52.097423 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:52.103101 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1021/2030] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:52 2022] PUT /identity/v3/projects/20b569d9d64a4fd3a856d78401401b3a/users/ddd526f3372d42e29fb07c74232802fb/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:52.114415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0165cb-ad83-41da-88e8-bcbacdc896b9 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:52.115024 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0165cb-ad83-41da-88e8-bcbacdc896b9 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:52.115396 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0165cb-ad83-41da-88e8-bcbacdc896b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:52.164339 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-bb0165cb-ad83-41da-88e8-bcbacdc896b9 None None] MFA Rules not processed for user `ddd526f3372d42e29fb07c74232802fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:52.168662 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-bb0165cb-ad83-41da-88e8-bcbacdc896b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:52.250625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1010/2031] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:52 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:52.262426 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1e8f2-bc04-4703-948f-9bd9280f3395 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:52.264185 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d5e1e8f2-bc04-4703-948f-9bd9280f3395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:52.325998 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1e8f2-bc04-4703-948f-9bd9280f3395 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:52.329887 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32f472-6dfa-4f18-aa86-25d63f5cc22d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:52.330669 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32f472-6dfa-4f18-aa86-25d63f5cc22d service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:52.330838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32f472-6dfa-4f18-aa86-25d63f5cc22d service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:52.331167 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32f472-6dfa-4f18-aa86-25d63f5cc22d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:52.342444 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32f472-6dfa-4f18-aa86-25d63f5cc22d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:52.344091 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32f472-6dfa-4f18-aa86-25d63f5cc22d service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:52.357006 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1022/2032] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:52 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:45:52.502533 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0165cb-ad83-41da-88e8-bcbacdc896b9 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:52.504370 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-bb0165cb-ad83-41da-88e8-bcbacdc896b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:52.522895 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0165cb-ad83-41da-88e8-bcbacdc896b9 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:52.529589 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d9f75-6c6f-4ab3-bf34-e7c9ef2b5edb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:52.530470 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d9f75-6c6f-4ab3-bf34-e7c9ef2b5edb service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:52.530822 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d9f75-6c6f-4ab3-bf34-e7c9ef2b5edb service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:52.531318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d9f75-6c6f-4ab3-bf34-e7c9ef2b5edb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:52.601058 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:52.628272 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d9f75-6c6f-4ab3-bf34-e7c9ef2b5edb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:52.630509 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d9f75-6c6f-4ab3-bf34-e7c9ef2b5edb service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:52.650952 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1011/2033] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:45:54.553575 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32f472-6dfa-4f18-aa86-25d63f5cc22d service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:54.565493 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32f472-6dfa-4f18-aa86-25d63f5cc22d service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:54.571893 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82caa69-23e2-4dde-ae6b-4a60a6371650 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:54.573287 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82caa69-23e2-4dde-ae6b-4a60a6371650 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:54.573668 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82caa69-23e2-4dde-ae6b-4a60a6371650 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:54.574029 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82caa69-23e2-4dde-ae6b-4a60a6371650 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:54.576788 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d82caa69-23e2-4dde-ae6b-4a60a6371650 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:54.696961 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82caa69-23e2-4dde-ae6b-4a60a6371650 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:54.700884 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82caa69-23e2-4dde-ae6b-4a60a6371650 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:54.722680 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1023/2034] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:54 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:45:56.127717 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d9f75-6c6f-4ab3-bf34-e7c9ef2b5edb service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:56.227571 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d9f75-6c6f-4ab3-bf34-e7c9ef2b5edb service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:56.236699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff58c7-573c-4645-a3b9-482267a3e322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:56.237582 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff58c7-573c-4645-a3b9-482267a3e322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:56.237949 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff58c7-573c-4645-a3b9-482267a3e322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:56.238309 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff58c7-573c-4645-a3b9-482267a3e322 admin admin] PATH_INFO: `/v3/users/9025f83f375b433ebbb70a5598af67a8` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:56.239866 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff58c7-573c-4645-a3b9-482267a3e322 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9025f83f375b433ebbb70a5598af67a8)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:56.242521 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff58c7-573c-4645-a3b9-482267a3e322 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:56.321463 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-52ff58c7-573c-4645-a3b9-482267a3e322 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9025f83f375b433ebbb70a5598af67a8'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:56.334381 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-52ff58c7-573c-4645-a3b9-482267a3e322 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9025f83f375b433ebbb70a5598af67a8'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:56.373427 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-52ff58c7-573c-4645-a3b9-482267a3e322 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9025f83f375b433ebbb70a5598af67a8'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:56.374376 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-52ff58c7-573c-4645-a3b9-482267a3e322 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9025f83f375b433ebbb70a5598af67a8'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:56.386675 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-52ff58c7-573c-4645-a3b9-482267a3e322 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9025f83f375b433ebbb70a5598af67a8'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:56.406640 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1012/2035] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:45:56 2022] DELETE /identity/v3/users/9025f83f375b433ebbb70a5598af67a8 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:56.406964 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acce22f-0985-4ce7-9930-83e838251ba4 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:56.406964 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acce22f-0985-4ce7-9930-83e838251ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:56.406964 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acce22f-0985-4ce7-9930-83e838251ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:56.435876 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-6acce22f-0985-4ce7-9930-83e838251ba4 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:56.437688 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6acce22f-0985-4ce7-9930-83e838251ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:56.542115 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1024/2036] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:56.557213 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff58c7-573c-4645-a3b9-482267a3e322 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:56.559028 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-52ff58c7-573c-4645-a3b9-482267a3e322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:56.682346 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff58c7-573c-4645-a3b9-482267a3e322 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:56.689806 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c37557-472c-4d3e-ac60-78fb70735a7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:56.690681 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c37557-472c-4d3e-ac60-78fb70735a7e service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:56.691026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c37557-472c-4d3e-ac60-78fb70735a7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:56.691385 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c37557-472c-4d3e-ac60-78fb70735a7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:56.711991 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c37557-472c-4d3e-ac60-78fb70735a7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:56.711991 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c37557-472c-4d3e-ac60-78fb70735a7e service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:56.719869 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1013/2037] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:45:57.116735 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acce22f-0985-4ce7-9930-83e838251ba4 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:57.123253 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6acce22f-0985-4ce7-9930-83e838251ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:57.187501 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acce22f-0985-4ce7-9930-83e838251ba4 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:57.217803 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d22a4-10d7-40d6-8bb8-022e3c11d8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:57.219250 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d22a4-10d7-40d6-8bb8-022e3c11d8af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:57.219985 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d22a4-10d7-40d6-8bb8-022e3c11d8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:57.220319 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d22a4-10d7-40d6-8bb8-022e3c11d8af admin admin] PATH_INFO: `/v3/projects/57cf1b0d1d7e4161a715acd39bfc90fb` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:57.225366 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d22a4-10d7-40d6-8bb8-022e3c11d8af admin admin] RBAC: Authorizing `identity:delete_project(project_id=57cf1b0d1d7e4161a715acd39bfc90fb)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:57.234864 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d22a4-10d7-40d6-8bb8-022e3c11d8af admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:57.306049 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:57.326823 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-778d22a4-10d7-40d6-8bb8-022e3c11d8af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57cf1b0d1d7e4161a715acd39bfc90fb', 'request_id': 'req-778d22a4-10d7-40d6-8bb8-022e3c11d8af'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:57.343701 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-778d22a4-10d7-40d6-8bb8-022e3c11d8af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57cf1b0d1d7e4161a715acd39bfc90fb', 'request_id': 'req-778d22a4-10d7-40d6-8bb8-022e3c11d8af'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:57.358302 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-778d22a4-10d7-40d6-8bb8-022e3c11d8af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57cf1b0d1d7e4161a715acd39bfc90fb', 'request_id': 'req-778d22a4-10d7-40d6-8bb8-022e3c11d8af'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:57.384222 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-778d22a4-10d7-40d6-8bb8-022e3c11d8af admin admin] The token cache is being invalidate because project 57cf1b0d1d7e4161a715acd39bfc90fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:45:57.384514 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-778d22a4-10d7-40d6-8bb8-022e3c11d8af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:57.385320 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-778d22a4-10d7-40d6-8bb8-022e3c11d8af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:57.387165 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1025/2038] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:45:57 2022] DELETE /identity/v3/projects/57cf1b0d1d7e4161a715acd39bfc90fb => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:57.391852 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c37557-472c-4d3e-ac60-78fb70735a7e service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:57.421238 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c37557-472c-4d3e-ac60-78fb70735a7e service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:57.428353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:57.509210 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741f1ac-971c-4915-b6eb-c82a47ab3f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:57.509997 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741f1ac-971c-4915-b6eb-c82a47ab3f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:57.510330 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741f1ac-971c-4915-b6eb-c82a47ab3f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:57.510658 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741f1ac-971c-4915-b6eb-c82a47ab3f5a admin admin] PATH_INFO: `/v3/users/ddd526f3372d42e29fb07c74232802fb` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:57.512043 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741f1ac-971c-4915-b6eb-c82a47ab3f5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddd526f3372d42e29fb07c74232802fb)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:57.514057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741f1ac-971c-4915-b6eb-c82a47ab3f5a admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:57.586337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-b741f1ac-971c-4915-b6eb-c82a47ab3f5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddd526f3372d42e29fb07c74232802fb'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:57.599138 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-b741f1ac-971c-4915-b6eb-c82a47ab3f5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddd526f3372d42e29fb07c74232802fb'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:57.620163 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-b741f1ac-971c-4915-b6eb-c82a47ab3f5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddd526f3372d42e29fb07c74232802fb'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:57.621223 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-b741f1ac-971c-4915-b6eb-c82a47ab3f5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddd526f3372d42e29fb07c74232802fb'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:57.632627 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-b741f1ac-971c-4915-b6eb-c82a47ab3f5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddd526f3372d42e29fb07c74232802fb'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:57.639938 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1014/2039] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:45:57 2022] DELETE /identity/v3/users/ddd526f3372d42e29fb07c74232802fb => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:57.742921 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d22a4-10d7-40d6-8bb8-022e3c11d8af admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:57.745394 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-778d22a4-10d7-40d6-8bb8-022e3c11d8af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:57.762226 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d22a4-10d7-40d6-8bb8-022e3c11d8af admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:57.840107 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c176c-c157-404e-b78e-722d8b46d8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:57.841202 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c176c-c157-404e-b78e-722d8b46d8c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:57.841715 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c176c-c157-404e-b78e-722d8b46d8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:57.842157 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c176c-c157-404e-b78e-722d8b46d8c9 admin admin] PATH_INFO: `/v3/users/f072b747656c42aba94bbe3ddbcbb142` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:57.844751 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c176c-c157-404e-b78e-722d8b46d8c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f072b747656c42aba94bbe3ddbcbb142)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:57.848639 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c176c-c157-404e-b78e-722d8b46d8c9 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:57.955801 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-930c176c-c157-404e-b78e-722d8b46d8c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f072b747656c42aba94bbe3ddbcbb142'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:57.973917 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-930c176c-c157-404e-b78e-722d8b46d8c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f072b747656c42aba94bbe3ddbcbb142'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:57.978993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-930c176c-c157-404e-b78e-722d8b46d8c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f072b747656c42aba94bbe3ddbcbb142'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:58.016548 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-930c176c-c157-404e-b78e-722d8b46d8c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f072b747656c42aba94bbe3ddbcbb142'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:58.031307 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-930c176c-c157-404e-b78e-722d8b46d8c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f072b747656c42aba94bbe3ddbcbb142'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:58.061935 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1026/2040] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:45:57 2022] DELETE /identity/v3/users/f072b747656c42aba94bbe3ddbcbb142 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:45:58.067993 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798af2b2-8488-4dc0-8139-64364b03c6b2 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:58.067993 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798af2b2-8488-4dc0-8139-64364b03c6b2 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:58.067993 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798af2b2-8488-4dc0-8139-64364b03c6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:58.115581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-798af2b2-8488-4dc0-8139-64364b03c6b2 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:58.117758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-798af2b2-8488-4dc0-8139-64364b03c6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:58.161519 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c176c-c157-404e-b78e-722d8b46d8c9 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:58.164436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-930c176c-c157-404e-b78e-722d8b46d8c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:58.237720 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1015/2041] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:58.256114 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798af2b2-8488-4dc0-8139-64364b03c6b2 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:58.259153 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-798af2b2-8488-4dc0-8139-64364b03c6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:58.273619 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:58.312280 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:58.321798 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c176c-c157-404e-b78e-722d8b46d8c9 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:58.333632 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690836da-aeec-47ed-8583-53fce52d7034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:58.334813 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690836da-aeec-47ed-8583-53fce52d7034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:58.335261 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690836da-aeec-47ed-8583-53fce52d7034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:58.335700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690836da-aeec-47ed-8583-53fce52d7034 admin admin] PATH_INFO: `/v3/projects/20b569d9d64a4fd3a856d78401401b3a` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:58.337823 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690836da-aeec-47ed-8583-53fce52d7034 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20b569d9d64a4fd3a856d78401401b3a)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:58.342395 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690836da-aeec-47ed-8583-53fce52d7034 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:58.362924 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798af2b2-8488-4dc0-8139-64364b03c6b2 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:58.369118 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262248d-9fff-480e-a7e8-0f3b875f5b9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:58.369723 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262248d-9fff-480e-a7e8-0f3b875f5b9a service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:58.370186 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262248d-9fff-480e-a7e8-0f3b875f5b9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:58.370465 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262248d-9fff-480e-a7e8-0f3b875f5b9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:58.385077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262248d-9fff-480e-a7e8-0f3b875f5b9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:58.386715 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262248d-9fff-480e-a7e8-0f3b875f5b9a service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:58.404100 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1016/2042] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:45:58.455179 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-690836da-aeec-47ed-8583-53fce52d7034 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20b569d9d64a4fd3a856d78401401b3a', 'request_id': 'req-690836da-aeec-47ed-8583-53fce52d7034'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:58.470969 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-690836da-aeec-47ed-8583-53fce52d7034 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20b569d9d64a4fd3a856d78401401b3a', 'request_id': 'req-690836da-aeec-47ed-8583-53fce52d7034'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:58.488352 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-690836da-aeec-47ed-8583-53fce52d7034 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20b569d9d64a4fd3a856d78401401b3a', 'request_id': 'req-690836da-aeec-47ed-8583-53fce52d7034'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:58.505318 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-690836da-aeec-47ed-8583-53fce52d7034 admin admin] The token cache is being invalidate because project 20b569d9d64a4fd3a856d78401401b3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:45:58.505878 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-690836da-aeec-47ed-8583-53fce52d7034 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:58.507166 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-690836da-aeec-47ed-8583-53fce52d7034 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:58.515419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b41cc3-3a1d-454a-a264-66873b4b726c None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:58.515884 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b41cc3-3a1d-454a-a264-66873b4b726c None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:58.516281 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b41cc3-3a1d-454a-a264-66873b4b726c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:58.519597 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1027/2043] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:45:58 2022] DELETE /identity/v3/projects/20b569d9d64a4fd3a856d78401401b3a => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:58.540426 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-04b41cc3-3a1d-454a-a264-66873b4b726c None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:58.541809 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-04b41cc3-3a1d-454a-a264-66873b4b726c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:58.635975 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1017/2044] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:58.644290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9280e-e398-4a9a-9612-eba71f5d266a None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:58.644794 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9280e-e398-4a9a-9612-eba71f5d266a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:58.645147 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9280e-e398-4a9a-9612-eba71f5d266a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:58.674483 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-6ba9280e-e398-4a9a-9612-eba71f5d266a None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:58.675990 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6ba9280e-e398-4a9a-9612-eba71f5d266a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:58.690328 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1028/2045] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:58.696830 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b41cc3-3a1d-454a-a264-66873b4b726c None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:58.709523 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b41cc3-3a1d-454a-a264-66873b4b726c None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:58.724804 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5e318-c0b0-4154-a9be-14e707c400f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:58.726538 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5e318-c0b0-4154-a9be-14e707c400f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:58.726962 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5e318-c0b0-4154-a9be-14e707c400f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:58.727413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec5e318-c0b0-4154-a9be-14e707c400f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:58.728787 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5e318-c0b0-4154-a9be-14e707c400f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:45:58.729278 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5e318-c0b0-4154-a9be-14e707c400f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:58.731365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec5e318-c0b0-4154-a9be-14e707c400f0 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:58.756441 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1018/2046] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:45:58.762971 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9280e-e398-4a9a-9612-eba71f5d266a None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:58.775529 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9280e-e398-4a9a-9612-eba71f5d266a None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:58.782940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2134c82-c50a-4705-90a1-094833b61093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:58.783653 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2134c82-c50a-4705-90a1-094833b61093 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:58.784105 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2134c82-c50a-4705-90a1-094833b61093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:58.784450 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2134c82-c50a-4705-90a1-094833b61093 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:58.785202 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2134c82-c50a-4705-90a1-094833b61093 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:58.787478 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2134c82-c50a-4705-90a1-094833b61093 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:58.826818 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1029/2047] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:45:58 2022] POST /identity/v3/projects => generated 381 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:58.831441 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5e318-c0b0-4154-a9be-14e707c400f0 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:58.849648 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec5e318-c0b0-4154-a9be-14e707c400f0 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:58.930943 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b978a-f0b0-4a45-b886-fa031482241b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:58.932087 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b978a-f0b0-4a45-b886-fa031482241b admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:58.932576 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b978a-f0b0-4a45-b886-fa031482241b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:58.933108 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876b978a-f0b0-4a45-b886-fa031482241b admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:58.935082 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2134c82-c50a-4705-90a1-094833b61093 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:58.937059 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b2134c82-c50a-4705-90a1-094833b61093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:58.944541 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b978a-f0b0-4a45-b886-fa031482241b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:58.949238 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876b978a-f0b0-4a45-b886-fa031482241b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:58.950737 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2134c82-c50a-4705-90a1-094833b61093 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:58.961042 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd403c-fbf9-4ead-970e-03c4d235ddc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:58.962499 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd403c-fbf9-4ead-970e-03c4d235ddc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:58.964115 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd403c-fbf9-4ead-970e-03c4d235ddc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:58.964668 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd403c-fbf9-4ead-970e-03c4d235ddc7 admin admin] PATH_INFO: `/v3/projects/4cdf8bf097ae4868ba5ac0378663abb4` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:58.973604 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd403c-fbf9-4ead-970e-03c4d235ddc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cdf8bf097ae4868ba5ac0378663abb4)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:58.976998 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd403c-fbf9-4ead-970e-03c4d235ddc7 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:58.982853 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1019/2048] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:45:58 2022] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:58.985948 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b978a-f0b0-4a45-b886-fa031482241b admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:58.996681 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876b978a-f0b0-4a45-b886-fa031482241b admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:59.002541 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda64fe-9ea6-4c69-a7c4-d13033ebc864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:59.003171 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda64fe-9ea6-4c69-a7c4-d13033ebc864 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:59.003443 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda64fe-9ea6-4c69-a7c4-d13033ebc864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:59.005366 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda64fe-9ea6-4c69-a7c4-d13033ebc864 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:59.005366 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda64fe-9ea6-4c69-a7c4-d13033ebc864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:59.006032 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda64fe-9ea6-4c69-a7c4-d13033ebc864 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:59.021459 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1020/2049] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:45:59.025864 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda64fe-9ea6-4c69-a7c4-d13033ebc864 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:59.037453 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda64fe-9ea6-4c69-a7c4-d13033ebc864 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:59.046740 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6cdd403c-fbf9-4ead-970e-03c4d235ddc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cdf8bf097ae4868ba5ac0378663abb4', 'request_id': 'req-6cdd403c-fbf9-4ead-970e-03c4d235ddc7'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:59.057933 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6cdd403c-fbf9-4ead-970e-03c4d235ddc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cdf8bf097ae4868ba5ac0378663abb4', 'request_id': 'req-6cdd403c-fbf9-4ead-970e-03c4d235ddc7'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:59.067958 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6cdd403c-fbf9-4ead-970e-03c4d235ddc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cdf8bf097ae4868ba5ac0378663abb4', 'request_id': 'req-6cdd403c-fbf9-4ead-970e-03c4d235ddc7'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:59.084622 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6cdd403c-fbf9-4ead-970e-03c4d235ddc7 admin admin] The token cache is being invalidate because project 4cdf8bf097ae4868ba5ac0378663abb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:45:59.084622 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6cdd403c-fbf9-4ead-970e-03c4d235ddc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:59.086528 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6cdd403c-fbf9-4ead-970e-03c4d235ddc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:59.088709 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1030/2050] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:45:58 2022] DELETE /identity/v3/projects/4cdf8bf097ae4868ba5ac0378663abb4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:59.092238 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:59.093431 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd403c-fbf9-4ead-970e-03c4d235ddc7 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:59.095339 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6cdd403c-fbf9-4ead-970e-03c4d235ddc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:59.135831 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:59.138411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c372ae7-6795-4966-b250-1b40b0fcbb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:59.139287 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c372ae7-6795-4966-b250-1b40b0fcbb67 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:59.139723 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c372ae7-6795-4966-b250-1b40b0fcbb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:59.140122 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c372ae7-6795-4966-b250-1b40b0fcbb67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:59.140951 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c372ae7-6795-4966-b250-1b40b0fcbb67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:59.143504 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c372ae7-6795-4966-b250-1b40b0fcbb67 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:59.156519 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1021/2051] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:45:59 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:45:59.161210 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c372ae7-6795-4966-b250-1b40b0fcbb67 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:59.164231 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0c372ae7-6795-4966-b250-1b40b0fcbb67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:59.185148 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c372ae7-6795-4966-b250-1b40b0fcbb67 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:59.193455 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73612b56-d5ba-48ba-8002-f30a809f6ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:59.194818 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73612b56-d5ba-48ba-8002-f30a809f6ae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:59.194818 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73612b56-d5ba-48ba-8002-f30a809f6ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:59.195153 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73612b56-d5ba-48ba-8002-f30a809f6ae5 admin admin] PATH_INFO: `/v3/projects/0542f539019b4c80a23056d3731b5d29/users/51e42e48156a48628d4584c249727c80/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:59.201773 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd403c-fbf9-4ead-970e-03c4d235ddc7 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:59.211457 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b556c8-666e-4a4c-915e-5b3f14e62826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:59.212158 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b556c8-666e-4a4c-915e-5b3f14e62826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:59.212510 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b556c8-666e-4a4c-915e-5b3f14e62826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:59.212685 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b556c8-666e-4a4c-915e-5b3f14e62826 admin admin] PATH_INFO: `/v3/users/f406d98445a94acf8406b6790dca95f3` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:59.214571 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b556c8-666e-4a4c-915e-5b3f14e62826 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f406d98445a94acf8406b6790dca95f3)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:59.216334 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b556c8-666e-4a4c-915e-5b3f14e62826 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:59.221996 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73612b56-d5ba-48ba-8002-f30a809f6ae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0542f539019b4c80a23056d3731b5d29, user_id=51e42e48156a48628d4584c249727c80, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:59.226228 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73612b56-d5ba-48ba-8002-f30a809f6ae5 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:59.255341 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1022/2052] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:45:59 2022] PUT /identity/v3/projects/0542f539019b4c80a23056d3731b5d29/users/51e42e48156a48628d4584c249727c80/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:59.265358 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73612b56-d5ba-48ba-8002-f30a809f6ae5 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:59.268280 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-73612b56-d5ba-48ba-8002-f30a809f6ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:59.292726 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-95b556c8-666e-4a4c-915e-5b3f14e62826 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f406d98445a94acf8406b6790dca95f3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:59.304880 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-95b556c8-666e-4a4c-915e-5b3f14e62826 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f406d98445a94acf8406b6790dca95f3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:59.305896 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-95b556c8-666e-4a4c-915e-5b3f14e62826 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f406d98445a94acf8406b6790dca95f3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:59.328786 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-95b556c8-666e-4a4c-915e-5b3f14e62826 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f406d98445a94acf8406b6790dca95f3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:59.340636 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-95b556c8-666e-4a4c-915e-5b3f14e62826 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f406d98445a94acf8406b6790dca95f3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:59.355844 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1031/2053] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:45:59 2022] DELETE /identity/v3/users/f406d98445a94acf8406b6790dca95f3 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:45:59.357450 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48643f9a-b10a-4451-9373-c496a5f7c156 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:59.357751 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48643f9a-b10a-4451-9373-c496a5f7c156 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:59.358012 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48643f9a-b10a-4451-9373-c496a5f7c156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:59.387530 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73612b56-d5ba-48ba-8002-f30a809f6ae5 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:59.401248 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-48643f9a-b10a-4451-9373-c496a5f7c156 None None] MFA Rules not processed for user `51e42e48156a48628d4584c249727c80`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:59.403520 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-48643f9a-b10a-4451-9373-c496a5f7c156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:59.462319 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702bcee-b793-4266-a3dd-9d58112e63d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:59.462319 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702bcee-b793-4266-a3dd-9d58112e63d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:59.463047 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702bcee-b793-4266-a3dd-9d58112e63d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:59.463047 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702bcee-b793-4266-a3dd-9d58112e63d8 admin admin] PATH_INFO: `/v3/users/87f4b7aa15c542bfa691d48f38f23b77` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:59.464511 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a702bcee-b793-4266-a3dd-9d58112e63d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87f4b7aa15c542bfa691d48f38f23b77)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:59.466760 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a702bcee-b793-4266-a3dd-9d58112e63d8 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:59.518468 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1032/2054] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:45:59.525283 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48643f9a-b10a-4451-9373-c496a5f7c156 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:59.527721 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-48643f9a-b10a-4451-9373-c496a5f7c156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:59.548666 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a702bcee-b793-4266-a3dd-9d58112e63d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87f4b7aa15c542bfa691d48f38f23b77'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:59.550398 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48643f9a-b10a-4451-9373-c496a5f7c156 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:59.557077 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09c593-7bc4-4b79-904a-a47a7a35b9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:59.557882 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09c593-7bc4-4b79-904a-a47a7a35b9d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:59.558331 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09c593-7bc4-4b79-904a-a47a7a35b9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:59.558551 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09c593-7bc4-4b79-904a-a47a7a35b9d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:59.559495 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09c593-7bc4-4b79-904a-a47a7a35b9d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:59.561814 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09c593-7bc4-4b79-904a-a47a7a35b9d8 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:59.569354 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a702bcee-b793-4266-a3dd-9d58112e63d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87f4b7aa15c542bfa691d48f38f23b77'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:59.578914 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:59.594990 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a702bcee-b793-4266-a3dd-9d58112e63d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87f4b7aa15c542bfa691d48f38f23b77'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:59.596508 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a702bcee-b793-4266-a3dd-9d58112e63d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87f4b7aa15c542bfa691d48f38f23b77'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:59.606316 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1033/2055] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:45:59 2022] POST /identity/v3/projects => generated 379 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:45:59.610219 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a702bcee-b793-4266-a3dd-9d58112e63d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87f4b7aa15c542bfa691d48f38f23b77'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:45:59.611363 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09c593-7bc4-4b79-904a-a47a7a35b9d8 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:59.614100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1e09c593-7bc4-4b79-904a-a47a7a35b9d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:59.620831 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1023/2056] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:45:59 2022] DELETE /identity/v3/users/87f4b7aa15c542bfa691d48f38f23b77 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:45:59.626821 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5de0f2-b57d-4dfb-9146-4477bd627887 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:59.627951 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5de0f2-b57d-4dfb-9146-4477bd627887 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:59.628357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5de0f2-b57d-4dfb-9146-4477bd627887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:59.649840 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:45:59.668144 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-6e5de0f2-b57d-4dfb-9146-4477bd627887 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:45:59.670271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-6e5de0f2-b57d-4dfb-9146-4477bd627887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:59.802506 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09c593-7bc4-4b79-904a-a47a7a35b9d8 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:45:59.827846 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1024/2057] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:45:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:45:59.843444 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5de0f2-b57d-4dfb-9146-4477bd627887 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:45:59.845349 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-6e5de0f2-b57d-4dfb-9146-4477bd627887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:45:59.949546 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f59b7-bade-47c5-a882-308c749492cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:45:59.950315 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f59b7-bade-47c5-a882-308c749492cb admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:45:59.950596 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f59b7-bade-47c5-a882-308c749492cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:45:59.950868 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3f59b7-bade-47c5-a882-308c749492cb admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:45:59.951547 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f59b7-bade-47c5-a882-308c749492cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:45:59.955496 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3f59b7-bade-47c5-a882-308c749492cb admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:45:59.984478 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5de0f2-b57d-4dfb-9146-4477bd627887 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:00.002214 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf1dd0-4c0a-4682-9f77-78d82c57ad63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:00.003472 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf1dd0-4c0a-4682-9f77-78d82c57ad63 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:00.004350 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf1dd0-4c0a-4682-9f77-78d82c57ad63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:00.004743 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf1dd0-4c0a-4682-9f77-78d82c57ad63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:00.013349 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1034/2058] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:45:59 2022] POST /identity/v3/users => generated 296 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:46:00.017565 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f59b7-bade-47c5-a882-308c749492cb admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:00.021206 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf1dd0-4c0a-4682-9f77-78d82c57ad63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:00.023138 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf1dd0-4c0a-4682-9f77-78d82c57ad63 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:00.038447 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1025/2059] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:45:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:46:00.042118 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3f59b7-bade-47c5-a882-308c749492cb admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:00.057285 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd91fa-f0c4-46bf-aecb-efa5ac3c87e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:00.060537 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd91fa-f0c4-46bf-aecb-efa5ac3c87e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:00.060961 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd91fa-f0c4-46bf-aecb-efa5ac3c87e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:00.061340 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd91fa-f0c4-46bf-aecb-efa5ac3c87e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:00.064492 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd91fa-f0c4-46bf-aecb-efa5ac3c87e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:00.070635 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bd91fa-f0c4-46bf-aecb-efa5ac3c87e7 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:00.106602 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1035/2060] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:46:00.109706 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf1dd0-4c0a-4682-9f77-78d82c57ad63 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:00.131763 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf1dd0-4c0a-4682-9f77-78d82c57ad63 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:00.140588 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd91fa-f0c4-46bf-aecb-efa5ac3c87e7 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:00.143593 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecfec9-7c00-4887-aa58-6ee1d5c72edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:00.145433 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-79bd91fa-f0c4-46bf-aecb-efa5ac3c87e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:00.147474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecfec9-7c00-4887-aa58-6ee1d5c72edf admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:00.148433 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecfec9-7c00-4887-aa58-6ee1d5c72edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:00.148869 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ecfec9-7c00-4887-aa58-6ee1d5c72edf admin admin] PATH_INFO: `/v3/projects/9f3eeeb3beba47f7ab0add3d204208ef/users/ec82a7d330fc40b4ab06c3a0c84ac718/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:00.181128 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd91fa-f0c4-46bf-aecb-efa5ac3c87e7 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:00.204020 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247ada4-f334-4ada-bb23-00bc8bfd4a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:00.204699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247ada4-f334-4ada-bb23-00bc8bfd4a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:00.204975 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247ada4-f334-4ada-bb23-00bc8bfd4a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:00.206645 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247ada4-f334-4ada-bb23-00bc8bfd4a3b admin admin] PATH_INFO: `/v3/projects/1a06bdf2432143e1b84e997fdbe19d2c` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:00.208440 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e247ada4-f334-4ada-bb23-00bc8bfd4a3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a06bdf2432143e1b84e997fdbe19d2c)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:00.210489 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e247ada4-f334-4ada-bb23-00bc8bfd4a3b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:00.213913 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ecfec9-7c00-4887-aa58-6ee1d5c72edf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f3eeeb3beba47f7ab0add3d204208ef, user_id=ec82a7d330fc40b4ab06c3a0c84ac718, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:00.216988 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ecfec9-7c00-4887-aa58-6ee1d5c72edf admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:00.245198 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1026/2061] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:46:00 2022] PUT /identity/v3/projects/9f3eeeb3beba47f7ab0add3d204208ef/users/ec82a7d330fc40b4ab06c3a0c84ac718/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:00.251479 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecfec9-7c00-4887-aa58-6ee1d5c72edf admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:00.350258 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e247ada4-f334-4ada-bb23-00bc8bfd4a3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a06bdf2432143e1b84e997fdbe19d2c', 'request_id': 'req-e247ada4-f334-4ada-bb23-00bc8bfd4a3b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:00.361305 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:00.369495 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e247ada4-f334-4ada-bb23-00bc8bfd4a3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a06bdf2432143e1b84e997fdbe19d2c', 'request_id': 'req-e247ada4-f334-4ada-bb23-00bc8bfd4a3b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:00.369786 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ecfec9-7c00-4887-aa58-6ee1d5c72edf admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:00.394939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e247ada4-f334-4ada-bb23-00bc8bfd4a3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a06bdf2432143e1b84e997fdbe19d2c', 'request_id': 'req-e247ada4-f334-4ada-bb23-00bc8bfd4a3b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:00.437206 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e247ada4-f334-4ada-bb23-00bc8bfd4a3b admin admin] The token cache is being invalidate because project 1a06bdf2432143e1b84e997fdbe19d2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:46:00.439606 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e247ada4-f334-4ada-bb23-00bc8bfd4a3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:00.441114 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e247ada4-f334-4ada-bb23-00bc8bfd4a3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:00.446731 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1036/2062] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:46:00 2022] DELETE /identity/v3/projects/1a06bdf2432143e1b84e997fdbe19d2c => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:46:00.452436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247ada4-f334-4ada-bb23-00bc8bfd4a3b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:00.455956 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e247ada4-f334-4ada-bb23-00bc8bfd4a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:00.493952 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbea444-4d97-4417-997e-ccf8345d917d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:00.495524 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbea444-4d97-4417-997e-ccf8345d917d admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:00.496428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbea444-4d97-4417-997e-ccf8345d917d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:00.496428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbea444-4d97-4417-997e-ccf8345d917d admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:00.496823 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbea444-4d97-4417-997e-ccf8345d917d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:00.499601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbea444-4d97-4417-997e-ccf8345d917d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:00.516486 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:00.518671 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1027/2063] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:46:00.524002 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbea444-4d97-4417-997e-ccf8345d917d admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:00.527338 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4cbea444-4d97-4417-997e-ccf8345d917d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:00.548265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbea444-4d97-4417-997e-ccf8345d917d admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:00.553416 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef37f6-6087-40dc-a3df-ea33adc7e26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:00.554159 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef37f6-6087-40dc-a3df-ea33adc7e26d admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:00.554712 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef37f6-6087-40dc-a3df-ea33adc7e26d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:00.555060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef37f6-6087-40dc-a3df-ea33adc7e26d admin admin] PATH_INFO: `/v3/projects/9f3eeeb3beba47f7ab0add3d204208ef/users/ec82a7d330fc40b4ab06c3a0c84ac718/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:00.559104 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef37f6-6087-40dc-a3df-ea33adc7e26d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f3eeeb3beba47f7ab0add3d204208ef, user_id=ec82a7d330fc40b4ab06c3a0c84ac718, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:00.562334 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef37f6-6087-40dc-a3df-ea33adc7e26d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:00.596661 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1028/2064] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:46:00 2022] PUT /identity/v3/projects/9f3eeeb3beba47f7ab0add3d204208ef/users/ec82a7d330fc40b4ab06c3a0c84ac718/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:00.599413 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247ada4-f334-4ada-bb23-00bc8bfd4a3b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:00.601736 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e80906-fc9c-4bf5-8226-32bee51c5b3a None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:00.602100 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e80906-fc9c-4bf5-8226-32bee51c5b3a None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:00.602475 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e80906-fc9c-4bf5-8226-32bee51c5b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:00.646977 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-73e80906-fc9c-4bf5-8226-32bee51c5b3a None None] MFA Rules not processed for user `ec82a7d330fc40b4ab06c3a0c84ac718`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:00.649958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-73e80906-fc9c-4bf5-8226-32bee51c5b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:00.718565 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70bb6b-baaa-4899-8550-c19a2620feb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:00.719504 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70bb6b-baaa-4899-8550-c19a2620feb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:00.720002 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70bb6b-baaa-4899-8550-c19a2620feb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:00.720502 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70bb6b-baaa-4899-8550-c19a2620feb3 admin admin] PATH_INFO: `/v3/users/bdf6e845b6404fd3944b3d47054de14f` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:00.722927 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70bb6b-baaa-4899-8550-c19a2620feb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdf6e845b6404fd3944b3d47054de14f)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:00.727708 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70bb6b-baaa-4899-8550-c19a2620feb3 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:00.801467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1029/2065] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:00 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:00.802315 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e80906-fc9c-4bf5-8226-32bee51c5b3a None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:00.804030 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-73e80906-fc9c-4bf5-8226-32bee51c5b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:00.819305 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e80906-fc9c-4bf5-8226-32bee51c5b3a None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:00.825635 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14adfa-79b3-40eb-82f3-76f059ce8dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:00.826557 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14adfa-79b3-40eb-82f3-76f059ce8dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:00.826934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14adfa-79b3-40eb-82f3-76f059ce8dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:00.827331 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14adfa-79b3-40eb-82f3-76f059ce8dfa admin admin] PATH_INFO: `/v3/projects/970dba232b2d4ae5947677f2ebd1f5e7` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:00.828976 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de14adfa-79b3-40eb-82f3-76f059ce8dfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=970dba232b2d4ae5947677f2ebd1f5e7)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:00.831340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de14adfa-79b3-40eb-82f3-76f059ce8dfa admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:00.860412 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5a70bb6b-baaa-4899-8550-c19a2620feb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdf6e845b6404fd3944b3d47054de14f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:00.876799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5a70bb6b-baaa-4899-8550-c19a2620feb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdf6e845b6404fd3944b3d47054de14f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:00.877824 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5a70bb6b-baaa-4899-8550-c19a2620feb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdf6e845b6404fd3944b3d47054de14f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:00.896075 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5a70bb6b-baaa-4899-8550-c19a2620feb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdf6e845b6404fd3944b3d47054de14f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:00.906062 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5a70bb6b-baaa-4899-8550-c19a2620feb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdf6e845b6404fd3944b3d47054de14f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:00.914825 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1037/2066] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:46:00 2022] DELETE /identity/v3/users/bdf6e845b6404fd3944b3d47054de14f => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:46:00.916955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-de14adfa-79b3-40eb-82f3-76f059ce8dfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '970dba232b2d4ae5947677f2ebd1f5e7', 'request_id': 'req-de14adfa-79b3-40eb-82f3-76f059ce8dfa'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:00.917132 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70bb6b-baaa-4899-8550-c19a2620feb3 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:00.918895 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5a70bb6b-baaa-4899-8550-c19a2620feb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:00.932774 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-de14adfa-79b3-40eb-82f3-76f059ce8dfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '970dba232b2d4ae5947677f2ebd1f5e7', 'request_id': 'req-de14adfa-79b3-40eb-82f3-76f059ce8dfa'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:00.950088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-de14adfa-79b3-40eb-82f3-76f059ce8dfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '970dba232b2d4ae5947677f2ebd1f5e7', 'request_id': 'req-de14adfa-79b3-40eb-82f3-76f059ce8dfa'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:00.952556 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:00.983619 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-de14adfa-79b3-40eb-82f3-76f059ce8dfa admin admin] The token cache is being invalidate because project 970dba232b2d4ae5947677f2ebd1f5e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:46:00.983966 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-de14adfa-79b3-40eb-82f3-76f059ce8dfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:00.984946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-de14adfa-79b3-40eb-82f3-76f059ce8dfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:00.991569 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1030/2067] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:46:00 2022] DELETE /identity/v3/projects/970dba232b2d4ae5947677f2ebd1f5e7 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:00.994262 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14adfa-79b3-40eb-82f3-76f059ce8dfa admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:00.996554 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-de14adfa-79b3-40eb-82f3-76f059ce8dfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:01.016663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70bb6b-baaa-4899-8550-c19a2620feb3 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:01.029661 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89486701-71f9-4a81-819c-950b8703689b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:01.030602 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89486701-71f9-4a81-819c-950b8703689b service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:01.032189 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89486701-71f9-4a81-819c-950b8703689b service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:01.034248 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89486701-71f9-4a81-819c-950b8703689b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:01.039225 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-89486701-71f9-4a81-819c-950b8703689b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:01.052325 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:01.138601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14adfa-79b3-40eb-82f3-76f059ce8dfa admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:01.221696 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89486701-71f9-4a81-819c-950b8703689b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:01.223758 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89486701-71f9-4a81-819c-950b8703689b service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:01.254948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1038/2068] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:00 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:46:01.266964 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4ea2a-e506-423b-a643-8bcdbf44cadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:01.267777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4ea2a-e506-423b-a643-8bcdbf44cadc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:01.268059 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4ea2a-e506-423b-a643-8bcdbf44cadc admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:01.268342 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4ea2a-e506-423b-a643-8bcdbf44cadc admin admin] PATH_INFO: `/v3/users/9b2cf1a409724835a2305664d4adac6a` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:01.271322 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4ea2a-e506-423b-a643-8bcdbf44cadc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b2cf1a409724835a2305664d4adac6a)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:01.273509 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4ea2a-e506-423b-a643-8bcdbf44cadc admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:01.328348 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89486701-71f9-4a81-819c-950b8703689b service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:01.330041 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-89486701-71f9-4a81-819c-950b8703689b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:01.366165 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89486701-71f9-4a81-819c-950b8703689b service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:01.378760 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bb8fe-08de-4bc6-b049-4af1ae3243a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:01.379765 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bb8fe-08de-4bc6-b049-4af1ae3243a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:01.381138 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bb8fe-08de-4bc6-b049-4af1ae3243a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:01.381639 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bb8fe-08de-4bc6-b049-4af1ae3243a8 admin admin] PATH_INFO: `/v3/projects/73341e6d204f4694b76fb4a346e5faf6` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:01.383675 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bb8fe-08de-4bc6-b049-4af1ae3243a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73341e6d204f4694b76fb4a346e5faf6)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:01.391017 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bb8fe-08de-4bc6-b049-4af1ae3243a8 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:01.397833 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-19d4ea2a-e506-423b-a643-8bcdbf44cadc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b2cf1a409724835a2305664d4adac6a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:01.424063 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-19d4ea2a-e506-423b-a643-8bcdbf44cadc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b2cf1a409724835a2305664d4adac6a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:01.477990 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-19d4ea2a-e506-423b-a643-8bcdbf44cadc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b2cf1a409724835a2305664d4adac6a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:01.479130 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-19d4ea2a-e506-423b-a643-8bcdbf44cadc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b2cf1a409724835a2305664d4adac6a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:01.511978 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-19d4ea2a-e506-423b-a643-8bcdbf44cadc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b2cf1a409724835a2305664d4adac6a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:01.541836 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1031/2069] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:46:00 2022] DELETE /identity/v3/users/9b2cf1a409724835a2305664d4adac6a => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:01.575940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-201bb8fe-08de-4bc6-b049-4af1ae3243a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73341e6d204f4694b76fb4a346e5faf6', 'request_id': 'req-201bb8fe-08de-4bc6-b049-4af1ae3243a8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:01.600862 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-201bb8fe-08de-4bc6-b049-4af1ae3243a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73341e6d204f4694b76fb4a346e5faf6', 'request_id': 'req-201bb8fe-08de-4bc6-b049-4af1ae3243a8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:01.613963 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-201bb8fe-08de-4bc6-b049-4af1ae3243a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73341e6d204f4694b76fb4a346e5faf6', 'request_id': 'req-201bb8fe-08de-4bc6-b049-4af1ae3243a8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:01.640420 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-201bb8fe-08de-4bc6-b049-4af1ae3243a8 admin admin] The token cache is being invalidate because project 73341e6d204f4694b76fb4a346e5faf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:46:01.640686 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-201bb8fe-08de-4bc6-b049-4af1ae3243a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:01.641463 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-201bb8fe-08de-4bc6-b049-4af1ae3243a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:01.649063 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1039/2070] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:46:01 2022] DELETE /identity/v3/projects/73341e6d204f4694b76fb4a346e5faf6 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:46:01.650640 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608321e0-1b77-48a3-b766-27455fe0d8a6 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:01.650874 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608321e0-1b77-48a3-b766-27455fe0d8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:01.651139 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608321e0-1b77-48a3-b766-27455fe0d8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:01.693277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-608321e0-1b77-48a3-b766-27455fe0d8a6 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:01.694681 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-608321e0-1b77-48a3-b766-27455fe0d8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:01.730897 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:01.852320 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1032/2071] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:01.862700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b3b76-b995-4a40-a692-b939bc717777 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:01.863279 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b3b76-b995-4a40-a692-b939bc717777 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:01.863279 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b3b76-b995-4a40-a692-b939bc717777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:01.912572 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-256b3b76-b995-4a40-a692-b939bc717777 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:01.914309 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-256b3b76-b995-4a40-a692-b939bc717777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:01.927549 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1040/2072] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:01.929572 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608321e0-1b77-48a3-b766-27455fe0d8a6 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:01.948642 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608321e0-1b77-48a3-b766-27455fe0d8a6 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:01.958444 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40febd67-a039-436f-8934-cf533312f8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:01.959283 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40febd67-a039-436f-8934-cf533312f8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:01.959543 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40febd67-a039-436f-8934-cf533312f8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:01.959866 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40febd67-a039-436f-8934-cf533312f8d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:01.960871 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40febd67-a039-436f-8934-cf533312f8d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:46:01.961265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40febd67-a039-436f-8934-cf533312f8d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:01.962934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40febd67-a039-436f-8934-cf533312f8d1 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:01.983796 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1033/2073] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:46:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:46:01.986514 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b3b76-b995-4a40-a692-b939bc717777 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:02.001618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40febd67-a039-436f-8934-cf533312f8d1 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:02.006432 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b3b76-b995-4a40-a692-b939bc717777 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:02.007149 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-40febd67-a039-436f-8934-cf533312f8d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:02.022337 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa178a-6ec7-4b19-8c54-f29f68349bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:02.024432 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa178a-6ec7-4b19-8c54-f29f68349bea admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:02.024903 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa178a-6ec7-4b19-8c54-f29f68349bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:02.025375 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa178a-6ec7-4b19-8c54-f29f68349bea admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:02.026551 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa178a-6ec7-4b19-8c54-f29f68349bea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:02.031151 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa178a-6ec7-4b19-8c54-f29f68349bea admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:02.038902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40febd67-a039-436f-8934-cf533312f8d1 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:02.050200 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5e6ff-632f-4da5-8323-32d509648d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:02.053139 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5e6ff-632f-4da5-8323-32d509648d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:02.054051 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5e6ff-632f-4da5-8323-32d509648d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:02.054767 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5e6ff-632f-4da5-8323-32d509648d9a admin admin] PATH_INFO: `/v3/users/51e42e48156a48628d4584c249727c80` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:02.057347 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5e6ff-632f-4da5-8323-32d509648d9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=51e42e48156a48628d4584c249727c80)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:02.063892 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5e6ff-632f-4da5-8323-32d509648d9a admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:02.107784 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1041/2074] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:46:01 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:46:02.109575 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa178a-6ec7-4b19-8c54-f29f68349bea admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:02.158005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-abd5e6ff-632f-4da5-8323-32d509648d9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51e42e48156a48628d4584c249727c80'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:02.176385 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-abd5e6ff-632f-4da5-8323-32d509648d9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51e42e48156a48628d4584c249727c80'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:02.202234 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-abd5e6ff-632f-4da5-8323-32d509648d9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51e42e48156a48628d4584c249727c80'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:02.203071 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-abd5e6ff-632f-4da5-8323-32d509648d9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51e42e48156a48628d4584c249727c80'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:02.214137 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-abd5e6ff-632f-4da5-8323-32d509648d9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51e42e48156a48628d4584c249727c80'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:02.225845 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1034/2075] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:46:01 2022] DELETE /identity/v3/users/51e42e48156a48628d4584c249727c80 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:46:02.226863 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5e6ff-632f-4da5-8323-32d509648d9a admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:02.228875 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-abd5e6ff-632f-4da5-8323-32d509648d9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:02.287507 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:02.300156 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa178a-6ec7-4b19-8c54-f29f68349bea admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:02.369829 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5e6ff-632f-4da5-8323-32d509648d9a admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:02.379477 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0fdff-1218-4913-ab7a-255e22362fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:02.381950 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0fdff-1218-4913-ab7a-255e22362fc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:02.382433 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0fdff-1218-4913-ab7a-255e22362fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:02.384924 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0fdff-1218-4913-ab7a-255e22362fc9 admin admin] PATH_INFO: `/v3/projects/6d83be6d7aa341e9b994ea438b6e2a69` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:02.387406 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0fdff-1218-4913-ab7a-255e22362fc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d83be6d7aa341e9b994ea438b6e2a69)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:02.391250 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0fdff-1218-4913-ab7a-255e22362fc9 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:02.416215 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762c88d-8c04-4ae3-ae74-f896b8f49748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:02.416862 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762c88d-8c04-4ae3-ae74-f896b8f49748 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:02.417146 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762c88d-8c04-4ae3-ae74-f896b8f49748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:02.417420 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762c88d-8c04-4ae3-ae74-f896b8f49748 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:02.418341 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762c88d-8c04-4ae3-ae74-f896b8f49748 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:02.421298 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762c88d-8c04-4ae3-ae74-f896b8f49748 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:02.438973 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:02.466838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1042/2076] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:46:02 2022] POST /identity/v3/users => generated 287 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:46:02.466838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46663dd2-2464-4a7d-a5cc-b804f8f70e32 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:02.466838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46663dd2-2464-4a7d-a5cc-b804f8f70e32 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:02.466838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46663dd2-2464-4a7d-a5cc-b804f8f70e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:02.488844 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-42c0fdff-1218-4913-ab7a-255e22362fc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d83be6d7aa341e9b994ea438b6e2a69', 'request_id': 'req-42c0fdff-1218-4913-ab7a-255e22362fc9'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:02.500147 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-42c0fdff-1218-4913-ab7a-255e22362fc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d83be6d7aa341e9b994ea438b6e2a69', 'request_id': 'req-42c0fdff-1218-4913-ab7a-255e22362fc9'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:02.503761 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-46663dd2-2464-4a7d-a5cc-b804f8f70e32 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:02.507400 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-46663dd2-2464-4a7d-a5cc-b804f8f70e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:02.520398 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-42c0fdff-1218-4913-ab7a-255e22362fc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d83be6d7aa341e9b994ea438b6e2a69', 'request_id': 'req-42c0fdff-1218-4913-ab7a-255e22362fc9'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:02.542125 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-42c0fdff-1218-4913-ab7a-255e22362fc9 admin admin] The token cache is being invalidate because project 6d83be6d7aa341e9b994ea438b6e2a69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:46:02.542654 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-42c0fdff-1218-4913-ab7a-255e22362fc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:02.544253 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-42c0fdff-1218-4913-ab7a-255e22362fc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:02.546088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1035/2077] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:46:02 2022] DELETE /identity/v3/projects/6d83be6d7aa341e9b994ea438b6e2a69 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:02.546874 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0fdff-1218-4913-ab7a-255e22362fc9 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:02.553146 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-42c0fdff-1218-4913-ab7a-255e22362fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:02.701744 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0fdff-1218-4913-ab7a-255e22362fc9 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:02.719020 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682390be-1e1d-41dc-bcbe-38d765c60bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:02.719979 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682390be-1e1d-41dc-bcbe-38d765c60bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:02.720495 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682390be-1e1d-41dc-bcbe-38d765c60bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:02.720918 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682390be-1e1d-41dc-bcbe-38d765c60bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:02.722240 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682390be-1e1d-41dc-bcbe-38d765c60bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:02.724380 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682390be-1e1d-41dc-bcbe-38d765c60bc9 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:02.741332 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1036/2078] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:46:02.747012 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b73d7e-2d4a-4ada-bfd6-be7d538ed8ff None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:02.747560 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b73d7e-2d4a-4ada-bfd6-be7d538ed8ff None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:02.748032 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b73d7e-2d4a-4ada-bfd6-be7d538ed8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:02.775891 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-00b73d7e-2d4a-4ada-bfd6-be7d538ed8ff None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:02.777457 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-00b73d7e-2d4a-4ada-bfd6-be7d538ed8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:02.788202 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1037/2079] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:02.789396 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b73d7e-2d4a-4ada-bfd6-be7d538ed8ff None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:02.825866 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b73d7e-2d4a-4ada-bfd6-be7d538ed8ff None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:02.830013 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1043/2080] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:02.850026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636c6c3-f435-42bd-9143-136ed82b4e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:02.850884 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636c6c3-f435-42bd-9143-136ed82b4e35 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:02.851061 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee9909-d0be-4e98-adcc-31f51223d672 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:02.851344 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636c6c3-f435-42bd-9143-136ed82b4e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:02.851656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0636c6c3-f435-42bd-9143-136ed82b4e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:02.851834 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee9909-d0be-4e98-adcc-31f51223d672 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:02.852290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee9909-d0be-4e98-adcc-31f51223d672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:02.852481 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0636c6c3-f435-42bd-9143-136ed82b4e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:02.856274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0636c6c3-f435-42bd-9143-136ed82b4e35 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:02.869446 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1038/2081] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:46:02.875320 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636c6c3-f435-42bd-9143-136ed82b4e35 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:02.891656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0636c6c3-f435-42bd-9143-136ed82b4e35 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:02.893400 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b1ee9909-d0be-4e98-adcc-31f51223d672 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:02.895992 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b1ee9909-d0be-4e98-adcc-31f51223d672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:02.899588 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09093c-0d81-4c82-94fc-6883cf077336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:02.900568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09093c-0d81-4c82-94fc-6883cf077336 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:02.900934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09093c-0d81-4c82-94fc-6883cf077336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:02.901388 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09093c-0d81-4c82-94fc-6883cf077336 admin admin] PATH_INFO: `/v3/projects/9571799e2aed497eb33dc772a2a42cf6/users/cb1b63f434b24b208a457b02c3ed2bc2/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:02.909908 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1044/2082] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:02.912591 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee9909-d0be-4e98-adcc-31f51223d672 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:02.914239 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b1ee9909-d0be-4e98-adcc-31f51223d672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:02.933683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09093c-0d81-4c82-94fc-6883cf077336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9571799e2aed497eb33dc772a2a42cf6, user_id=cb1b63f434b24b208a457b02c3ed2bc2, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:02.937557 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09093c-0d81-4c82-94fc-6883cf077336 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:02.982422 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1039/2083] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:46:02 2022] PUT /identity/v3/projects/9571799e2aed497eb33dc772a2a42cf6/users/cb1b63f434b24b208a457b02c3ed2bc2/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:46:02.983553 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09093c-0d81-4c82-94fc-6883cf077336 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:03.029787 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee9909-d0be-4e98-adcc-31f51223d672 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:03.097242 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09093c-0d81-4c82-94fc-6883cf077336 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:03.106373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:03.114399 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b867e71-437b-4d47-a7b0-9648700ceef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:03.115947 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b867e71-437b-4d47-a7b0-9648700ceef8 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:03.116320 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b867e71-437b-4d47-a7b0-9648700ceef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:03.116718 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b867e71-437b-4d47-a7b0-9648700ceef8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:03.117435 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b867e71-437b-4d47-a7b0-9648700ceef8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:46:03.117781 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b867e71-437b-4d47-a7b0-9648700ceef8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:03.120512 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b867e71-437b-4d47-a7b0-9648700ceef8 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:03.130921 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:03.139640 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1040/2084] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:46:03.142968 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf969369-4b9f-4656-8311-94c0b94c059e None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:03.142968 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf969369-4b9f-4656-8311-94c0b94c059e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:03.143282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf969369-4b9f-4656-8311-94c0b94c059e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:03.146203 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243c02a-b5a4-47c0-8313-b09f824ff7db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:03.146747 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243c02a-b5a4-47c0-8313-b09f824ff7db service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:03.147257 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243c02a-b5a4-47c0-8313-b09f824ff7db service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:03.147632 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243c02a-b5a4-47c0-8313-b09f824ff7db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:03.180728 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243c02a-b5a4-47c0-8313-b09f824ff7db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:03.182640 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243c02a-b5a4-47c0-8313-b09f824ff7db service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:03.202815 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1045/2085] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:46:03.204765 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243c02a-b5a4-47c0-8313-b09f824ff7db service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:03.219268 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243c02a-b5a4-47c0-8313-b09f824ff7db service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:03.227556 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-bf969369-4b9f-4656-8311-94c0b94c059e None None] MFA Rules not processed for user `cb1b63f434b24b208a457b02c3ed2bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:03.229387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-bf969369-4b9f-4656-8311-94c0b94c059e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:03.230278 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c4e72-eb6f-465e-ae96-aa8f508109e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:03.231192 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c4e72-eb6f-465e-ae96-aa8f508109e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:03.231891 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c4e72-eb6f-465e-ae96-aa8f508109e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:03.232459 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c4e72-eb6f-465e-ae96-aa8f508109e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:03.233273 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c4e72-eb6f-465e-ae96-aa8f508109e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:03.235850 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c4e72-eb6f-465e-ae96-aa8f508109e1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:03.301508 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1046/2086] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:46:03 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:46:03.306728 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c4e72-eb6f-465e-ae96-aa8f508109e1 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:03.345436 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1041/2087] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:03.371502 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf969369-4b9f-4656-8311-94c0b94c059e None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:03.374645 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-bf969369-4b9f-4656-8311-94c0b94c059e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:03.477095 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c4e72-eb6f-465e-ae96-aa8f508109e1 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:03.485602 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff9595-960c-499a-9063-cbe299ccc62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:03.486745 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff9595-960c-499a-9063-cbe299ccc62a admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:03.487046 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff9595-960c-499a-9063-cbe299ccc62a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:03.487323 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff9595-960c-499a-9063-cbe299ccc62a admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:03.488067 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff9595-960c-499a-9063-cbe299ccc62a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:03.492045 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff9595-960c-499a-9063-cbe299ccc62a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:03.531823 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1047/2088] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:46:03 2022] POST /identity/v3/users => generated 283 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:46:03.537360 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff9595-960c-499a-9063-cbe299ccc62a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:03.558949 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff9595-960c-499a-9063-cbe299ccc62a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:03.566716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd2d7e-0406-4d40-bbb6-26a4d42d54f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:03.568128 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd2d7e-0406-4d40-bbb6-26a4d42d54f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:03.568552 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd2d7e-0406-4d40-bbb6-26a4d42d54f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:03.568926 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fd2d7e-0406-4d40-bbb6-26a4d42d54f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:03.569716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd2d7e-0406-4d40-bbb6-26a4d42d54f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:03.572806 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fd2d7e-0406-4d40-bbb6-26a4d42d54f1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:03.594533 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1048/2089] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:46:03.597696 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd2d7e-0406-4d40-bbb6-26a4d42d54f1 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:03.600229 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf969369-4b9f-4656-8311-94c0b94c059e None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:03.629874 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fd2d7e-0406-4d40-bbb6-26a4d42d54f1 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:03.650352 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0696f8-e66c-4fb8-a1d0-dbcbdabcb662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:03.651389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0696f8-e66c-4fb8-a1d0-dbcbdabcb662 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:03.651968 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0696f8-e66c-4fb8-a1d0-dbcbdabcb662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:03.652407 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0696f8-e66c-4fb8-a1d0-dbcbdabcb662 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:03.653544 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0696f8-e66c-4fb8-a1d0-dbcbdabcb662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:03.659230 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0696f8-e66c-4fb8-a1d0-dbcbdabcb662 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:03.711991 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1049/2090] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:46:03.718570 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0696f8-e66c-4fb8-a1d0-dbcbdabcb662 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:03.751956 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0696f8-e66c-4fb8-a1d0-dbcbdabcb662 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:03.764758 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f33946-be13-4557-969b-9547648211f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:03.766652 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f33946-be13-4557-969b-9547648211f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:03.767133 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f33946-be13-4557-969b-9547648211f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:03.767614 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f33946-be13-4557-969b-9547648211f9 admin admin] PATH_INFO: `/v3/projects/c2bc767e1b6f43a888aa42408fe8f42f/users/922263624aa140d6ad245b8cb2c7f660/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:03.781159 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183e8b1-ec45-484f-915e-4774016bbfa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:03.782357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183e8b1-ec45-484f-915e-4774016bbfa7 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:03.782357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183e8b1-ec45-484f-915e-4774016bbfa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:03.783053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183e8b1-ec45-484f-915e-4774016bbfa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:03.828581 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f33946-be13-4557-969b-9547648211f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2bc767e1b6f43a888aa42408fe8f42f, user_id=922263624aa140d6ad245b8cb2c7f660, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:03.834307 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f33946-be13-4557-969b-9547648211f9 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:03.866010 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1050/2091] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:46:03 2022] PUT /identity/v3/projects/c2bc767e1b6f43a888aa42408fe8f42f/users/922263624aa140d6ad245b8cb2c7f660/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:03.867683 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f33946-be13-4557-969b-9547648211f9 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:03.870958 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-26f33946-be13-4557-969b-9547648211f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:03.925141 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183e8b1-ec45-484f-915e-4774016bbfa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:03.926655 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183e8b1-ec45-484f-915e-4774016bbfa7 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:03.931789 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:03.942310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1042/2092] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:46:03.944137 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f0df9-391e-4917-8d4d-72e91f0e72cb None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:03.944366 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f0df9-391e-4917-8d4d-72e91f0e72cb None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:03.944550 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f0df9-391e-4917-8d4d-72e91f0e72cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:03.985731 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-dc9f0df9-391e-4917-8d4d-72e91f0e72cb None None] MFA Rules not processed for user `922263624aa140d6ad245b8cb2c7f660`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:03.985731 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-dc9f0df9-391e-4917-8d4d-72e91f0e72cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:03.993663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f33946-be13-4557-969b-9547648211f9 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:04.003004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03e614-8fd7-4232-916f-21dc42709f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:04.003893 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03e614-8fd7-4232-916f-21dc42709f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:04.004204 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03e614-8fd7-4232-916f-21dc42709f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:04.004829 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03e614-8fd7-4232-916f-21dc42709f83 admin admin] PATH_INFO: `/v3/projects/0542f539019b4c80a23056d3731b5d29` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:04.006528 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03e614-8fd7-4232-916f-21dc42709f83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0542f539019b4c80a23056d3731b5d29)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:04.008943 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03e614-8fd7-4232-916f-21dc42709f83 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:04.019595 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:04.093494 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1043/2093] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:04.098793 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f0df9-391e-4917-8d4d-72e91f0e72cb None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:04.115803 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f0df9-391e-4917-8d4d-72e91f0e72cb None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:04.136544 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4c03e614-8fd7-4232-916f-21dc42709f83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0542f539019b4c80a23056d3731b5d29', 'request_id': 'req-4c03e614-8fd7-4232-916f-21dc42709f83'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:04.145204 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4c03e614-8fd7-4232-916f-21dc42709f83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0542f539019b4c80a23056d3731b5d29', 'request_id': 'req-4c03e614-8fd7-4232-916f-21dc42709f83'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:04.158865 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4c03e614-8fd7-4232-916f-21dc42709f83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0542f539019b4c80a23056d3731b5d29', 'request_id': 'req-4c03e614-8fd7-4232-916f-21dc42709f83'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:04.192922 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4c03e614-8fd7-4232-916f-21dc42709f83 admin admin] The token cache is being invalidate because project 0542f539019b4c80a23056d3731b5d29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:46:04.193227 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4c03e614-8fd7-4232-916f-21dc42709f83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:04.197481 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4c03e614-8fd7-4232-916f-21dc42709f83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:04.199495 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1051/2094] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:46:03 2022] DELETE /identity/v3/projects/0542f539019b4c80a23056d3731b5d29 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:04.208520 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03e614-8fd7-4232-916f-21dc42709f83 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:04.214152 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4c03e614-8fd7-4232-916f-21dc42709f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:04.284772 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3acc2-4a08-4094-bb70-62efa2c30077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:04.285557 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3acc2-4a08-4094-bb70-62efa2c30077 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:04.285960 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3acc2-4a08-4094-bb70-62efa2c30077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:04.286245 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3acc2-4a08-4094-bb70-62efa2c30077 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:04.287057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3acc2-4a08-4094-bb70-62efa2c30077 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:04.289097 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3acc2-4a08-4094-bb70-62efa2c30077 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:04.348867 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03e614-8fd7-4232-916f-21dc42709f83 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:04.354588 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1044/2095] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:46:04 2022] POST /identity/v3/projects => generated 361 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:46:04.359779 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3acc2-4a08-4094-bb70-62efa2c30077 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:04.365981 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-73c3acc2-4a08-4094-bb70-62efa2c30077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:04.477953 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f48590-8127-4dc7-a80d-07b857d02a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:04.478626 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f48590-8127-4dc7-a80d-07b857d02a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:04.478905 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f48590-8127-4dc7-a80d-07b857d02a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:04.479179 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f48590-8127-4dc7-a80d-07b857d02a33 admin admin] PATH_INFO: `/v3/users/ec82a7d330fc40b4ab06c3a0c84ac718` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:04.483490 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f48590-8127-4dc7-a80d-07b857d02a33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec82a7d330fc40b4ab06c3a0c84ac718)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:04.490944 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3acc2-4a08-4094-bb70-62efa2c30077 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:04.493244 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f48590-8127-4dc7-a80d-07b857d02a33 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:04.497295 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a8126-9b66-4fb7-a586-7db89251cea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:04.497765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a8126-9b66-4fb7-a586-7db89251cea7 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:04.497964 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a8126-9b66-4fb7-a586-7db89251cea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:04.498299 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a8126-9b66-4fb7-a586-7db89251cea7 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:04.499816 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a8126-9b66-4fb7-a586-7db89251cea7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:04.502240 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a8126-9b66-4fb7-a586-7db89251cea7 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:04.534247 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1045/2096] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:46:04 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:46:04.545709 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a8126-9b66-4fb7-a586-7db89251cea7 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:04.557512 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:04.572793 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a8126-9b66-4fb7-a586-7db89251cea7 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:04.580106 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82bc89-b2ee-4b2f-a89e-b4892fdf8072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:04.580880 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82bc89-b2ee-4b2f-a89e-b4892fdf8072 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:04.581273 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82bc89-b2ee-4b2f-a89e-b4892fdf8072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:04.581609 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e82bc89-b2ee-4b2f-a89e-b4892fdf8072 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:04.582544 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e82bc89-b2ee-4b2f-a89e-b4892fdf8072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:04.584486 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e82bc89-b2ee-4b2f-a89e-b4892fdf8072 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:04.602580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1046/2097] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:46:04.610140 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82bc89-b2ee-4b2f-a89e-b4892fdf8072 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:04.650850 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e82bc89-b2ee-4b2f-a89e-b4892fdf8072 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:04.660511 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-48f48590-8127-4dc7-a80d-07b857d02a33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec82a7d330fc40b4ab06c3a0c84ac718'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:04.664666 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567abd9-2b8f-4d17-a14d-99de3c6adce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:04.665275 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:04.665400 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567abd9-2b8f-4d17-a14d-99de3c6adce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:04.665606 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567abd9-2b8f-4d17-a14d-99de3c6adce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:04.665922 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567abd9-2b8f-4d17-a14d-99de3c6adce6 admin admin] PATH_INFO: `/v3/projects/7d259e69c91c4ca089d79b47406ffe59/users/d893730fbcdf4010a3452b17339047ec/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:04.691087 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-48f48590-8127-4dc7-a80d-07b857d02a33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec82a7d330fc40b4ab06c3a0c84ac718'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:04.692116 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-48f48590-8127-4dc7-a80d-07b857d02a33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec82a7d330fc40b4ab06c3a0c84ac718'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:04.724265 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-48f48590-8127-4dc7-a80d-07b857d02a33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec82a7d330fc40b4ab06c3a0c84ac718'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:04.726527 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567abd9-2b8f-4d17-a14d-99de3c6adce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d259e69c91c4ca089d79b47406ffe59, user_id=d893730fbcdf4010a3452b17339047ec, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:04.733436 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567abd9-2b8f-4d17-a14d-99de3c6adce6 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:04.743046 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-48f48590-8127-4dc7-a80d-07b857d02a33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec82a7d330fc40b4ab06c3a0c84ac718'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:04.758653 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1052/2098] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:46:04 2022] DELETE /identity/v3/users/ec82a7d330fc40b4ab06c3a0c84ac718 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:04.774736 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f48590-8127-4dc7-a80d-07b857d02a33 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:04.779631 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1047/2099] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:46:04 2022] PUT /identity/v3/projects/7d259e69c91c4ca089d79b47406ffe59/users/d893730fbcdf4010a3452b17339047ec/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:04.780906 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-48f48590-8127-4dc7-a80d-07b857d02a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:04.902346 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f48590-8127-4dc7-a80d-07b857d02a33 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:04.907515 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36210452-0fa8-468b-89c4-7e91a3c0c938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:04.908187 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36210452-0fa8-468b-89c4-7e91a3c0c938 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:04.908490 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36210452-0fa8-468b-89c4-7e91a3c0c938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:04.908725 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36210452-0fa8-468b-89c4-7e91a3c0c938 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:04.909387 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36210452-0fa8-468b-89c4-7e91a3c0c938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:04.911518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36210452-0fa8-468b-89c4-7e91a3c0c938 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:04.940112 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1053/2100] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:04 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:46:04.942540 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567abd9-2b8f-4d17-a14d-99de3c6adce6 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:05.025051 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567abd9-2b8f-4d17-a14d-99de3c6adce6 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:05.030172 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0f8246-a8b5-40f5-b78b-5eeaa0ddcb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:05.030866 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f8246-a8b5-40f5-b78b-5eeaa0ddcb42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:05.031289 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f8246-a8b5-40f5-b78b-5eeaa0ddcb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:05.031562 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0f8246-a8b5-40f5-b78b-5eeaa0ddcb42 admin admin] PATH_INFO: `/v3/projects/7d259e69c91c4ca089d79b47406ffe59/users/d893730fbcdf4010a3452b17339047ec/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:05.033619 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f8246-a8b5-40f5-b78b-5eeaa0ddcb42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d259e69c91c4ca089d79b47406ffe59, user_id=d893730fbcdf4010a3452b17339047ec, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:05.036330 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0f8246-a8b5-40f5-b78b-5eeaa0ddcb42 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:05.051804 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1048/2101] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:46:04 2022] PUT /identity/v3/projects/7d259e69c91c4ca089d79b47406ffe59/users/d893730fbcdf4010a3452b17339047ec/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:05.062591 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ed0c0-ea82-4c0f-b27f-60896d020650 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:05.063467 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ed0c0-ea82-4c0f-b27f-60896d020650 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:05.063950 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ed0c0-ea82-4c0f-b27f-60896d020650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:05.096628 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-0f9ed0c0-ea82-4c0f-b27f-60896d020650 None None] MFA Rules not processed for user `d893730fbcdf4010a3452b17339047ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:05.097650 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0f9ed0c0-ea82-4c0f-b27f-60896d020650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:05.167787 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d974bbb-068d-4ca8-ab7c-852093dec392 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:05.168289 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d974bbb-068d-4ca8-ab7c-852093dec392 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:05.168775 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d974bbb-068d-4ca8-ab7c-852093dec392 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:05.171235 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1049/2102] 10.222.0.66 () {54 vars in 921 bytes} [Mon Sep 26 05:46:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 26 05:46:05.184837 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65700be0-086e-4f96-ae51-8b4e9293f133 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:05.185310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65700be0-086e-4f96-ae51-8b4e9293f133 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:05.185779 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65700be0-086e-4f96-ae51-8b4e9293f133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:05.232328 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-65700be0-086e-4f96-ae51-8b4e9293f133 None None] MFA Rules not processed for user `895edcfb20484b188a3877c9de8b59c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:05.236347 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-65700be0-086e-4f96-ae51-8b4e9293f133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:05.236752 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1054/2103] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:05 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:05.237802 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ed0c0-ea82-4c0f-b27f-60896d020650 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:05.239310 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0f9ed0c0-ea82-4c0f-b27f-60896d020650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:05.319399 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:05.343979 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ed0c0-ea82-4c0f-b27f-60896d020650 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:05.349675 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbe3a1-c87a-426c-ad1e-4051451e0437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:05.350353 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbe3a1-c87a-426c-ad1e-4051451e0437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:05.350666 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbe3a1-c87a-426c-ad1e-4051451e0437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:05.350922 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbe3a1-c87a-426c-ad1e-4051451e0437 admin admin] PATH_INFO: `/v3/projects/9f3eeeb3beba47f7ab0add3d204208ef` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:05.352419 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbe3a1-c87a-426c-ad1e-4051451e0437 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f3eeeb3beba47f7ab0add3d204208ef)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:05.354186 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbe3a1-c87a-426c-ad1e-4051451e0437 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:05.374820 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1050/2104] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Sep 26 05:46:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:05.376957 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65700be0-086e-4f96-ae51-8b4e9293f133 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:05.379050 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-65700be0-086e-4f96-ae51-8b4e9293f133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:05.413028 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fbdbe3a1-c87a-426c-ad1e-4051451e0437 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f3eeeb3beba47f7ab0add3d204208ef', 'request_id': 'req-fbdbe3a1-c87a-426c-ad1e-4051451e0437'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:05.424058 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fbdbe3a1-c87a-426c-ad1e-4051451e0437 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f3eeeb3beba47f7ab0add3d204208ef', 'request_id': 'req-fbdbe3a1-c87a-426c-ad1e-4051451e0437'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:05.436751 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fbdbe3a1-c87a-426c-ad1e-4051451e0437 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f3eeeb3beba47f7ab0add3d204208ef', 'request_id': 'req-fbdbe3a1-c87a-426c-ad1e-4051451e0437'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:05.456043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fbdbe3a1-c87a-426c-ad1e-4051451e0437 admin admin] The token cache is being invalidate because project 9f3eeeb3beba47f7ab0add3d204208ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:46:05.456330 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fbdbe3a1-c87a-426c-ad1e-4051451e0437 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:05.457046 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-fbdbe3a1-c87a-426c-ad1e-4051451e0437 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:05.458987 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1055/2105] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:46:05 2022] DELETE /identity/v3/projects/9f3eeeb3beba47f7ab0add3d204208ef => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:05.461480 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbe3a1-c87a-426c-ad1e-4051451e0437 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:05.465217 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-fbdbe3a1-c87a-426c-ad1e-4051451e0437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:05.477783 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65700be0-086e-4f96-ae51-8b4e9293f133 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:05.498132 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:05.574201 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760b48c-773a-4301-91c4-0d66feec8b46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:05.575655 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760b48c-773a-4301-91c4-0d66feec8b46 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:05.576369 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760b48c-773a-4301-91c4-0d66feec8b46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:05.576929 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760b48c-773a-4301-91c4-0d66feec8b46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:05.580755 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e760b48c-773a-4301-91c4-0d66feec8b46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:05.600027 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbe3a1-c87a-426c-ad1e-4051451e0437 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:05.606216 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dfc116-cfda-44c5-a44d-b56a4dbafeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:05.607075 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfc116-cfda-44c5-a44d-b56a4dbafeea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:05.607499 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfc116-cfda-44c5-a44d-b56a4dbafeea admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:05.608130 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dfc116-cfda-44c5-a44d-b56a4dbafeea admin admin] PATH_INFO: `/v3/users/31214da58fc3420393b0f5bd5df8e9d2` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:05.609776 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfc116-cfda-44c5-a44d-b56a4dbafeea admin admin] RBAC: Authorizing `identity:delete_user(user_id=31214da58fc3420393b0f5bd5df8e9d2)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:05.612245 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dfc116-cfda-44c5-a44d-b56a4dbafeea admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:05.688389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-c7dfc116-cfda-44c5-a44d-b56a4dbafeea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31214da58fc3420393b0f5bd5df8e9d2'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:05.693206 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760b48c-773a-4301-91c4-0d66feec8b46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:05.695174 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e760b48c-773a-4301-91c4-0d66feec8b46 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:05.704150 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-c7dfc116-cfda-44c5-a44d-b56a4dbafeea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31214da58fc3420393b0f5bd5df8e9d2'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:05.704964 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-c7dfc116-cfda-44c5-a44d-b56a4dbafeea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31214da58fc3420393b0f5bd5df8e9d2'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:05.722568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1051/2106] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:05 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:46:05.725202 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760b48c-773a-4301-91c4-0d66feec8b46 service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:05.727825 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e760b48c-773a-4301-91c4-0d66feec8b46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:05.734984 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-c7dfc116-cfda-44c5-a44d-b56a4dbafeea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31214da58fc3420393b0f5bd5df8e9d2'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:05.750789 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:05.754970 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-c7dfc116-cfda-44c5-a44d-b56a4dbafeea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31214da58fc3420393b0f5bd5df8e9d2'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:05.770845 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1056/2107] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:46:05 2022] DELETE /identity/v3/users/31214da58fc3420393b0f5bd5df8e9d2 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:05.788131 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb73535-c199-4993-975c-5ce63876421a None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:05.788131 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb73535-c199-4993-975c-5ce63876421a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:05.788131 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb73535-c199-4993-975c-5ce63876421a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:05.847121 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-fcb73535-c199-4993-975c-5ce63876421a None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:05.849170 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-fcb73535-c199-4993-975c-5ce63876421a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:05.865505 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760b48c-773a-4301-91c4-0d66feec8b46 service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:05.957135 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d06de6-906b-4843-8198-fdcc0e380d69 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895edcfb20484b188a3877c9de8b59c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:05.958221 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d06de6-906b-4843-8198-fdcc0e380d69 service placement] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:05.959017 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d06de6-906b-4843-8198-fdcc0e380d69 service placement] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:05.959457 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d06de6-906b-4843-8198-fdcc0e380d69 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:05.964422 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-26d06de6-906b-4843-8198-fdcc0e380d69 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:05.987950 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1057/2108] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:05.987950 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb73535-c199-4993-975c-5ce63876421a None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:05.989184 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:05.990148 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-fcb73535-c199-4993-975c-5ce63876421a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:05.995475 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d06de6-906b-4843-8198-fdcc0e380d69 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:06.000027 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d06de6-906b-4843-8198-fdcc0e380d69 service placement] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:06.026457 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1052/2109] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:46:06.029499 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105125af-2174-4245-8160-3b992c0ad8bf None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:06.030013 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105125af-2174-4245-8160-3b992c0ad8bf None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:06.030472 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105125af-2174-4245-8160-3b992c0ad8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:06.100808 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-105125af-2174-4245-8160-3b992c0ad8bf None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:06.105077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-105125af-2174-4245-8160-3b992c0ad8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:06.123130 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1053/2110] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:06.124891 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105125af-2174-4245-8160-3b992c0ad8bf None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:06.127206 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-105125af-2174-4245-8160-3b992c0ad8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:06.134503 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb73535-c199-4993-975c-5ce63876421a None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:06.148142 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16615028-a2ee-4e28-a72a-005d46c62da2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:06.153433 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105125af-2174-4245-8160-3b992c0ad8bf None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:06.156391 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16615028-a2ee-4e28-a72a-005d46c62da2 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:06.156909 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16615028-a2ee-4e28-a72a-005d46c62da2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:06.157603 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16615028-a2ee-4e28-a72a-005d46c62da2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:06.163659 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-16615028-a2ee-4e28-a72a-005d46c62da2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:06.165828 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c94deb-2c65-46b9-85fe-d715a389b634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:06.166780 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c94deb-2c65-46b9-85fe-d715a389b634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:06.167234 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c94deb-2c65-46b9-85fe-d715a389b634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:06.168287 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c94deb-2c65-46b9-85fe-d715a389b634 admin admin] PATH_INFO: `/v3/projects/59d7d2da6d364c40984a6d95c87f35b6` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:06.171298 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c94deb-2c65-46b9-85fe-d715a389b634 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59d7d2da6d364c40984a6d95c87f35b6)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:06.176837 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c94deb-2c65-46b9-85fe-d715a389b634 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:06.269116 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16615028-a2ee-4e28-a72a-005d46c62da2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:06.271323 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16615028-a2ee-4e28-a72a-005d46c62da2 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:06.284023 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1058/2111] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:46:06.285165 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16615028-a2ee-4e28-a72a-005d46c62da2 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:06.299656 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16615028-a2ee-4e28-a72a-005d46c62da2 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:06.306886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-00c94deb-2c65-46b9-85fe-d715a389b634 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59d7d2da6d364c40984a6d95c87f35b6', 'request_id': 'req-00c94deb-2c65-46b9-85fe-d715a389b634'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:06.324371 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-00c94deb-2c65-46b9-85fe-d715a389b634 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59d7d2da6d364c40984a6d95c87f35b6', 'request_id': 'req-00c94deb-2c65-46b9-85fe-d715a389b634'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:06.347311 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-00c94deb-2c65-46b9-85fe-d715a389b634 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59d7d2da6d364c40984a6d95c87f35b6', 'request_id': 'req-00c94deb-2c65-46b9-85fe-d715a389b634'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:06.383093 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-00c94deb-2c65-46b9-85fe-d715a389b634 admin admin] The token cache is being invalidate because project 59d7d2da6d364c40984a6d95c87f35b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:46:06.383445 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-00c94deb-2c65-46b9-85fe-d715a389b634 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:06.384705 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-00c94deb-2c65-46b9-85fe-d715a389b634 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:06.386465 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1054/2112] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:46:06 2022] DELETE /identity/v3/projects/59d7d2da6d364c40984a6d95c87f35b6 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:06.395066 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:06.396740 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8934c71-b88e-4a02-90b3-4673257d6cba None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:06.397039 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8934c71-b88e-4a02-90b3-4673257d6cba None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:06.398803 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8934c71-b88e-4a02-90b3-4673257d6cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:06.423248 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445703b-6eb0-4aaa-9e58-2d312d70a986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:06.424251 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445703b-6eb0-4aaa-9e58-2d312d70a986 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:06.424716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445703b-6eb0-4aaa-9e58-2d312d70a986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:06.425297 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445703b-6eb0-4aaa-9e58-2d312d70a986 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:06.426727 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445703b-6eb0-4aaa-9e58-2d312d70a986 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:46:06.427267 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445703b-6eb0-4aaa-9e58-2d312d70a986 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:06.429157 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445703b-6eb0-4aaa-9e58-2d312d70a986 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:06.438023 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-b8934c71-b88e-4a02-90b3-4673257d6cba None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:06.439633 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b8934c71-b88e-4a02-90b3-4673257d6cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:06.442661 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1059/2113] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:46:06.447337 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445703b-6eb0-4aaa-9e58-2d312d70a986 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:06.450119 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1055/2114] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:06.450521 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8445703b-6eb0-4aaa-9e58-2d312d70a986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:06.463966 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd71088-ab16-4383-96d9-7af3b003ab85 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:06.464258 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd71088-ab16-4383-96d9-7af3b003ab85 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:06.464412 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd71088-ab16-4383-96d9-7af3b003ab85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:06.465783 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445703b-6eb0-4aaa-9e58-2d312d70a986 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:06.471099 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78696ce-240d-4e35-af52-00791b64da07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:06.472101 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78696ce-240d-4e35-af52-00791b64da07 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:06.472101 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78696ce-240d-4e35-af52-00791b64da07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:06.472461 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78696ce-240d-4e35-af52-00791b64da07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:06.473133 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78696ce-240d-4e35-af52-00791b64da07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:06.475544 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78696ce-240d-4e35-af52-00791b64da07 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:06.494638 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-4cd71088-ab16-4383-96d9-7af3b003ab85 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:06.496048 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4cd71088-ab16-4383-96d9-7af3b003ab85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:06.506895 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1056/2115] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:46:06.514252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd71088-ab16-4383-96d9-7af3b003ab85 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:06.514887 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1060/2116] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:46:06 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:46:06.519053 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78696ce-240d-4e35-af52-00791b64da07 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:06.529334 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd71088-ab16-4383-96d9-7af3b003ab85 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:06.621513 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25f90f-e7af-454b-99ad-e119f32f6394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:06.622481 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25f90f-e7af-454b-99ad-e119f32f6394 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:06.622481 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25f90f-e7af-454b-99ad-e119f32f6394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:06.622770 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25f90f-e7af-454b-99ad-e119f32f6394 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:06.623548 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c25f90f-e7af-454b-99ad-e119f32f6394 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:46:06.623895 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c25f90f-e7af-454b-99ad-e119f32f6394 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:06.625633 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c25f90f-e7af-454b-99ad-e119f32f6394 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:06.627859 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78696ce-240d-4e35-af52-00791b64da07 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:06.641049 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1057/2117] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:46:06.645508 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d0a4d-ff8d-4061-97d5-8da99e3e8653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:06.646390 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d0a4d-ff8d-4061-97d5-8da99e3e8653 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:06.647016 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d0a4d-ff8d-4061-97d5-8da99e3e8653 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:06.647482 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d0a4d-ff8d-4061-97d5-8da99e3e8653 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:06.648624 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d0a4d-ff8d-4061-97d5-8da99e3e8653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:06.650689 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25f90f-e7af-454b-99ad-e119f32f6394 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:06.651035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d0a4d-ff8d-4061-97d5-8da99e3e8653 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:06.687903 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1061/2118] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:46:06 2022] POST /identity/v3/users => generated 287 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:46:06.694565 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25f90f-e7af-454b-99ad-e119f32f6394 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:06.695492 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d0a4d-ff8d-4061-97d5-8da99e3e8653 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:06.708671 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d0a4d-ff8d-4061-97d5-8da99e3e8653 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:06.715122 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdb35d-d407-4f8d-947a-559bff75d693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:06.716083 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdb35d-d407-4f8d-947a-559bff75d693 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:06.716535 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdb35d-d407-4f8d-947a-559bff75d693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:06.716903 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdb35d-d407-4f8d-947a-559bff75d693 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:06.717990 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdb35d-d407-4f8d-947a-559bff75d693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:06.719926 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdb35d-d407-4f8d-947a-559bff75d693 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:06.748107 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1062/2119] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:46:06.749702 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdb35d-d407-4f8d-947a-559bff75d693 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:06.757614 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff4517-0541-4bc4-b6b6-43b36bf39e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:06.758293 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff4517-0541-4bc4-b6b6-43b36bf39e3f admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:06.758543 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff4517-0541-4bc4-b6b6-43b36bf39e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:06.758917 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff4517-0541-4bc4-b6b6-43b36bf39e3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:06.759630 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff4517-0541-4bc4-b6b6-43b36bf39e3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:06.763842 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff4517-0541-4bc4-b6b6-43b36bf39e3f admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:06.773532 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdb35d-d407-4f8d-947a-559bff75d693 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:06.786305 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec120ea5-7b2f-4e03-9adb-43604de80469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:06.787354 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec120ea5-7b2f-4e03-9adb-43604de80469 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:06.787632 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec120ea5-7b2f-4e03-9adb-43604de80469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:06.787944 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec120ea5-7b2f-4e03-9adb-43604de80469 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:06.788731 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec120ea5-7b2f-4e03-9adb-43604de80469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:06.793860 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec120ea5-7b2f-4e03-9adb-43604de80469 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:06.816949 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1063/2120] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:46:06.821770 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec120ea5-7b2f-4e03-9adb-43604de80469 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:06.843942 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1058/2121] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:46:06 2022] POST /identity/v3/projects => generated 401 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:46:06.847952 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff4517-0541-4bc4-b6b6-43b36bf39e3f admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:06.875678 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec120ea5-7b2f-4e03-9adb-43604de80469 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:06.926893 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:06.975398 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff4517-0541-4bc4-b6b6-43b36bf39e3f admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:06.991318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4bad1-f882-4a1d-a022-c71863c8f428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:06.992593 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4bad1-f882-4a1d-a022-c71863c8f428 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:06.993067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4bad1-f882-4a1d-a022-c71863c8f428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:06.993816 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4bad1-f882-4a1d-a022-c71863c8f428 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:06.995222 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4bad1-f882-4a1d-a022-c71863c8f428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:06.999027 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb4bad1-f882-4a1d-a022-c71863c8f428 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:07.022867 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dda5e-3c80-4a91-8c8b-bf21a6b96533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:07.023963 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dda5e-3c80-4a91-8c8b-bf21a6b96533 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:07.024883 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dda5e-3c80-4a91-8c8b-bf21a6b96533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:07.025462 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dda5e-3c80-4a91-8c8b-bf21a6b96533 admin admin] PATH_INFO: `/v3/projects/af4e28ded37047e6914a4ad665905e6e/users/d23aa52bc935480fb21101025b5793c8/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:07.045129 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1059/2122] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:46:06 2022] POST /identity/v3/users => generated 301 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:46:07.052900 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4bad1-f882-4a1d-a022-c71863c8f428 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:07.070182 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955dda5e-3c80-4a91-8c8b-bf21a6b96533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af4e28ded37047e6914a4ad665905e6e, user_id=d23aa52bc935480fb21101025b5793c8, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:07.073377 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955dda5e-3c80-4a91-8c8b-bf21a6b96533 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:07.078225 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4bad1-f882-4a1d-a022-c71863c8f428 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:07.087216 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0395159-bfdd-437b-9206-11b6eb4ae7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:07.088402 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0395159-bfdd-437b-9206-11b6eb4ae7e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:07.088817 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0395159-bfdd-437b-9206-11b6eb4ae7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:07.089185 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0395159-bfdd-437b-9206-11b6eb4ae7e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:07.089973 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0395159-bfdd-437b-9206-11b6eb4ae7e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:07.092096 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0395159-bfdd-437b-9206-11b6eb4ae7e5 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:07.099101 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1064/2123] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:46:06 2022] PUT /identity/v3/projects/af4e28ded37047e6914a4ad665905e6e/users/d23aa52bc935480fb21101025b5793c8/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:07.111515 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b7e86-01eb-4203-ad66-cdec619fdead None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:07.113110 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b7e86-01eb-4203-ad66-cdec619fdead None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:07.113546 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b7e86-01eb-4203-ad66-cdec619fdead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:07.114226 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1060/2124] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:46:07.119021 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0395159-bfdd-437b-9206-11b6eb4ae7e5 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:07.135523 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0395159-bfdd-437b-9206-11b6eb4ae7e5 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:07.146401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:07.162941 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-0d9b7e86-01eb-4203-ad66-cdec619fdead None None] MFA Rules not processed for user `d23aa52bc935480fb21101025b5793c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:07.164785 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0d9b7e86-01eb-4203-ad66-cdec619fdead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:07.274038 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02650c-745e-4dee-96de-65b0c364d846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:07.274754 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02650c-745e-4dee-96de-65b0c364d846 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:07.274952 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02650c-745e-4dee-96de-65b0c364d846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:07.275197 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02650c-745e-4dee-96de-65b0c364d846 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:07.275901 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02650c-745e-4dee-96de-65b0c364d846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:07.277868 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02650c-745e-4dee-96de-65b0c364d846 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:07.299685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1061/2125] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:46:07.303951 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02650c-745e-4dee-96de-65b0c364d846 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:07.307436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1065/2126] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:46:07.319413 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b7e86-01eb-4203-ad66-cdec619fdead None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:07.322311 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0d9b7e86-01eb-4203-ad66-cdec619fdead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:07.327434 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02650c-745e-4dee-96de-65b0c364d846 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:07.332823 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c82ef8-a771-4483-a30c-e530123143ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:07.333516 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c82ef8-a771-4483-a30c-e530123143ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:07.333895 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c82ef8-a771-4483-a30c-e530123143ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:07.334398 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c82ef8-a771-4483-a30c-e530123143ee admin admin] PATH_INFO: `/v3/projects/5713ff23f8a14bd1b1c7d5deb6adbf0d/users/5fe56abf851941a8866ef7b46a5f5686/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:07.364821 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c82ef8-a771-4483-a30c-e530123143ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=5713ff23f8a14bd1b1c7d5deb6adbf0d, user_id=5fe56abf851941a8866ef7b46a5f5686, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:07.369792 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c82ef8-a771-4483-a30c-e530123143ee admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:07.396076 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1062/2127] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:46:07 2022] PUT /identity/v3/projects/5713ff23f8a14bd1b1c7d5deb6adbf0d/users/5fe56abf851941a8866ef7b46a5f5686/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:46:07.407316 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f558ac-b276-46f7-9567-25ac15257d55 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:07.407716 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f558ac-b276-46f7-9567-25ac15257d55 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:07.408252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f558ac-b276-46f7-9567-25ac15257d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:07.413208 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b7e86-01eb-4203-ad66-cdec619fdead None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:07.454619 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-b8f558ac-b276-46f7-9567-25ac15257d55 None None] MFA Rules not processed for user `5fe56abf851941a8866ef7b46a5f5686`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:07.456927 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b8f558ac-b276-46f7-9567-25ac15257d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:07.529003 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6b592-c947-41ad-86cb-0714b6ce6208 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:07.530248 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6b592-c947-41ad-86cb-0714b6ce6208 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:07.530699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6b592-c947-41ad-86cb-0714b6ce6208 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:07.531183 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a6b592-c947-41ad-86cb-0714b6ce6208 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:07.551947 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1063/2128] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:07 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:07.557333 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f558ac-b276-46f7-9567-25ac15257d55 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:07.574836 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:07.624867 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a6b592-c947-41ad-86cb-0714b6ce6208 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:07.627213 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a6b592-c947-41ad-86cb-0714b6ce6208 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:07.645716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1066/2129] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:46:07.671531 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f558ac-b276-46f7-9567-25ac15257d55 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:07.682043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6b592-c947-41ad-86cb-0714b6ce6208 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:07.683699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfdfda-3ae5-4253-8010-de590c8f5d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:07.688780 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfdfda-3ae5-4253-8010-de590c8f5d89 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:07.689405 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfdfda-3ae5-4253-8010-de590c8f5d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:07.689862 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfdfda-3ae5-4253-8010-de590c8f5d89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:07.691111 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfdfda-3ae5-4253-8010-de590c8f5d89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:07.694106 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfdfda-3ae5-4253-8010-de590c8f5d89 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:07.702713 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a6b592-c947-41ad-86cb-0714b6ce6208 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:07.716676 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b7193-200d-4d3f-bda2-8e573170dd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:07.717930 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b7193-200d-4d3f-bda2-8e573170dd9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:07.719286 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b7193-200d-4d3f-bda2-8e573170dd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:07.719419 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b7193-200d-4d3f-bda2-8e573170dd9a admin admin] PATH_INFO: `/v3/users/d23aa52bc935480fb21101025b5793c8` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:07.725567 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b7193-200d-4d3f-bda2-8e573170dd9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d23aa52bc935480fb21101025b5793c8)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:07.730168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b7193-200d-4d3f-bda2-8e573170dd9a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:07.737175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1064/2130] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:46:07 2022] POST /identity/v3/projects => generated 401 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:46:07.739467 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:07.741403 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfdfda-3ae5-4253-8010-de590c8f5d89 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:07.809174 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-681b7193-200d-4d3f-bda2-8e573170dd9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd23aa52bc935480fb21101025b5793c8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:07.822152 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-681b7193-200d-4d3f-bda2-8e573170dd9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd23aa52bc935480fb21101025b5793c8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:07.823229 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-681b7193-200d-4d3f-bda2-8e573170dd9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd23aa52bc935480fb21101025b5793c8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:07.846185 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfdfda-3ae5-4253-8010-de590c8f5d89 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:07.849629 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-681b7193-200d-4d3f-bda2-8e573170dd9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd23aa52bc935480fb21101025b5793c8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:07.852382 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3cb4b-8d41-4763-9c8f-6cdbf6f3a7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:07.853229 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3cb4b-8d41-4763-9c8f-6cdbf6f3a7d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:07.854116 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3cb4b-8d41-4763-9c8f-6cdbf6f3a7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:07.854388 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3cb4b-8d41-4763-9c8f-6cdbf6f3a7d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:07.855112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3cb4b-8d41-4763-9c8f-6cdbf6f3a7d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:07.857787 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3cb4b-8d41-4763-9c8f-6cdbf6f3a7d9 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:07.863284 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-681b7193-200d-4d3f-bda2-8e573170dd9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd23aa52bc935480fb21101025b5793c8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:07.874438 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1067/2131] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:46:07 2022] DELETE /identity/v3/users/d23aa52bc935480fb21101025b5793c8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:46:07.881092 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b0baa-968d-4834-bf06-29743f357bdf None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:07.881434 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b0baa-968d-4834-bf06-29743f357bdf None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:07.881753 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b0baa-968d-4834-bf06-29743f357bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:07.897577 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1065/2132] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:46:07 2022] POST /identity/v3/users => generated 307 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:46:07.901901 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3cb4b-8d41-4763-9c8f-6cdbf6f3a7d9 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:07.903963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d1b3cb4b-8d41-4763-9c8f-6cdbf6f3a7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:07.913340 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-097b0baa-968d-4834-bf06-29743f357bdf None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:07.915501 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-097b0baa-968d-4834-bf06-29743f357bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:07.918603 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3cb4b-8d41-4763-9c8f-6cdbf6f3a7d9 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:08.004252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a2951-10c7-4ec8-9b56-dfe700914116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:08.004860 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a2951-10c7-4ec8-9b56-dfe700914116 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:08.005200 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a2951-10c7-4ec8-9b56-dfe700914116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:08.005512 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a2951-10c7-4ec8-9b56-dfe700914116 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:08.006087 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a2951-10c7-4ec8-9b56-dfe700914116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:08.007572 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1068/2133] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:46:08.011233 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a2951-10c7-4ec8-9b56-dfe700914116 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:08.017593 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b0baa-968d-4834-bf06-29743f357bdf None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:08.019329 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-097b0baa-968d-4834-bf06-29743f357bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:08.029752 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1066/2134] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:46:08.031391 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a2951-10c7-4ec8-9b56-dfe700914116 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:08.043822 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a2951-10c7-4ec8-9b56-dfe700914116 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:08.051504 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a8c09-1114-4d40-af35-5ab70066cf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:08.053183 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a8c09-1114-4d40-af35-5ab70066cf31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:08.053722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a8c09-1114-4d40-af35-5ab70066cf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:08.053994 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a8c09-1114-4d40-af35-5ab70066cf31 admin admin] PATH_INFO: `/v3/projects/ffadfa53c8634769813ae136ccede1a4/users/8b44a5762c4f48c6a4bd3b4abe540153/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:08.077837 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a8c09-1114-4d40-af35-5ab70066cf31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffadfa53c8634769813ae136ccede1a4, user_id=8b44a5762c4f48c6a4bd3b4abe540153, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:08.081741 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a8c09-1114-4d40-af35-5ab70066cf31 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:08.092724 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:08.103722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1067/2135] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:46:08 2022] PUT /identity/v3/projects/ffadfa53c8634769813ae136ccede1a4/users/8b44a5762c4f48c6a4bd3b4abe540153/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:08.109980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a8c09-1114-4d40-af35-5ab70066cf31 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:08.125704 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b0baa-968d-4834-bf06-29743f357bdf None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:08.179453 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:08.204629 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a8c09-1114-4d40-af35-5ab70066cf31 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:08.207158 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a241c-1cba-4e37-97de-1f11e9dd6fb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:08.207931 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a241c-1cba-4e37-97de-1f11e9dd6fb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:08.208393 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a241c-1cba-4e37-97de-1f11e9dd6fb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:08.208627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a241c-1cba-4e37-97de-1f11e9dd6fb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:08.214054 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0f73d-6881-4f03-9556-2f12a320d978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:08.214991 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0f73d-6881-4f03-9556-2f12a320d978 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:08.215494 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0f73d-6881-4f03-9556-2f12a320d978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:08.215838 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0f73d-6881-4f03-9556-2f12a320d978 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:08.217384 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0f73d-6881-4f03-9556-2f12a320d978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:08.219033 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0f73d-6881-4f03-9556-2f12a320d978 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:08.219827 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a241c-1cba-4e37-97de-1f11e9dd6fb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:08.221410 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a241c-1cba-4e37-97de-1f11e9dd6fb2 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:08.230096 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1068/2136] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:08 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:46:08.234288 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1069/2137] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:46:08.237170 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0f73d-6881-4f03-9556-2f12a320d978 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:08.249835 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0f73d-6881-4f03-9556-2f12a320d978 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:08.256687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da196aa7-037e-45f3-b652-bc477603f1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:08.257874 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da196aa7-037e-45f3-b652-bc477603f1c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:08.258200 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da196aa7-037e-45f3-b652-bc477603f1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:08.258627 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da196aa7-037e-45f3-b652-bc477603f1c0 admin admin] PATH_INFO: `/v3/projects/ffadfa53c8634769813ae136ccede1a4/users/8b44a5762c4f48c6a4bd3b4abe540153/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:08.261269 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da196aa7-037e-45f3-b652-bc477603f1c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffadfa53c8634769813ae136ccede1a4, user_id=8b44a5762c4f48c6a4bd3b4abe540153, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:08.264268 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da196aa7-037e-45f3-b652-bc477603f1c0 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:08.278515 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1069/2138] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:46:08 2022] PUT /identity/v3/projects/ffadfa53c8634769813ae136ccede1a4/users/8b44a5762c4f48c6a4bd3b4abe540153/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:08.293602 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc0d29-3095-4dbb-90cd-977d4b9b462c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:08.293968 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc0d29-3095-4dbb-90cd-977d4b9b462c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:08.294159 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc0d29-3095-4dbb-90cd-977d4b9b462c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:08.349144 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-4adc0d29-3095-4dbb-90cd-977d4b9b462c None None] MFA Rules not processed for user `8b44a5762c4f48c6a4bd3b4abe540153`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:08.351134 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4adc0d29-3095-4dbb-90cd-977d4b9b462c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:08.501535 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da196aa7-037e-45f3-b652-bc477603f1c0 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:08.502677 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1070/2139] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:08 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:08.508266 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-da196aa7-037e-45f3-b652-bc477603f1c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:08.525724 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc0d29-3095-4dbb-90cd-977d4b9b462c None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:08.528717 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4adc0d29-3095-4dbb-90cd-977d4b9b462c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:08.618899 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da196aa7-037e-45f3-b652-bc477603f1c0 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:08.625004 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdb7e5-4b73-43b1-ae75-07771f549a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:08.625712 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdb7e5-4b73-43b1-ae75-07771f549a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:08.626118 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdb7e5-4b73-43b1-ae75-07771f549a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:08.626279 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdb7e5-4b73-43b1-ae75-07771f549a7f admin admin] PATH_INFO: `/v3/users/cb1b63f434b24b208a457b02c3ed2bc2` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:08.627812 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bdb7e5-4b73-43b1-ae75-07771f549a7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb1b63f434b24b208a457b02c3ed2bc2)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:08.629617 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bdb7e5-4b73-43b1-ae75-07771f549a7f admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:08.632132 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc0d29-3095-4dbb-90cd-977d4b9b462c None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:08.638624 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c85a30-7f28-450c-a7b6-3b3f1246a309 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:08.639661 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c85a30-7f28-450c-a7b6-3b3f1246a309 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:08.640183 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c85a30-7f28-450c-a7b6-3b3f1246a309 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:08.640716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c85a30-7f28-450c-a7b6-3b3f1246a309 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:08.653249 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c85a30-7f28-450c-a7b6-3b3f1246a309 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:08.655012 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c85a30-7f28-450c-a7b6-3b3f1246a309 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:08.672760 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1071/2140] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:08 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:46:08.674379 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c85a30-7f28-450c-a7b6-3b3f1246a309 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:08.676211 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-91c85a30-7f28-450c-a7b6-3b3f1246a309 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:08.695125 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c85a30-7f28-450c-a7b6-3b3f1246a309 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:08.703991 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-17bdb7e5-4b73-43b1-ae75-07771f549a7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb1b63f434b24b208a457b02c3ed2bc2'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:08.706027 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6f686-9dff-4d62-96fb-a9fd60ba141c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:08.706942 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6f686-9dff-4d62-96fb-a9fd60ba141c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:08.707283 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6f686-9dff-4d62-96fb-a9fd60ba141c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:08.707631 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6f686-9dff-4d62-96fb-a9fd60ba141c admin admin] PATH_INFO: `/v3/projects/af4e28ded37047e6914a4ad665905e6e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:08.708965 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6f686-9dff-4d62-96fb-a9fd60ba141c admin admin] RBAC: Authorizing `identity:delete_project(project_id=af4e28ded37047e6914a4ad665905e6e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:08.711004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6f686-9dff-4d62-96fb-a9fd60ba141c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:08.716249 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-17bdb7e5-4b73-43b1-ae75-07771f549a7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb1b63f434b24b208a457b02c3ed2bc2'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:08.749332 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-17bdb7e5-4b73-43b1-ae75-07771f549a7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb1b63f434b24b208a457b02c3ed2bc2'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:08.750699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-17bdb7e5-4b73-43b1-ae75-07771f549a7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb1b63f434b24b208a457b02c3ed2bc2'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:08.766560 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-17bdb7e5-4b73-43b1-ae75-07771f549a7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb1b63f434b24b208a457b02c3ed2bc2'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:08.779565 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:08.801879 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1070/2141] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:46:08 2022] DELETE /identity/v3/users/cb1b63f434b24b208a457b02c3ed2bc2 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:46:08.809928 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d1a6f686-9dff-4d62-96fb-a9fd60ba141c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af4e28ded37047e6914a4ad665905e6e', 'request_id': 'req-d1a6f686-9dff-4d62-96fb-a9fd60ba141c'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:08.811947 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395e6b4-dabb-427a-bc91-665f696a450f None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:08.812306 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395e6b4-dabb-427a-bc91-665f696a450f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:08.812917 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395e6b4-dabb-427a-bc91-665f696a450f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:08.818454 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d1a6f686-9dff-4d62-96fb-a9fd60ba141c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af4e28ded37047e6914a4ad665905e6e', 'request_id': 'req-d1a6f686-9dff-4d62-96fb-a9fd60ba141c'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:08.827001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d1a6f686-9dff-4d62-96fb-a9fd60ba141c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af4e28ded37047e6914a4ad665905e6e', 'request_id': 'req-d1a6f686-9dff-4d62-96fb-a9fd60ba141c'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:08.830344 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:08.837867 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-c395e6b4-dabb-427a-bc91-665f696a450f None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:08.839299 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c395e6b4-dabb-427a-bc91-665f696a450f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:08.852410 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d1a6f686-9dff-4d62-96fb-a9fd60ba141c admin admin] The token cache is being invalidate because project af4e28ded37047e6914a4ad665905e6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:46:08.852881 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d1a6f686-9dff-4d62-96fb-a9fd60ba141c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:08.854103 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d1a6f686-9dff-4d62-96fb-a9fd60ba141c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:08.857026 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1072/2142] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:46:08 2022] DELETE /identity/v3/projects/af4e28ded37047e6914a4ad665905e6e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:08.865727 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6f686-9dff-4d62-96fb-a9fd60ba141c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:08.868349 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d1a6f686-9dff-4d62-96fb-a9fd60ba141c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:08.915448 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1071/2143] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:08.916602 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebbece-f211-49d5-91c4-caaced6c8e25 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:08.916883 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebbece-f211-49d5-91c4-caaced6c8e25 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:08.917150 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ebbece-f211-49d5-91c4-caaced6c8e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:08.947191 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-c8ebbece-f211-49d5-91c4-caaced6c8e25 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:08.948661 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c8ebbece-f211-49d5-91c4-caaced6c8e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:08.958447 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1072/2144] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:08.959909 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ebbece-f211-49d5-91c4-caaced6c8e25 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:08.961540 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c8ebbece-f211-49d5-91c4-caaced6c8e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:08.969051 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6f686-9dff-4d62-96fb-a9fd60ba141c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:09.043029 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ebbece-f211-49d5-91c4-caaced6c8e25 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:09.047800 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c33a7f-beb8-4f3d-b1d4-161063c793e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:09.048953 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c33a7f-beb8-4f3d-b1d4-161063c793e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:09.048953 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c33a7f-beb8-4f3d-b1d4-161063c793e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:09.049231 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c33a7f-beb8-4f3d-b1d4-161063c793e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:09.060739 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c33a7f-beb8-4f3d-b1d4-161063c793e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:09.062163 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d40e3-86ba-48c5-ac19-1292274f2e4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:09.062381 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c33a7f-beb8-4f3d-b1d4-161063c793e7 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:09.063423 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d40e3-86ba-48c5-ac19-1292274f2e4d service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:09.064010 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d40e3-86ba-48c5-ac19-1292274f2e4d service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:09.064551 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d40e3-86ba-48c5-ac19-1292274f2e4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:09.067782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7d8d40e3-86ba-48c5-ac19-1292274f2e4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:09.073592 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1073/2145] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:46:09.077588 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9a6eb-a001-4f05-8ec2-0eda81c4374a None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:09.078509 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9a6eb-a001-4f05-8ec2-0eda81c4374a None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:09.078743 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9a6eb-a001-4f05-8ec2-0eda81c4374a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:09.108444 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-5cc9a6eb-a001-4f05-8ec2-0eda81c4374a None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:09.109593 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5cc9a6eb-a001-4f05-8ec2-0eda81c4374a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:09.124183 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1074/2146] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:09.126066 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9a6eb-a001-4f05-8ec2-0eda81c4374a None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:09.139979 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9a6eb-a001-4f05-8ec2-0eda81c4374a None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:09.146654 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd676ed3-44aa-460b-8d0d-4b340507172c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:09.147444 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd676ed3-44aa-460b-8d0d-4b340507172c admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:09.147962 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd676ed3-44aa-460b-8d0d-4b340507172c admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:09.148819 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd676ed3-44aa-460b-8d0d-4b340507172c admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:09.149438 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd676ed3-44aa-460b-8d0d-4b340507172c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:46:09.150129 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd676ed3-44aa-460b-8d0d-4b340507172c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:09.152246 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd676ed3-44aa-460b-8d0d-4b340507172c admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:09.166412 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1075/2147] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:46:09.173060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd676ed3-44aa-460b-8d0d-4b340507172c admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:09.184904 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd676ed3-44aa-460b-8d0d-4b340507172c admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:09.189882 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a059957-bd98-44d4-8d95-b02f4830bb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:09.190601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a059957-bd98-44d4-8d95-b02f4830bb14 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:09.190826 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a059957-bd98-44d4-8d95-b02f4830bb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:09.191100 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a059957-bd98-44d4-8d95-b02f4830bb14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:09.191818 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a059957-bd98-44d4-8d95-b02f4830bb14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:09.193740 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a059957-bd98-44d4-8d95-b02f4830bb14 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:09.206835 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d40e3-86ba-48c5-ac19-1292274f2e4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:09.210787 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d40e3-86ba-48c5-ac19-1292274f2e4d service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:09.233646 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1073/2148] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:08 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:46:09.238395 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1076/2149] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:46:09 2022] POST /identity/v3/projects => generated 357 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:46:09.240825 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d40e3-86ba-48c5-ac19-1292274f2e4d service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:09.263309 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d40e3-86ba-48c5-ac19-1292274f2e4d service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:09.399597 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbf788-c104-472a-84e2-6d8a413943aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:09.401927 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbf788-c104-472a-84e2-6d8a413943aa admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:09.402555 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbf788-c104-472a-84e2-6d8a413943aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:09.403026 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbf788-c104-472a-84e2-6d8a413943aa admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:09.404321 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbf788-c104-472a-84e2-6d8a413943aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:09.408511 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbf788-c104-472a-84e2-6d8a413943aa admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:09.431594 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:09.458859 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1074/2150] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:46:09 2022] POST /identity/v3/users => generated 279 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:46:09.463668 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a059957-bd98-44d4-8d95-b02f4830bb14 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:09.476447 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a059957-bd98-44d4-8d95-b02f4830bb14 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:09.482159 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206df25-0c77-4149-9f5d-70782154ebee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:09.483025 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206df25-0c77-4149-9f5d-70782154ebee admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:09.483440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206df25-0c77-4149-9f5d-70782154ebee admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:09.483845 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206df25-0c77-4149-9f5d-70782154ebee admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:09.484715 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206df25-0c77-4149-9f5d-70782154ebee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:09.486737 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8206df25-0c77-4149-9f5d-70782154ebee admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:09.513112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1077/2151] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:46:09.515211 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbf788-c104-472a-84e2-6d8a413943aa admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:09.550001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbf788-c104-472a-84e2-6d8a413943aa admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:09.573580 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9795be8-d158-49f9-bd19-8b7254478c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:09.574490 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9795be8-d158-49f9-bd19-8b7254478c40 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:09.574883 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9795be8-d158-49f9-bd19-8b7254478c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:09.575334 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9795be8-d158-49f9-bd19-8b7254478c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:09.576657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9795be8-d158-49f9-bd19-8b7254478c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:09.582088 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9795be8-d158-49f9-bd19-8b7254478c40 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:09.614774 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1075/2152] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:09 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:46:09.619853 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206df25-0c77-4149-9f5d-70782154ebee admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:09.633419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8206df25-0c77-4149-9f5d-70782154ebee admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:09.640287 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9795be8-d158-49f9-bd19-8b7254478c40 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:09.644640 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e9795be8-d158-49f9-bd19-8b7254478c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:09.653219 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5383333-1b3d-49ce-8544-7cd14b608458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:09.654456 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5383333-1b3d-49ce-8544-7cd14b608458 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:09.655311 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5383333-1b3d-49ce-8544-7cd14b608458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:09.655690 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5383333-1b3d-49ce-8544-7cd14b608458 admin admin] PATH_INFO: `/v3/projects/3ff8d21408694ca1a4215c589f604d51/users/3abbc26db53b40aebf2aebb284d3ca21/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:09.667143 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9795be8-d158-49f9-bd19-8b7254478c40 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:09.681696 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82913720-e72c-4cac-8d5a-6bda2ebd77f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:09.682364 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82913720-e72c-4cac-8d5a-6bda2ebd77f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:09.682637 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82913720-e72c-4cac-8d5a-6bda2ebd77f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:09.682913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82913720-e72c-4cac-8d5a-6bda2ebd77f8 admin admin] PATH_INFO: `/v3/projects/9571799e2aed497eb33dc772a2a42cf6` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:09.684795 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82913720-e72c-4cac-8d5a-6bda2ebd77f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9571799e2aed497eb33dc772a2a42cf6)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:09.686758 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82913720-e72c-4cac-8d5a-6bda2ebd77f8 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:09.745267 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5383333-1b3d-49ce-8544-7cd14b608458 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ff8d21408694ca1a4215c589f604d51, user_id=3abbc26db53b40aebf2aebb284d3ca21, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:09.757114 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5383333-1b3d-49ce-8544-7cd14b608458 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:09.789967 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1078/2153] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:46:09 2022] PUT /identity/v3/projects/3ff8d21408694ca1a4215c589f604d51/users/3abbc26db53b40aebf2aebb284d3ca21/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:09.798398 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-82913720-e72c-4cac-8d5a-6bda2ebd77f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9571799e2aed497eb33dc772a2a42cf6', 'request_id': 'req-82913720-e72c-4cac-8d5a-6bda2ebd77f8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:09.806344 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd2293-d667-449a-afed-fd25829db6b8 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:09.806344 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd2293-d667-449a-afed-fd25829db6b8 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:09.806344 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd2293-d667-449a-afed-fd25829db6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:09.839270 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-82913720-e72c-4cac-8d5a-6bda2ebd77f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9571799e2aed497eb33dc772a2a42cf6', 'request_id': 'req-82913720-e72c-4cac-8d5a-6bda2ebd77f8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:09.854997 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-82913720-e72c-4cac-8d5a-6bda2ebd77f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9571799e2aed497eb33dc772a2a42cf6', 'request_id': 'req-82913720-e72c-4cac-8d5a-6bda2ebd77f8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:09.884280 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-37fd2293-d667-449a-afed-fd25829db6b8 None None] MFA Rules not processed for user `3abbc26db53b40aebf2aebb284d3ca21`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:09.885012 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-82913720-e72c-4cac-8d5a-6bda2ebd77f8 admin admin] The token cache is being invalidate because project 9571799e2aed497eb33dc772a2a42cf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:46:09.885313 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-82913720-e72c-4cac-8d5a-6bda2ebd77f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:09.887497 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-82913720-e72c-4cac-8d5a-6bda2ebd77f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:09.888323 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-37fd2293-d667-449a-afed-fd25829db6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:09.894032 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1076/2154] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:46:09 2022] DELETE /identity/v3/projects/9571799e2aed497eb33dc772a2a42cf6 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:09.900668 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f30fc6-6d4a-423b-8ed1-8b3e8b897716 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:09.901033 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f30fc6-6d4a-423b-8ed1-8b3e8b897716 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:09.901220 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f30fc6-6d4a-423b-8ed1-8b3e8b897716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:09.910460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:09.945546 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-81f30fc6-6d4a-423b-8ed1-8b3e8b897716 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:09.953369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-81f30fc6-6d4a-423b-8ed1-8b3e8b897716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:10.030173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1079/2155] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:09 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:10.114386 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd2293-d667-449a-afed-fd25829db6b8 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:10.116075 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-37fd2293-d667-449a-afed-fd25829db6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:10.139196 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1077/2156] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:10.142514 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4544e2-67b2-4f48-a4f0-0412a7895de2 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:10.142995 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4544e2-67b2-4f48-a4f0-0412a7895de2 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:10.144387 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4544e2-67b2-4f48-a4f0-0412a7895de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:10.199044 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-9c4544e2-67b2-4f48-a4f0-0412a7895de2 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:10.205094 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9c4544e2-67b2-4f48-a4f0-0412a7895de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:10.231947 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1078/2157] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:46:10.234253 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4544e2-67b2-4f48-a4f0-0412a7895de2 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:10.260776 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4544e2-67b2-4f48-a4f0-0412a7895de2 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:10.272286 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5d0fa-145f-4eeb-bc63-4cecc3d43d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:10.273824 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5d0fa-145f-4eeb-bc63-4cecc3d43d04 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:10.274443 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5d0fa-145f-4eeb-bc63-4cecc3d43d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:10.275398 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5d0fa-145f-4eeb-bc63-4cecc3d43d04 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:10.276780 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5d0fa-145f-4eeb-bc63-4cecc3d43d04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:46:10.277491 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5d0fa-145f-4eeb-bc63-4cecc3d43d04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:10.280209 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd2293-d667-449a-afed-fd25829db6b8 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:10.282254 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5d0fa-145f-4eeb-bc63-4cecc3d43d04 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:10.288470 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b1029-b938-40d5-a501-1386e389104c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:10.291034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b1029-b938-40d5-a501-1386e389104c service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:10.291648 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b1029-b938-40d5-a501-1386e389104c service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:10.292356 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b1029-b938-40d5-a501-1386e389104c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:10.309884 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b1029-b938-40d5-a501-1386e389104c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:10.320584 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1079/2158] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:46:10.322567 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5d0fa-145f-4eeb-bc63-4cecc3d43d04 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:10.324224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b1029-b938-40d5-a501-1386e389104c service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:10.344529 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5d0fa-145f-4eeb-bc63-4cecc3d43d04 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:10.360708 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32a459-ae8b-4926-a550-963575b0f805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:10.361955 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32a459-ae8b-4926-a550-963575b0f805 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:10.362644 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32a459-ae8b-4926-a550-963575b0f805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:10.363120 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32a459-ae8b-4926-a550-963575b0f805 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:10.364370 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32a459-ae8b-4926-a550-963575b0f805 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:10.368230 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32a459-ae8b-4926-a550-963575b0f805 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:10.369232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1080/2159] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:10 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:46:10.383137 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b1029-b938-40d5-a501-1386e389104c service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:10.384649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4e2b1029-b938-40d5-a501-1386e389104c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:10.412278 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b1029-b938-40d5-a501-1386e389104c service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:10.418729 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e656d9e-7abb-43c1-beab-a58ee4bcfa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:10.420335 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e656d9e-7abb-43c1-beab-a58ee4bcfa82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:10.420747 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e656d9e-7abb-43c1-beab-a58ee4bcfa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:10.422356 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e656d9e-7abb-43c1-beab-a58ee4bcfa82 admin admin] PATH_INFO: `/v3/users/3abbc26db53b40aebf2aebb284d3ca21` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:10.423061 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e656d9e-7abb-43c1-beab-a58ee4bcfa82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3abbc26db53b40aebf2aebb284d3ca21)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:10.425795 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e656d9e-7abb-43c1-beab-a58ee4bcfa82 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:10.440265 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1080/2160] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:46:10 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:46:10.444967 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32a459-ae8b-4926-a550-963575b0f805 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:10.511748 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:10.546900 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-4e656d9e-7abb-43c1-beab-a58ee4bcfa82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3abbc26db53b40aebf2aebb284d3ca21'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:10.572789 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-4e656d9e-7abb-43c1-beab-a58ee4bcfa82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3abbc26db53b40aebf2aebb284d3ca21'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:10.598901 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32a459-ae8b-4926-a550-963575b0f805 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:10.604975 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-4e656d9e-7abb-43c1-beab-a58ee4bcfa82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3abbc26db53b40aebf2aebb284d3ca21'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:10.606388 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-4e656d9e-7abb-43c1-beab-a58ee4bcfa82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3abbc26db53b40aebf2aebb284d3ca21'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:10.608497 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4a90d-a710-47ac-8fb2-4ccc40c1730b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:10.609483 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4a90d-a710-47ac-8fb2-4ccc40c1730b admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:10.609894 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4a90d-a710-47ac-8fb2-4ccc40c1730b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:10.610292 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4a90d-a710-47ac-8fb2-4ccc40c1730b admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:10.611485 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4a90d-a710-47ac-8fb2-4ccc40c1730b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:10.614064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4a90d-a710-47ac-8fb2-4ccc40c1730b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:10.639162 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-4e656d9e-7abb-43c1-beab-a58ee4bcfa82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3abbc26db53b40aebf2aebb284d3ca21'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:10.650360 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1081/2161] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:46:10 2022] DELETE /identity/v3/users/3abbc26db53b40aebf2aebb284d3ca21 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:46:10.661243 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bda312-fd55-4759-bc8e-30a34fd36af4 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:10.661709 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bda312-fd55-4759-bc8e-30a34fd36af4 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:10.662233 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bda312-fd55-4759-bc8e-30a34fd36af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:10.674897 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1081/2162] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:46:10 2022] POST /identity/v3/users => generated 284 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:46:10.680490 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4a90d-a710-47ac-8fb2-4ccc40c1730b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:10.682484 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9ef4a90d-a710-47ac-8fb2-4ccc40c1730b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:10.688646 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-e2bda312-fd55-4759-bc8e-30a34fd36af4 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:10.690111 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e2bda312-fd55-4759-bc8e-30a34fd36af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:10.700724 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4a90d-a710-47ac-8fb2-4ccc40c1730b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:10.728355 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:10.795121 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ce1a0-9464-4669-8b45-dd0e09e65f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:10.800203 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ce1a0-9464-4669-8b45-dd0e09e65f8d admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:10.800203 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ce1a0-9464-4669-8b45-dd0e09e65f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:10.800203 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ce1a0-9464-4669-8b45-dd0e09e65f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:10.800203 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ce1a0-9464-4669-8b45-dd0e09e65f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:10.802311 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ce1a0-9464-4669-8b45-dd0e09e65f8d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:10.817874 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1082/2163] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:46:10.823458 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ce1a0-9464-4669-8b45-dd0e09e65f8d admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:10.843123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ce1a0-9464-4669-8b45-dd0e09e65f8d admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:10.849344 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6090159-045a-47cd-bd04-5d2e43d82265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:10.849980 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6090159-045a-47cd-bd04-5d2e43d82265 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:10.850254 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6090159-045a-47cd-bd04-5d2e43d82265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:10.850610 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6090159-045a-47cd-bd04-5d2e43d82265 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:10.851274 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6090159-045a-47cd-bd04-5d2e43d82265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:10.852982 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6090159-045a-47cd-bd04-5d2e43d82265 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:10.867214 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1083/2164] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:46:10.871809 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1082/2165] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:10.873118 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6090159-045a-47cd-bd04-5d2e43d82265 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:10.888487 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bda312-fd55-4759-bc8e-30a34fd36af4 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:10.892617 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e2bda312-fd55-4759-bc8e-30a34fd36af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:10.895409 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6090159-045a-47cd-bd04-5d2e43d82265 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:10.907223 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c872d73-d972-496d-b335-4d004e76749e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:10.909577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c872d73-d972-496d-b335-4d004e76749e admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:10.910377 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c872d73-d972-496d-b335-4d004e76749e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:10.911870 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c872d73-d972-496d-b335-4d004e76749e admin admin] PATH_INFO: `/v3/projects/b007ec059292458e9a62734a01065da3/users/d5339f1ce63746478bdf2e157836baf9/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:10.966206 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c872d73-d972-496d-b335-4d004e76749e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b007ec059292458e9a62734a01065da3, user_id=d5339f1ce63746478bdf2e157836baf9, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:10.971976 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c872d73-d972-496d-b335-4d004e76749e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:11.013424 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1084/2166] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:46:10 2022] PUT /identity/v3/projects/b007ec059292458e9a62734a01065da3/users/d5339f1ce63746478bdf2e157836baf9/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:11.034737 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292385f9-f7f1-4ead-80d2-2a597f77fb93 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:11.035388 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292385f9-f7f1-4ead-80d2-2a597f77fb93 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:11.036012 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292385f9-f7f1-4ead-80d2-2a597f77fb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:11.054992 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bda312-fd55-4759-bc8e-30a34fd36af4 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:11.121807 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-292385f9-f7f1-4ead-80d2-2a597f77fb93 None None] MFA Rules not processed for user `d5339f1ce63746478bdf2e157836baf9`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:11.123254 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-292385f9-f7f1-4ead-80d2-2a597f77fb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:11.228847 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1085/2167] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:11.233935 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395484d7-b22c-46df-8b6a-e05eb3727920 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:11.234840 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395484d7-b22c-46df-8b6a-e05eb3727920 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:11.235202 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395484d7-b22c-46df-8b6a-e05eb3727920 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:11.235549 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395484d7-b22c-46df-8b6a-e05eb3727920 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:11.255382 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292385f9-f7f1-4ead-80d2-2a597f77fb93 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:11.257267 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-292385f9-f7f1-4ead-80d2-2a597f77fb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:11.262672 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:11.446844 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395484d7-b22c-46df-8b6a-e05eb3727920 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:11.451055 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395484d7-b22c-46df-8b6a-e05eb3727920 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:11.454741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292385f9-f7f1-4ead-80d2-2a597f77fb93 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:11.461053 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d487a1fd-47fb-4fac-a03a-761efe12b7e2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '766ad3d6be374fc482a7c0bf6a1e56ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:11.462068 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487a1fd-47fb-4fac-a03a-761efe12b7e2 service glance] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:11.462822 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487a1fd-47fb-4fac-a03a-761efe12b7e2 service glance] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:11.463134 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d487a1fd-47fb-4fac-a03a-761efe12b7e2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:11.475818 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1083/2168] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:46:11.492948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487a1fd-47fb-4fac-a03a-761efe12b7e2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:11.497448 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d487a1fd-47fb-4fac-a03a-761efe12b7e2 service glance] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:11.521566 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1086/2169] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:46:12.029934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395484d7-b22c-46df-8b6a-e05eb3727920 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:12.031357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-395484d7-b22c-46df-8b6a-e05eb3727920 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:12.054971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395484d7-b22c-46df-8b6a-e05eb3727920 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:12.062275 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9325c61-b19f-4d29-8c46-9d8ec2cde10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:12.062939 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9325c61-b19f-4d29-8c46-9d8ec2cde10b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:12.063218 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9325c61-b19f-4d29-8c46-9d8ec2cde10b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:12.063649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9325c61-b19f-4d29-8c46-9d8ec2cde10b admin admin] PATH_INFO: `/v3/projects/3ff8d21408694ca1a4215c589f604d51` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:12.065104 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9325c61-b19f-4d29-8c46-9d8ec2cde10b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ff8d21408694ca1a4215c589f604d51)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:12.067106 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9325c61-b19f-4d29-8c46-9d8ec2cde10b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:12.104691 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:12.127531 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a9325c61-b19f-4d29-8c46-9d8ec2cde10b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ff8d21408694ca1a4215c589f604d51', 'request_id': 'req-a9325c61-b19f-4d29-8c46-9d8ec2cde10b'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:12.139155 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a9325c61-b19f-4d29-8c46-9d8ec2cde10b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ff8d21408694ca1a4215c589f604d51', 'request_id': 'req-a9325c61-b19f-4d29-8c46-9d8ec2cde10b'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:12.149724 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a9325c61-b19f-4d29-8c46-9d8ec2cde10b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ff8d21408694ca1a4215c589f604d51', 'request_id': 'req-a9325c61-b19f-4d29-8c46-9d8ec2cde10b'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:12.170071 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a9325c61-b19f-4d29-8c46-9d8ec2cde10b admin admin] The token cache is being invalidate because project 3ff8d21408694ca1a4215c589f604d51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:46:12.170541 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a9325c61-b19f-4d29-8c46-9d8ec2cde10b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:12.171597 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a9325c61-b19f-4d29-8c46-9d8ec2cde10b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:12.174550 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1084/2170] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:46:12 2022] DELETE /identity/v3/projects/3ff8d21408694ca1a4215c589f604d51 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:12.181567 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131226a9-a68e-455f-b971-b69957273da8 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:12.182036 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131226a9-a68e-455f-b971-b69957273da8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:12.182486 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131226a9-a68e-455f-b971-b69957273da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:12.222024 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-131226a9-a68e-455f-b971-b69957273da8 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:12.223404 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-131226a9-a68e-455f-b971-b69957273da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:12.225409 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620ddec-522c-43cb-bac9-3a818667dd2c None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:12.225901 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620ddec-522c-43cb-bac9-3a818667dd2c None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:12.226407 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620ddec-522c-43cb-bac9-3a818667dd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:12.252186 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-5620ddec-522c-43cb-bac9-3a818667dd2c None None] MFA Rules not processed for user `867510e21fed4ac68228500d540081e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:12.253800 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5620ddec-522c-43cb-bac9-3a818667dd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:12.332664 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1087/2171] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:12.338533 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1085/2172] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:12.353697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a45ab-858d-4a45-b1d3-a1138e39ee45 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:12.354047 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a45ab-858d-4a45-b1d3-a1138e39ee45 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:12.354236 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a45ab-858d-4a45-b1d3-a1138e39ee45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:12.385625 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-df7a45ab-858d-4a45-b1d3-a1138e39ee45 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:12.388711 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-df7a45ab-858d-4a45-b1d3-a1138e39ee45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:12.403067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1086/2173] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:12.409324 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131226a9-a68e-455f-b971-b69957273da8 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:12.420941 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131226a9-a68e-455f-b971-b69957273da8 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:12.429733 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c1f39-3156-44e3-9440-2d0cbcc4d3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:12.430420 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c1f39-3156-44e3-9440-2d0cbcc4d3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:12.430736 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c1f39-3156-44e3-9440-2d0cbcc4d3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:12.431081 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c1f39-3156-44e3-9440-2d0cbcc4d3f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:12.431623 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c1f39-3156-44e3-9440-2d0cbcc4d3f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:46:12.431980 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c1f39-3156-44e3-9440-2d0cbcc4d3f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:12.433719 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c1f39-3156-44e3-9440-2d0cbcc4d3f2 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:12.448561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1088/2174] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:46:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:46:12.454934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a45ab-858d-4a45-b1d3-a1138e39ee45 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:12.473370 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a45ab-858d-4a45-b1d3-a1138e39ee45 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:12.482590 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ac11a-04dd-496e-91e5-e26de8a00c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:12.483571 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ac11a-04dd-496e-91e5-e26de8a00c93 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:12.484316 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ac11a-04dd-496e-91e5-e26de8a00c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:12.488585 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ac11a-04dd-496e-91e5-e26de8a00c93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:12.489345 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ac11a-04dd-496e-91e5-e26de8a00c93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:12.491799 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ac11a-04dd-496e-91e5-e26de8a00c93 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:12.533688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1087/2175] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:46:12 2022] POST /identity/v3/projects => generated 377 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:46:12.538071 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c1f39-3156-44e3-9440-2d0cbcc4d3f2 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:12.555654 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c1f39-3156-44e3-9440-2d0cbcc4d3f2 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:12.666538 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee2d17-547d-400e-a1cc-f4b2c3641f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:12.667238 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee2d17-547d-400e-a1cc-f4b2c3641f5b admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:12.667682 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee2d17-547d-400e-a1cc-f4b2c3641f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:12.668016 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee2d17-547d-400e-a1cc-f4b2c3641f5b admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:12.668816 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee2d17-547d-400e-a1cc-f4b2c3641f5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:12.670850 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee2d17-547d-400e-a1cc-f4b2c3641f5b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:12.738284 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1089/2176] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:46:12 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:46:12.741873 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ac11a-04dd-496e-91e5-e26de8a00c93 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:12.763943 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ac11a-04dd-496e-91e5-e26de8a00c93 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:12.772877 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b647e-88ce-4117-b1f6-bbd8d03d838f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:12.773666 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b647e-88ce-4117-b1f6-bbd8d03d838f admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:12.774134 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b647e-88ce-4117-b1f6-bbd8d03d838f admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:12.774945 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b647e-88ce-4117-b1f6-bbd8d03d838f admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:12.775833 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b647e-88ce-4117-b1f6-bbd8d03d838f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:12.778928 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b647e-88ce-4117-b1f6-bbd8d03d838f admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:12.800241 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1088/2177] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:46:12.806163 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee2d17-547d-400e-a1cc-f4b2c3641f5b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:12.820689 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:12.829745 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee2d17-547d-400e-a1cc-f4b2c3641f5b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:12.841232 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0692ca-73eb-411f-9579-c8233ac473b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:12.842297 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0692ca-73eb-411f-9579-c8233ac473b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:12.842833 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0692ca-73eb-411f-9579-c8233ac473b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:12.843313 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0692ca-73eb-411f-9579-c8233ac473b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:12.844878 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0692ca-73eb-411f-9579-c8233ac473b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:12.850105 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0692ca-73eb-411f-9579-c8233ac473b8 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:12.852413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b647e-88ce-4117-b1f6-bbd8d03d838f admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:12.856116 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e83b647e-88ce-4117-b1f6-bbd8d03d838f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:12.871571 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1090/2178] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:12 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:46:12.878293 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0692ca-73eb-411f-9579-c8233ac473b8 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:12.888452 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b647e-88ce-4117-b1f6-bbd8d03d838f admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:12.897897 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e8925-adf5-4e55-8b2d-10b0b25fa11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:12.899438 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e8925-adf5-4e55-8b2d-10b0b25fa11c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:12.900285 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e8925-adf5-4e55-8b2d-10b0b25fa11c admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:12.901416 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e8925-adf5-4e55-8b2d-10b0b25fa11c admin admin] PATH_INFO: `/v3/users/922263624aa140d6ad245b8cb2c7f660` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:12.901727 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0692ca-73eb-411f-9579-c8233ac473b8 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:12.904608 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e8925-adf5-4e55-8b2d-10b0b25fa11c admin admin] RBAC: Authorizing `identity:delete_user(user_id=922263624aa140d6ad245b8cb2c7f660)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:12.910218 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e8925-adf5-4e55-8b2d-10b0b25fa11c admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:12.916368 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf27082-22af-488e-97c9-d9f834d4985b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:12.917203 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf27082-22af-488e-97c9-d9f834d4985b admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:12.917630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf27082-22af-488e-97c9-d9f834d4985b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:12.917957 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf27082-22af-488e-97c9-d9f834d4985b admin admin] PATH_INFO: `/v3/projects/36f22a1fa71c41fd9d7f0616204af7a7/users/c940e07b8bd14e0c87a1594650eb7f8d/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:12.948769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf27082-22af-488e-97c9-d9f834d4985b admin admin] RBAC: Authorizing `identity:create_grant(project_id=36f22a1fa71c41fd9d7f0616204af7a7, user_id=c940e07b8bd14e0c87a1594650eb7f8d, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:12.975527 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf27082-22af-488e-97c9-d9f834d4985b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:13.027494 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1091/2179] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:46:12 2022] PUT /identity/v3/projects/36f22a1fa71c41fd9d7f0616204af7a7/users/c940e07b8bd14e0c87a1594650eb7f8d/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:13.048494 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e71e8925-adf5-4e55-8b2d-10b0b25fa11c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '922263624aa140d6ad245b8cb2c7f660'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:13.050114 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f02fa-b044-4d38-8ece-2a080cf3b4a2 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:13.050748 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f02fa-b044-4d38-8ece-2a080cf3b4a2 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:13.051198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f02fa-b044-4d38-8ece-2a080cf3b4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:13.066277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e71e8925-adf5-4e55-8b2d-10b0b25fa11c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '922263624aa140d6ad245b8cb2c7f660'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:13.145208 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-d68f02fa-b044-4d38-8ece-2a080cf3b4a2 None None] MFA Rules not processed for user `c940e07b8bd14e0c87a1594650eb7f8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:13.146576 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d68f02fa-b044-4d38-8ece-2a080cf3b4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:13.147801 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e71e8925-adf5-4e55-8b2d-10b0b25fa11c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '922263624aa140d6ad245b8cb2c7f660'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:13.148548 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e71e8925-adf5-4e55-8b2d-10b0b25fa11c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '922263624aa140d6ad245b8cb2c7f660'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:13.151038 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:13.165902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e71e8925-adf5-4e55-8b2d-10b0b25fa11c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '922263624aa140d6ad245b8cb2c7f660'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:13.178504 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1089/2180] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:46:12 2022] DELETE /identity/v3/users/922263624aa140d6ad245b8cb2c7f660 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:46:13.189105 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a98ae-4249-481c-9264-b4d14af127db None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:13.191265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a98ae-4249-481c-9264-b4d14af127db None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:13.191265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a98ae-4249-481c-9264-b4d14af127db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:13.240488 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-3c6a98ae-4249-481c-9264-b4d14af127db None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:13.243221 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-3c6a98ae-4249-481c-9264-b4d14af127db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:13.317819 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1092/2181] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:46:13.332861 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f02fa-b044-4d38-8ece-2a080cf3b4a2 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:13.334993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d68f02fa-b044-4d38-8ece-2a080cf3b4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:13.363551 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1090/2182] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:13.377298 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a98ae-4249-481c-9264-b4d14af127db None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:13.378998 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-3c6a98ae-4249-481c-9264-b4d14af127db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:13.461303 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f02fa-b044-4d38-8ece-2a080cf3b4a2 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:13.518353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a98ae-4249-481c-9264-b4d14af127db None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:13.523923 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8093966-ca98-413f-b8c0-bc27b9d8a3eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:13.524569 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8093966-ca98-413f-b8c0-bc27b9d8a3eb service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:13.524815 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8093966-ca98-413f-b8c0-bc27b9d8a3eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:13.525110 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8093966-ca98-413f-b8c0-bc27b9d8a3eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:13.543780 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8093966-ca98-413f-b8c0-bc27b9d8a3eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:13.544337 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb3bd5-d359-42e0-9bb2-8a3391425ace service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:13.545315 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb3bd5-d359-42e0-9bb2-8a3391425ace service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:13.545656 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb3bd5-d359-42e0-9bb2-8a3391425ace service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:13.545918 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb3bd5-d359-42e0-9bb2-8a3391425ace service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:13.546084 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8093966-ca98-413f-b8c0-bc27b9d8a3eb service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:13.564157 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1091/2183] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:46:13.597064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:13.650457 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb3bd5-d359-42e0-9bb2-8a3391425ace service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:13.652027 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb3bd5-d359-42e0-9bb2-8a3391425ace service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:13.662230 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1093/2184] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:46:13.975985 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8093966-ca98-413f-b8c0-bc27b9d8a3eb service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:13.977658 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f8093966-ca98-413f-b8c0-bc27b9d8a3eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:14.001099 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8093966-ca98-413f-b8c0-bc27b9d8a3eb service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:14.008604 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484886e5-6d51-4e81-ac2f-07b7078cc82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:14.009934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484886e5-6d51-4e81-ac2f-07b7078cc82d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:14.010477 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484886e5-6d51-4e81-ac2f-07b7078cc82d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:14.011046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484886e5-6d51-4e81-ac2f-07b7078cc82d admin admin] PATH_INFO: `/v3/projects/c2bc767e1b6f43a888aa42408fe8f42f` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:14.012850 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484886e5-6d51-4e81-ac2f-07b7078cc82d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2bc767e1b6f43a888aa42408fe8f42f)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:14.014968 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484886e5-6d51-4e81-ac2f-07b7078cc82d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:14.099593 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-484886e5-6d51-4e81-ac2f-07b7078cc82d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2bc767e1b6f43a888aa42408fe8f42f', 'request_id': 'req-484886e5-6d51-4e81-ac2f-07b7078cc82d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:14.111561 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-484886e5-6d51-4e81-ac2f-07b7078cc82d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2bc767e1b6f43a888aa42408fe8f42f', 'request_id': 'req-484886e5-6d51-4e81-ac2f-07b7078cc82d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:14.121373 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-484886e5-6d51-4e81-ac2f-07b7078cc82d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2bc767e1b6f43a888aa42408fe8f42f', 'request_id': 'req-484886e5-6d51-4e81-ac2f-07b7078cc82d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:14.139342 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-484886e5-6d51-4e81-ac2f-07b7078cc82d admin admin] The token cache is being invalidate because project c2bc767e1b6f43a888aa42408fe8f42f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:46:14.139659 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-484886e5-6d51-4e81-ac2f-07b7078cc82d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:14.140476 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-484886e5-6d51-4e81-ac2f-07b7078cc82d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:14.151419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1092/2185] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:46:13 2022] DELETE /identity/v3/projects/c2bc767e1b6f43a888aa42408fe8f42f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:46:14.155932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb3bd5-d359-42e0-9bb2-8a3391425ace service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:14.190723 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb3bd5-d359-42e0-9bb2-8a3391425ace service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:14.290225 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34854b-be86-40fd-b430-e03a3f7ef3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:14.291001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34854b-be86-40fd-b430-e03a3f7ef3eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:14.291285 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34854b-be86-40fd-b430-e03a3f7ef3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:14.291556 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34854b-be86-40fd-b430-e03a3f7ef3eb admin admin] PATH_INFO: `/v3/users/d893730fbcdf4010a3452b17339047ec` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:14.293351 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34854b-be86-40fd-b430-e03a3f7ef3eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d893730fbcdf4010a3452b17339047ec)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:14.295436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab34854b-be86-40fd-b430-e03a3f7ef3eb admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:14.402208 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ab34854b-be86-40fd-b430-e03a3f7ef3eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd893730fbcdf4010a3452b17339047ec'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:14.412811 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ab34854b-be86-40fd-b430-e03a3f7ef3eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd893730fbcdf4010a3452b17339047ec'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:14.414045 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ab34854b-be86-40fd-b430-e03a3f7ef3eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd893730fbcdf4010a3452b17339047ec'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:14.433285 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ab34854b-be86-40fd-b430-e03a3f7ef3eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd893730fbcdf4010a3452b17339047ec'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:14.455600 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ab34854b-be86-40fd-b430-e03a3f7ef3eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd893730fbcdf4010a3452b17339047ec'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:14.465229 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1094/2186] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:46:14 2022] DELETE /identity/v3/users/d893730fbcdf4010a3452b17339047ec => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:14.512161 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484886e5-6d51-4e81-ac2f-07b7078cc82d admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:14.515770 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-484886e5-6d51-4e81-ac2f-07b7078cc82d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:14.535757 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484886e5-6d51-4e81-ac2f-07b7078cc82d admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:14.569881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:14.735802 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda474fe-6161-4b75-889e-3520c1694c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:14.737133 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda474fe-6161-4b75-889e-3520c1694c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:14.737409 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda474fe-6161-4b75-889e-3520c1694c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:14.737678 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda474fe-6161-4b75-889e-3520c1694c66 admin admin] PATH_INFO: `/v3/users/5fe56abf851941a8866ef7b46a5f5686` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:14.739115 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda474fe-6161-4b75-889e-3520c1694c66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fe56abf851941a8866ef7b46a5f5686)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:14.741256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda474fe-6161-4b75-889e-3520c1694c66 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:14.817653 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cda474fe-6161-4b75-889e-3520c1694c66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fe56abf851941a8866ef7b46a5f5686'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:14.831661 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cda474fe-6161-4b75-889e-3520c1694c66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fe56abf851941a8866ef7b46a5f5686'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:14.865290 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cda474fe-6161-4b75-889e-3520c1694c66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fe56abf851941a8866ef7b46a5f5686'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:14.866682 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cda474fe-6161-4b75-889e-3520c1694c66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fe56abf851941a8866ef7b46a5f5686'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:14.877187 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cda474fe-6161-4b75-889e-3520c1694c66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fe56abf851941a8866ef7b46a5f5686'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:14.884350 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1093/2187] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:46:14 2022] DELETE /identity/v3/users/5fe56abf851941a8866ef7b46a5f5686 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:14.889591 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7797bf-c68b-40c2-b18f-43bd31245d2d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:14.889936 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7797bf-c68b-40c2-b18f-43bd31245d2d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:14.890455 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7797bf-c68b-40c2-b18f-43bd31245d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:14.925574 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-bf7797bf-c68b-40c2-b18f-43bd31245d2d None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:14.926946 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-bf7797bf-c68b-40c2-b18f-43bd31245d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:14.986397 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:15.010550 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1095/2188] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:15.023947 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda474fe-6161-4b75-889e-3520c1694c66 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:15.025711 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-cda474fe-6161-4b75-889e-3520c1694c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:15.094590 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda474fe-6161-4b75-889e-3520c1694c66 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:15.102955 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7797bf-c68b-40c2-b18f-43bd31245d2d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:15.106255 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-bf7797bf-c68b-40c2-b18f-43bd31245d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:15.127129 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf76e5-ed69-4d22-a863-e9bd71c09fc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:15.128120 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf76e5-ed69-4d22-a863-e9bd71c09fc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:15.128120 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf76e5-ed69-4d22-a863-e9bd71c09fc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:15.128444 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf76e5-ed69-4d22-a863-e9bd71c09fc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:15.130742 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7797bf-c68b-40c2-b18f-43bd31245d2d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:15.141382 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90420b2c-28ff-4a35-a7a3-6dc1aafeb074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:15.142501 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90420b2c-28ff-4a35-a7a3-6dc1aafeb074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:15.143362 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90420b2c-28ff-4a35-a7a3-6dc1aafeb074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:15.144209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90420b2c-28ff-4a35-a7a3-6dc1aafeb074 admin admin] PATH_INFO: `/v3/projects/7d259e69c91c4ca089d79b47406ffe59` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:15.146022 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf76e5-ed69-4d22-a863-e9bd71c09fc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:15.146283 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90420b2c-28ff-4a35-a7a3-6dc1aafeb074 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d259e69c91c4ca089d79b47406ffe59)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:15.147596 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf76e5-ed69-4d22-a863-e9bd71c09fc5 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:15.150388 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90420b2c-28ff-4a35-a7a3-6dc1aafeb074 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:15.164505 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1094/2189] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:46:15.293896 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-90420b2c-28ff-4a35-a7a3-6dc1aafeb074 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d259e69c91c4ca089d79b47406ffe59', 'request_id': 'req-90420b2c-28ff-4a35-a7a3-6dc1aafeb074'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:15.307622 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-90420b2c-28ff-4a35-a7a3-6dc1aafeb074 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d259e69c91c4ca089d79b47406ffe59', 'request_id': 'req-90420b2c-28ff-4a35-a7a3-6dc1aafeb074'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:15.349371 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-90420b2c-28ff-4a35-a7a3-6dc1aafeb074 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d259e69c91c4ca089d79b47406ffe59', 'request_id': 'req-90420b2c-28ff-4a35-a7a3-6dc1aafeb074'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:15.382772 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-90420b2c-28ff-4a35-a7a3-6dc1aafeb074 admin admin] The token cache is being invalidate because project 7d259e69c91c4ca089d79b47406ffe59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:46:15.384649 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-90420b2c-28ff-4a35-a7a3-6dc1aafeb074 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:15.386954 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-90420b2c-28ff-4a35-a7a3-6dc1aafeb074 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:15.390017 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1096/2190] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:46:15 2022] DELETE /identity/v3/projects/7d259e69c91c4ca089d79b47406ffe59 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:46:15.396435 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54f2a2-0008-4b6c-96c0-29a60b8250c9 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:15.396808 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54f2a2-0008-4b6c-96c0-29a60b8250c9 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:15.396955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54f2a2-0008-4b6c-96c0-29a60b8250c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:15.423192 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-2a54f2a2-0008-4b6c-96c0-29a60b8250c9 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:15.424507 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2a54f2a2-0008-4b6c-96c0-29a60b8250c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:15.495762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:15.554627 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1095/2191] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:15.564266 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e39cc-945d-4247-a9d8-8390ac738ea8 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:15.565222 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e39cc-945d-4247-a9d8-8390ac738ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:15.565637 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e39cc-945d-4247-a9d8-8390ac738ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:15.597730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-712e39cc-945d-4247-a9d8-8390ac738ea8 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:15.600469 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-712e39cc-945d-4247-a9d8-8390ac738ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:15.618581 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1097/2192] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:15.628101 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54f2a2-0008-4b6c-96c0-29a60b8250c9 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:15.651726 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54f2a2-0008-4b6c-96c0-29a60b8250c9 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:15.664513 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070e88c-c0ed-4fbe-85c1-afbdb5c614d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:15.666333 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070e88c-c0ed-4fbe-85c1-afbdb5c614d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:15.666690 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070e88c-c0ed-4fbe-85c1-afbdb5c614d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:15.666914 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070e88c-c0ed-4fbe-85c1-afbdb5c614d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:15.668088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070e88c-c0ed-4fbe-85c1-afbdb5c614d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:46:15.668836 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070e88c-c0ed-4fbe-85c1-afbdb5c614d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:15.671264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070e88c-c0ed-4fbe-85c1-afbdb5c614d0 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:15.686761 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1096/2193] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:46:15.693951 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e39cc-945d-4247-a9d8-8390ac738ea8 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:15.710484 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e39cc-945d-4247-a9d8-8390ac738ea8 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:15.718625 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488fd19-0bf5-4c59-aeb9-9d27110e3b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:15.719395 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488fd19-0bf5-4c59-aeb9-9d27110e3b7b admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:15.719806 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488fd19-0bf5-4c59-aeb9-9d27110e3b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:15.720092 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488fd19-0bf5-4c59-aeb9-9d27110e3b7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:15.720850 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b488fd19-0bf5-4c59-aeb9-9d27110e3b7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:15.723524 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b488fd19-0bf5-4c59-aeb9-9d27110e3b7b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:15.770250 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1098/2194] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:46:15 2022] POST /identity/v3/projects => generated 371 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:46:15.772646 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070e88c-c0ed-4fbe-85c1-afbdb5c614d0 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:15.788855 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070e88c-c0ed-4fbe-85c1-afbdb5c614d0 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:15.898119 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf94da-8f99-4080-9f09-c35aea122568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:15.899190 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf94da-8f99-4080-9f09-c35aea122568 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:15.899664 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf94da-8f99-4080-9f09-c35aea122568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:15.900190 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf94da-8f99-4080-9f09-c35aea122568 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:15.901911 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf94da-8f99-4080-9f09-c35aea122568 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:15.905336 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf94da-8f99-4080-9f09-c35aea122568 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:15.950416 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1097/2195] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:46:15 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:46:15.955096 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488fd19-0bf5-4c59-aeb9-9d27110e3b7b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:15.967266 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488fd19-0bf5-4c59-aeb9-9d27110e3b7b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:15.973384 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46712a37-eebf-4597-96bd-451b8f8e785f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:15.974635 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46712a37-eebf-4597-96bd-451b8f8e785f admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:15.974635 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46712a37-eebf-4597-96bd-451b8f8e785f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:15.975047 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46712a37-eebf-4597-96bd-451b8f8e785f admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:15.975916 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46712a37-eebf-4597-96bd-451b8f8e785f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:15.977691 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46712a37-eebf-4597-96bd-451b8f8e785f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:15.991792 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1099/2196] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:46:15.994312 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf94da-8f99-4080-9f09-c35aea122568 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:16.005539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf94da-8f99-4080-9f09-c35aea122568 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:16.014660 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12d432-9da5-4844-b4ca-014b33cf55e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:16.014660 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12d432-9da5-4844-b4ca-014b33cf55e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:16.014660 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12d432-9da5-4844-b4ca-014b33cf55e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:16.014660 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12d432-9da5-4844-b4ca-014b33cf55e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:16.015307 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12d432-9da5-4844-b4ca-014b33cf55e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:16.015664 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12d432-9da5-4844-b4ca-014b33cf55e2 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:16.029677 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1098/2197] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:46:16.033925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46712a37-eebf-4597-96bd-451b8f8e785f admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:16.047400 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46712a37-eebf-4597-96bd-451b8f8e785f admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:16.059701 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff98de7-9608-49e4-9f6c-a10051e4b05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:16.060837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff98de7-9608-49e4-9f6c-a10051e4b05b admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:16.061883 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff98de7-9608-49e4-9f6c-a10051e4b05b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:16.062655 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff98de7-9608-49e4-9f6c-a10051e4b05b admin admin] PATH_INFO: `/v3/projects/26b383f7796b41a2b87d7a6d88c8fc28/users/8f2670af97d34c95be6fda61c5d88516/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:16.094932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff98de7-9608-49e4-9f6c-a10051e4b05b admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b383f7796b41a2b87d7a6d88c8fc28, user_id=8f2670af97d34c95be6fda61c5d88516, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:16.099599 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff98de7-9608-49e4-9f6c-a10051e4b05b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:16.120208 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1100/2198] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:46:16 2022] PUT /identity/v3/projects/26b383f7796b41a2b87d7a6d88c8fc28/users/8f2670af97d34c95be6fda61c5d88516/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:46:16.126955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295d8c5-6b71-45f5-a41b-1223ecf4f037 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:16.127279 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295d8c5-6b71-45f5-a41b-1223ecf4f037 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:16.128237 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295d8c5-6b71-45f5-a41b-1223ecf4f037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:16.149905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-5295d8c5-6b71-45f5-a41b-1223ecf4f037 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:16.156216 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5295d8c5-6b71-45f5-a41b-1223ecf4f037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:16.183716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff98de7-9608-49e4-9f6c-a10051e4b05b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:16.186128 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0ff98de7-9608-49e4-9f6c-a10051e4b05b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:16.299793 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1099/2199] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:16.312044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295d8c5-6b71-45f5-a41b-1223ecf4f037 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:16.313884 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5295d8c5-6b71-45f5-a41b-1223ecf4f037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:16.328377 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff98de7-9608-49e4-9f6c-a10051e4b05b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:16.335421 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f49356-8c2f-45e7-b3b6-6ab2baa275b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:16.336153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f49356-8c2f-45e7-b3b6-6ab2baa275b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:16.336432 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f49356-8c2f-45e7-b3b6-6ab2baa275b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:16.336706 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f49356-8c2f-45e7-b3b6-6ab2baa275b7 admin admin] PATH_INFO: `/v3/projects/5713ff23f8a14bd1b1c7d5deb6adbf0d` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:16.338433 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f49356-8c2f-45e7-b3b6-6ab2baa275b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5713ff23f8a14bd1b1c7d5deb6adbf0d)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:16.340897 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f49356-8c2f-45e7-b3b6-6ab2baa275b7 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:16.354734 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:16.397111 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:16.406058 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295d8c5-6b71-45f5-a41b-1223ecf4f037 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:16.432242 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-73f49356-8c2f-45e7-b3b6-6ab2baa275b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5713ff23f8a14bd1b1c7d5deb6adbf0d', 'request_id': 'req-73f49356-8c2f-45e7-b3b6-6ab2baa275b7'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:16.443072 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-73f49356-8c2f-45e7-b3b6-6ab2baa275b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5713ff23f8a14bd1b1c7d5deb6adbf0d', 'request_id': 'req-73f49356-8c2f-45e7-b3b6-6ab2baa275b7'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:16.455162 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-73f49356-8c2f-45e7-b3b6-6ab2baa275b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5713ff23f8a14bd1b1c7d5deb6adbf0d', 'request_id': 'req-73f49356-8c2f-45e7-b3b6-6ab2baa275b7'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:16.481068 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-73f49356-8c2f-45e7-b3b6-6ab2baa275b7 admin admin] The token cache is being invalidate because project 5713ff23f8a14bd1b1c7d5deb6adbf0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:46:16.481443 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07614fa6-8f5c-49c0-9be9-1d4715620900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:16.481667 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-73f49356-8c2f-45e7-b3b6-6ab2baa275b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:16.482357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07614fa6-8f5c-49c0-9be9-1d4715620900 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:16.482778 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07614fa6-8f5c-49c0-9be9-1d4715620900 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:16.482890 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-73f49356-8c2f-45e7-b3b6-6ab2baa275b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:16.483247 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07614fa6-8f5c-49c0-9be9-1d4715620900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:16.486106 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-07614fa6-8f5c-49c0-9be9-1d4715620900 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:16.487365 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1101/2200] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:46:16 2022] DELETE /identity/v3/projects/5713ff23f8a14bd1b1c7d5deb6adbf0d => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:16.494168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f49356-8c2f-45e7-b3b6-6ab2baa275b7 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:16.496563 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-73f49356-8c2f-45e7-b3b6-6ab2baa275b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:16.596928 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07614fa6-8f5c-49c0-9be9-1d4715620900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:16.600239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07614fa6-8f5c-49c0-9be9-1d4715620900 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:16.602239 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f49356-8c2f-45e7-b3b6-6ab2baa275b7 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:16.609503 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276465d5-05ee-4447-bc5c-254793766099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:16.610230 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276465d5-05ee-4447-bc5c-254793766099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:16.610534 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276465d5-05ee-4447-bc5c-254793766099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:16.610862 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276465d5-05ee-4447-bc5c-254793766099 admin admin] PATH_INFO: `/v3/users/8b44a5762c4f48c6a4bd3b4abe540153` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:16.612210 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276465d5-05ee-4447-bc5c-254793766099 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b44a5762c4f48c6a4bd3b4abe540153)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:16.614850 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276465d5-05ee-4447-bc5c-254793766099 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:16.630751 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1100/2201] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:46:16.686000 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-276465d5-05ee-4447-bc5c-254793766099 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b44a5762c4f48c6a4bd3b4abe540153'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:16.712477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-276465d5-05ee-4447-bc5c-254793766099 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b44a5762c4f48c6a4bd3b4abe540153'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:16.713130 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-276465d5-05ee-4447-bc5c-254793766099 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b44a5762c4f48c6a4bd3b4abe540153'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:16.743128 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-276465d5-05ee-4447-bc5c-254793766099 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b44a5762c4f48c6a4bd3b4abe540153'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:16.756203 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-276465d5-05ee-4447-bc5c-254793766099 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b44a5762c4f48c6a4bd3b4abe540153'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:16.769773 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1102/2202] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:46:16 2022] DELETE /identity/v3/users/8b44a5762c4f48c6a4bd3b4abe540153 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:46:17.356226 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07614fa6-8f5c-49c0-9be9-1d4715620900 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:17.391604 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07614fa6-8f5c-49c0-9be9-1d4715620900 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:17.478764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9a501-e57a-4af6-9e96-d5fea9fb656c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:17.479530 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9a501-e57a-4af6-9e96-d5fea9fb656c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:17.480048 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9a501-e57a-4af6-9e96-d5fea9fb656c admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:17.480448 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9a501-e57a-4af6-9e96-d5fea9fb656c admin admin] PATH_INFO: `/v3/projects/ffadfa53c8634769813ae136ccede1a4` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:17.481867 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9a501-e57a-4af6-9e96-d5fea9fb656c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffadfa53c8634769813ae136ccede1a4)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:17.484215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9a501-e57a-4af6-9e96-d5fea9fb656c admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:17.551909 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-66d9a501-e57a-4af6-9e96-d5fea9fb656c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffadfa53c8634769813ae136ccede1a4', 'request_id': 'req-66d9a501-e57a-4af6-9e96-d5fea9fb656c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:17.565547 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:17.572879 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-66d9a501-e57a-4af6-9e96-d5fea9fb656c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffadfa53c8634769813ae136ccede1a4', 'request_id': 'req-66d9a501-e57a-4af6-9e96-d5fea9fb656c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:17.591212 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-66d9a501-e57a-4af6-9e96-d5fea9fb656c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffadfa53c8634769813ae136ccede1a4', 'request_id': 'req-66d9a501-e57a-4af6-9e96-d5fea9fb656c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:17.639525 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-66d9a501-e57a-4af6-9e96-d5fea9fb656c admin admin] The token cache is being invalidate because project ffadfa53c8634769813ae136ccede1a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:46:17.640071 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-66d9a501-e57a-4af6-9e96-d5fea9fb656c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:17.649903 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-66d9a501-e57a-4af6-9e96-d5fea9fb656c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:17.652905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1101/2203] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:46:17 2022] DELETE /identity/v3/projects/ffadfa53c8634769813ae136ccede1a4 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:17.678409 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b759569-413c-4ae2-b88a-aae82616b83a None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:17.679306 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b759569-413c-4ae2-b88a-aae82616b83a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:17.679306 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b759569-413c-4ae2-b88a-aae82616b83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:17.737573 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-6b759569-413c-4ae2-b88a-aae82616b83a None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:17.740312 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6b759569-413c-4ae2-b88a-aae82616b83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:17.767788 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:17.862760 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1103/2204] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:17.874585 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d64ac5-f2d5-4c89-9ee3-588f7e2bf13f None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:17.874924 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d64ac5-f2d5-4c89-9ee3-588f7e2bf13f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:17.875443 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d64ac5-f2d5-4c89-9ee3-588f7e2bf13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:17.899882 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-32d64ac5-f2d5-4c89-9ee3-588f7e2bf13f None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:17.901958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-32d64ac5-f2d5-4c89-9ee3-588f7e2bf13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:17.912509 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1102/2205] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:46:17.917117 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b759569-413c-4ae2-b88a-aae82616b83a None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:17.930242 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b759569-413c-4ae2-b88a-aae82616b83a None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:17.936811 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ad398-b9bd-4fbc-a5d4-8069aa6c0ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:17.937682 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ad398-b9bd-4fbc-a5d4-8069aa6c0ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:17.949198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ad398-b9bd-4fbc-a5d4-8069aa6c0ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:17.949664 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ad398-b9bd-4fbc-a5d4-8069aa6c0ac3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:17.950540 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ad398-b9bd-4fbc-a5d4-8069aa6c0ac3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:46:17.951540 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ad398-b9bd-4fbc-a5d4-8069aa6c0ac3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:17.953428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ad398-b9bd-4fbc-a5d4-8069aa6c0ac3 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:17.971290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1104/2206] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:46:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:46:17.977181 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d64ac5-f2d5-4c89-9ee3-588f7e2bf13f None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:17.989239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d64ac5-f2d5-4c89-9ee3-588f7e2bf13f None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:17.995549 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a3f7ae-f2c4-4475-b3a2-407527c4df00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:17.996252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3f7ae-f2c4-4475-b3a2-407527c4df00 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:17.996527 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3f7ae-f2c4-4475-b3a2-407527c4df00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:17.996798 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a3f7ae-f2c4-4475-b3a2-407527c4df00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:17.997493 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3f7ae-f2c4-4475-b3a2-407527c4df00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:17.999461 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a3f7ae-f2c4-4475-b3a2-407527c4df00 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:18.058498 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ad398-b9bd-4fbc-a5d4-8069aa6c0ac3 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:18.058848 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1103/2207] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:46:17 2022] POST /identity/v3/projects => generated 381 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:46:18.076357 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ad398-b9bd-4fbc-a5d4-8069aa6c0ac3 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:18.166320 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d65cd6-07c7-4718-b8f4-3806e5549f8e None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:18.166776 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d65cd6-07c7-4718-b8f4-3806e5549f8e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:18.167218 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d65cd6-07c7-4718-b8f4-3806e5549f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:18.238300 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-e6d65cd6-07c7-4718-b8f4-3806e5549f8e None None] MFA Rules not processed for user `8f2670af97d34c95be6fda61c5d88516`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:18.238562 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e6d65cd6-07c7-4718-b8f4-3806e5549f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:18.270085 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b304e81-91ff-4a7f-845c-b0dcfa8908b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:18.270886 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b304e81-91ff-4a7f-845c-b0dcfa8908b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:18.273654 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b304e81-91ff-4a7f-845c-b0dcfa8908b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:18.273939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b304e81-91ff-4a7f-845c-b0dcfa8908b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:18.274651 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b304e81-91ff-4a7f-845c-b0dcfa8908b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:18.284250 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b304e81-91ff-4a7f-845c-b0dcfa8908b8 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:18.339578 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1105/2208] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:46:18 2022] POST /identity/v3/users => generated 291 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:46:18.355628 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b304e81-91ff-4a7f-845c-b0dcfa8908b8 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:18.395664 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b304e81-91ff-4a7f-845c-b0dcfa8908b8 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:18.435503 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1104/2209] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:18.437739 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9701313-07ca-427a-8452-acba3d5de0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:18.439138 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9701313-07ca-427a-8452-acba3d5de0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:18.439615 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9701313-07ca-427a-8452-acba3d5de0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:18.440036 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d65cd6-07c7-4718-b8f4-3806e5549f8e None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:18.440174 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9701313-07ca-427a-8452-acba3d5de0b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:18.441241 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9701313-07ca-427a-8452-acba3d5de0b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:18.441668 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e6d65cd6-07c7-4718-b8f4-3806e5549f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:18.444398 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9701313-07ca-427a-8452-acba3d5de0b5 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:18.460536 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d65cd6-07c7-4718-b8f4-3806e5549f8e None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:18.466505 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95b059-ae54-4739-8d82-c081e122fba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:18.467847 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95b059-ae54-4739-8d82-c081e122fba2 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:18.467847 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95b059-ae54-4739-8d82-c081e122fba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:18.467847 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a95b059-ae54-4739-8d82-c081e122fba2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:18.468369 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95b059-ae54-4739-8d82-c081e122fba2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:18.470565 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a95b059-ae54-4739-8d82-c081e122fba2 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:18.470731 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1106/2210] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:46:18.479003 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9701313-07ca-427a-8452-acba3d5de0b5 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:18.535044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1105/2211] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:46:18 2022] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:46:18.541856 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95b059-ae54-4739-8d82-c081e122fba2 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:18.543119 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9701313-07ca-427a-8452-acba3d5de0b5 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:18.689639 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a95b059-ae54-4739-8d82-c081e122fba2 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:18.699962 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f735fa-8c2a-4ff3-b9a9-e663f18a1309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:18.701169 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f735fa-8c2a-4ff3-b9a9-e663f18a1309 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:18.701598 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f735fa-8c2a-4ff3-b9a9-e663f18a1309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:18.702030 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f735fa-8c2a-4ff3-b9a9-e663f18a1309 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:18.702842 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f735fa-8c2a-4ff3-b9a9-e663f18a1309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:18.705007 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f735fa-8c2a-4ff3-b9a9-e663f18a1309 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:18.717133 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3d05b-237b-483a-80ce-d540568b2084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:18.717806 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3d05b-237b-483a-80ce-d540568b2084 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:18.718096 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3d05b-237b-483a-80ce-d540568b2084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:18.718364 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3d05b-237b-483a-80ce-d540568b2084 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:18.719073 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3d05b-237b-483a-80ce-d540568b2084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:18.720871 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3d05b-237b-483a-80ce-d540568b2084 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:18.732903 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1107/2212] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:46:18.744344 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3d05b-237b-483a-80ce-d540568b2084 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:18.759843 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3d05b-237b-483a-80ce-d540568b2084 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:18.760678 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1106/2213] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:46:18 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:46:18.765846 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1f83b-d215-41b1-bc7c-e58fb4da9bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:18.766704 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1f83b-d215-41b1-bc7c-e58fb4da9bb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:18.766987 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1f83b-d215-41b1-bc7c-e58fb4da9bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:18.767260 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1f83b-d215-41b1-bc7c-e58fb4da9bb7 admin admin] PATH_INFO: `/v3/projects/9c93e5d7315e4584ae255a077344aed4/users/dc2793931d34415ea0736ec64e68ac13/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:18.767568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f735fa-8c2a-4ff3-b9a9-e663f18a1309 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:18.784293 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f735fa-8c2a-4ff3-b9a9-e663f18a1309 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:18.790141 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd083ae7-14d2-4686-850e-268064caf120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:18.790674 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1f83b-d215-41b1-bc7c-e58fb4da9bb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c93e5d7315e4584ae255a077344aed4, user_id=dc2793931d34415ea0736ec64e68ac13, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:18.790974 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd083ae7-14d2-4686-850e-268064caf120 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:18.791409 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd083ae7-14d2-4686-850e-268064caf120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:18.791683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd083ae7-14d2-4686-850e-268064caf120 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:18.794799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1f83b-d215-41b1-bc7c-e58fb4da9bb7 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:18.796628 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd083ae7-14d2-4686-850e-268064caf120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:18.799998 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:18.800687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd083ae7-14d2-4686-850e-268064caf120 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:18.808053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:18.819176 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1108/2214] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:46:18 2022] PUT /identity/v3/projects/9c93e5d7315e4584ae255a077344aed4/users/dc2793931d34415ea0736ec64e68ac13/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:18.821307 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1107/2215] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:46:18.837991 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1f83b-d215-41b1-bc7c-e58fb4da9bb7 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:18.838898 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f002be-ffa2-4506-a971-dbab322e3336 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:18.839200 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f002be-ffa2-4506-a971-dbab322e3336 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:18.840125 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f002be-ffa2-4506-a971-dbab322e3336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:18.888939 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-37f002be-ffa2-4506-a971-dbab322e3336 None None] MFA Rules not processed for user `dc2793931d34415ea0736ec64e68ac13`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:18.890936 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-37f002be-ffa2-4506-a971-dbab322e3336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:18.965731 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1f83b-d215-41b1-bc7c-e58fb4da9bb7 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:18.974660 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95678ad-9fe8-4d34-be51-b4626f10f32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:18.975761 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95678ad-9fe8-4d34-be51-b4626f10f32e admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:18.976225 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95678ad-9fe8-4d34-be51-b4626f10f32e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:18.976664 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95678ad-9fe8-4d34-be51-b4626f10f32e admin admin] PATH_INFO: `/v3/projects/4fed9f59d1b8408ca185f8a2f683994d/users/d3464b09124348b1a1e315d23fd7ec63/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:19.003359 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95678ad-9fe8-4d34-be51-b4626f10f32e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fed9f59d1b8408ca185f8a2f683994d, user_id=d3464b09124348b1a1e315d23fd7ec63, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:19.006251 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95678ad-9fe8-4d34-be51-b4626f10f32e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:19.015097 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1108/2216] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:19.025629 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1109/2217] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:46:18 2022] PUT /identity/v3/projects/4fed9f59d1b8408ca185f8a2f683994d/users/d3464b09124348b1a1e315d23fd7ec63/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:19.027230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f002be-ffa2-4506-a971-dbab322e3336 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:19.029944 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95678ad-9fe8-4d34-be51-b4626f10f32e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:19.052813 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f002be-ffa2-4506-a971-dbab322e3336 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:19.124858 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95678ad-9fe8-4d34-be51-b4626f10f32e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:19.138219 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbf519-938f-475b-8fcf-eebb9f19c414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:19.138855 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbf519-938f-475b-8fcf-eebb9f19c414 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:19.139171 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbf519-938f-475b-8fcf-eebb9f19c414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:19.139407 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbf519-938f-475b-8fcf-eebb9f19c414 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:19.140056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbf519-938f-475b-8fcf-eebb9f19c414 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:19.140207 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f878d61-a44b-47ec-85b0-45d3c2f65ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:19.140748 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f878d61-a44b-47ec-85b0-45d3c2f65ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:19.141026 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f878d61-a44b-47ec-85b0-45d3c2f65ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:19.141296 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f878d61-a44b-47ec-85b0-45d3c2f65ea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:19.141947 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f878d61-a44b-47ec-85b0-45d3c2f65ea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:19.142128 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdbf519-938f-475b-8fcf-eebb9f19c414 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:19.146120 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f878d61-a44b-47ec-85b0-45d3c2f65ea2 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:19.170930 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1110/2218] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:46:19.176290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f878d61-a44b-47ec-85b0-45d3c2f65ea2 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:19.186108 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1109/2219] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:46:19 2022] POST /identity/v3/projects => generated 383 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:46:19.192036 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f878d61-a44b-47ec-85b0-45d3c2f65ea2 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:19.193078 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbf519-938f-475b-8fcf-eebb9f19c414 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:19.262804 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef726d88-cb17-4db6-934c-3f83ef9b8a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:19.263560 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef726d88-cb17-4db6-934c-3f83ef9b8a30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:19.263925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef726d88-cb17-4db6-934c-3f83ef9b8a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:19.264247 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef726d88-cb17-4db6-934c-3f83ef9b8a30 admin admin] PATH_INFO: `/v3/projects/4fed9f59d1b8408ca185f8a2f683994d/users/d3464b09124348b1a1e315d23fd7ec63/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:19.266794 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef726d88-cb17-4db6-934c-3f83ef9b8a30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fed9f59d1b8408ca185f8a2f683994d, user_id=d3464b09124348b1a1e315d23fd7ec63, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:19.271013 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef726d88-cb17-4db6-934c-3f83ef9b8a30 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:19.279500 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbf519-938f-475b-8fcf-eebb9f19c414 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:19.286940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1111/2220] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:46:19 2022] PUT /identity/v3/projects/4fed9f59d1b8408ca185f8a2f683994d/users/d3464b09124348b1a1e315d23fd7ec63/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:46:19.307173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:19.355151 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11446218-0a6d-4ecd-bceb-586c36262e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:19.355838 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11446218-0a6d-4ecd-bceb-586c36262e10 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:19.356328 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11446218-0a6d-4ecd-bceb-586c36262e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:19.356509 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11446218-0a6d-4ecd-bceb-586c36262e10 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:19.357289 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11446218-0a6d-4ecd-bceb-586c36262e10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:19.359857 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11446218-0a6d-4ecd-bceb-586c36262e10 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:19.383956 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1110/2221] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:46:19 2022] POST /identity/v3/users => generated 298 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:46:19.389569 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef726d88-cb17-4db6-934c-3f83ef9b8a30 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:19.409828 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef726d88-cb17-4db6-934c-3f83ef9b8a30 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:19.424324 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd806553-e8a2-4573-84c6-c8c775366c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:19.425154 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd806553-e8a2-4573-84c6-c8c775366c37 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:19.425567 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd806553-e8a2-4573-84c6-c8c775366c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:19.425976 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd806553-e8a2-4573-84c6-c8c775366c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:19.427109 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd806553-e8a2-4573-84c6-c8c775366c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:19.429159 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd806553-e8a2-4573-84c6-c8c775366c37 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:19.432182 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:19.441663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1112/2222] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:46:19.445542 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11446218-0a6d-4ecd-bceb-586c36262e10 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:19.457405 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11446218-0a6d-4ecd-bceb-586c36262e10 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:19.475808 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857ef2f-15be-4672-8d91-279924771da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:19.477098 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857ef2f-15be-4672-8d91-279924771da7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:19.477677 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857ef2f-15be-4672-8d91-279924771da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:19.478243 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857ef2f-15be-4672-8d91-279924771da7 admin admin] PATH_INFO: `/v3/projects/df2d1bbd5aa14ad089def8028d6c90ab/users/d1ee2323422f4f34a0b4d25ae455eddd/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:19.509865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857ef2f-15be-4672-8d91-279924771da7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df2d1bbd5aa14ad089def8028d6c90ab, user_id=d1ee2323422f4f34a0b4d25ae455eddd, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:19.514105 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857ef2f-15be-4672-8d91-279924771da7 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:19.534003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1111/2223] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:46:19 2022] PUT /identity/v3/projects/df2d1bbd5aa14ad089def8028d6c90ab/users/d1ee2323422f4f34a0b4d25ae455eddd/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:19.540091 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd806553-e8a2-4573-84c6-c8c775366c37 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:19.552061 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd806553-e8a2-4573-84c6-c8c775366c37 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:19.625292 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37f997-fa99-4d6b-b154-d6a0fbdbab69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:19.625926 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37f997-fa99-4d6b-b154-d6a0fbdbab69 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:19.626321 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37f997-fa99-4d6b-b154-d6a0fbdbab69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:19.626514 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37f997-fa99-4d6b-b154-d6a0fbdbab69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:19.627299 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37f997-fa99-4d6b-b154-d6a0fbdbab69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:19.629163 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37f997-fa99-4d6b-b154-d6a0fbdbab69 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:19.644187 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1113/2224] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:46:19.648325 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857ef2f-15be-4672-8d91-279924771da7 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:19.663060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857ef2f-15be-4672-8d91-279924771da7 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:19.669921 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793921c4-aa67-4f65-8d57-7aac9894d58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:19.671229 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793921c4-aa67-4f65-8d57-7aac9894d58c admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:19.672162 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793921c4-aa67-4f65-8d57-7aac9894d58c admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:19.672566 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793921c4-aa67-4f65-8d57-7aac9894d58c admin admin] PATH_INFO: `/v3/projects/df2d1bbd5aa14ad089def8028d6c90ab/users/d1ee2323422f4f34a0b4d25ae455eddd/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:19.675574 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793921c4-aa67-4f65-8d57-7aac9894d58c admin admin] RBAC: Authorizing `identity:create_grant(project_id=df2d1bbd5aa14ad089def8028d6c90ab, user_id=d1ee2323422f4f34a0b4d25ae455eddd, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:19.681143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793921c4-aa67-4f65-8d57-7aac9894d58c admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:19.697413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1112/2225] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:46:19 2022] PUT /identity/v3/projects/df2d1bbd5aa14ad089def8028d6c90ab/users/d1ee2323422f4f34a0b4d25ae455eddd/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:19.708657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cbb2a-ba20-48b1-8f2a-9e17e44159a8 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:19.709183 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cbb2a-ba20-48b1-8f2a-9e17e44159a8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:19.709462 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28cbb2a-ba20-48b1-8f2a-9e17e44159a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:19.769642 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c28cbb2a-ba20-48b1-8f2a-9e17e44159a8 None None] MFA Rules not processed for user `d1ee2323422f4f34a0b4d25ae455eddd`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:19.773993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c28cbb2a-ba20-48b1-8f2a-9e17e44159a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:19.903549 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1114/2226] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:19.919684 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793921c4-aa67-4f65-8d57-7aac9894d58c admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:19.924681 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-793921c4-aa67-4f65-8d57-7aac9894d58c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:20.000527 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793921c4-aa67-4f65-8d57-7aac9894d58c admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:20.007965 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b42c5-52de-48f5-aff5-a4abb433945a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:20.007965 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b42c5-52de-48f5-aff5-a4abb433945a service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:20.007965 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b42c5-52de-48f5-aff5-a4abb433945a service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:20.007965 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b42c5-52de-48f5-aff5-a4abb433945a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:20.017610 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b42c5-52de-48f5-aff5-a4abb433945a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:20.019132 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b42c5-52de-48f5-aff5-a4abb433945a service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:20.031491 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1113/2227] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:19 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:46:20.153311 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845ee2e-b7ed-49b3-ae0d-e0b79d7038fe None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:20.153583 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b42c5-52de-48f5-aff5-a4abb433945a service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:20.153723 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845ee2e-b7ed-49b3-ae0d-e0b79d7038fe None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:20.153830 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845ee2e-b7ed-49b3-ae0d-e0b79d7038fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:20.156093 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-470b42c5-52de-48f5-aff5-a4abb433945a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:20.188435 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b42c5-52de-48f5-aff5-a4abb433945a service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:20.192810 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-4845ee2e-b7ed-49b3-ae0d-e0b79d7038fe None None] MFA Rules not processed for user `d3464b09124348b1a1e315d23fd7ec63`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:20.194271 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4845ee2e-b7ed-49b3-ae0d-e0b79d7038fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:20.200936 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff61fa-989c-499e-bbe4-f84840141659 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:20.201951 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff61fa-989c-499e-bbe4-f84840141659 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:20.202227 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff61fa-989c-499e-bbe4-f84840141659 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:20.202617 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff61fa-989c-499e-bbe4-f84840141659 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:20.295439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff61fa-989c-499e-bbe4-f84840141659 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:20.297628 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff61fa-989c-499e-bbe4-f84840141659 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:20.325397 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1114/2228] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:46:20.358675 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1115/2229] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:20.374094 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca386b79-b459-4ee9-b378-fb9f7731a3c3 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:20.374767 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca386b79-b459-4ee9-b378-fb9f7731a3c3 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:20.375988 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca386b79-b459-4ee9-b378-fb9f7731a3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:20.423023 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-ca386b79-b459-4ee9-b378-fb9f7731a3c3 None None] MFA Rules not processed for user `8f2670af97d34c95be6fda61c5d88516`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:20.425226 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ca386b79-b459-4ee9-b378-fb9f7731a3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:20.445197 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:20.555032 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1115/2230] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:20.577586 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845ee2e-b7ed-49b3-ae0d-e0b79d7038fe None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:20.577940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4845ee2e-b7ed-49b3-ae0d-e0b79d7038fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:20.587573 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:20.710114 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845ee2e-b7ed-49b3-ae0d-e0b79d7038fe None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:20.723196 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c8a95-d413-4241-bfdc-b7072574606c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:20.725158 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c8a95-d413-4241-bfdc-b7072574606c service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:20.726079 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c8a95-d413-4241-bfdc-b7072574606c service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:20.726956 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c8a95-d413-4241-bfdc-b7072574606c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:20.741690 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c8a95-d413-4241-bfdc-b7072574606c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:20.743711 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c8a95-d413-4241-bfdc-b7072574606c service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:20.757065 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1116/2231] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:46:20.789440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca386b79-b459-4ee9-b378-fb9f7731a3c3 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:20.896866 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca386b79-b459-4ee9-b378-fb9f7731a3c3 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:20.904805 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c949da-02a8-4027-9b36-9e86fa9a9b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:20.905916 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c949da-02a8-4027-9b36-9e86fa9a9b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:20.906395 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c949da-02a8-4027-9b36-9e86fa9a9b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:20.906887 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c949da-02a8-4027-9b36-9e86fa9a9b63 admin admin] PATH_INFO: `/v3/users/dc2793931d34415ea0736ec64e68ac13` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:20.909196 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c949da-02a8-4027-9b36-9e86fa9a9b63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc2793931d34415ea0736ec64e68ac13)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:20.913059 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c949da-02a8-4027-9b36-9e86fa9a9b63 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:20.996568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a1c949da-02a8-4027-9b36-9e86fa9a9b63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc2793931d34415ea0736ec64e68ac13'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:21.007987 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a1c949da-02a8-4027-9b36-9e86fa9a9b63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc2793931d34415ea0736ec64e68ac13'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:21.032771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a1c949da-02a8-4027-9b36-9e86fa9a9b63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc2793931d34415ea0736ec64e68ac13'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:21.034216 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a1c949da-02a8-4027-9b36-9e86fa9a9b63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc2793931d34415ea0736ec64e68ac13'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:21.049755 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a1c949da-02a8-4027-9b36-9e86fa9a9b63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc2793931d34415ea0736ec64e68ac13'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:21.061935 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1116/2232] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:46:20 2022] DELETE /identity/v3/users/dc2793931d34415ea0736ec64e68ac13 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:21.068423 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9a6c8-bc36-4411-90f6-1b24570dd23f None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:21.069892 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9a6c8-bc36-4411-90f6-1b24570dd23f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:21.070737 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9a6c8-bc36-4411-90f6-1b24570dd23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:21.098320 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-55b9a6c8-bc36-4411-90f6-1b24570dd23f None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:21.100837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-55b9a6c8-bc36-4411-90f6-1b24570dd23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:21.248180 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1117/2233] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:46:21.271305 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c949da-02a8-4027-9b36-9e86fa9a9b63 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:21.273101 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a1c949da-02a8-4027-9b36-9e86fa9a9b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:21.362650 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:21.390709 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c949da-02a8-4027-9b36-9e86fa9a9b63 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:21.395235 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c7865-2b20-4590-9b6e-3cc6cd8df05f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:21.396100 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c7865-2b20-4590-9b6e-3cc6cd8df05f service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:21.396579 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c7865-2b20-4590-9b6e-3cc6cd8df05f service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:21.396860 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c7865-2b20-4590-9b6e-3cc6cd8df05f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:21.413079 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c7865-2b20-4590-9b6e-3cc6cd8df05f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:21.414548 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c7865-2b20-4590-9b6e-3cc6cd8df05f service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:21.427329 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1117/2234] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:46:21.992600 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9a6c8-bc36-4411-90f6-1b24570dd23f None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:21.997445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-55b9a6c8-bc36-4411-90f6-1b24570dd23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:22.023357 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9a6c8-bc36-4411-90f6-1b24570dd23f None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:22.031598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337eaf6a-4a6f-42a3-978f-2ffd568497b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:22.033329 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337eaf6a-4a6f-42a3-978f-2ffd568497b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:22.033529 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337eaf6a-4a6f-42a3-978f-2ffd568497b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:22.034030 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337eaf6a-4a6f-42a3-978f-2ffd568497b9 admin admin] PATH_INFO: `/v3/projects/9c93e5d7315e4584ae255a077344aed4` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:22.036356 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337eaf6a-4a6f-42a3-978f-2ffd568497b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c93e5d7315e4584ae255a077344aed4)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:22.040519 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337eaf6a-4a6f-42a3-978f-2ffd568497b9 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:22.150022 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-337eaf6a-4a6f-42a3-978f-2ffd568497b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c93e5d7315e4584ae255a077344aed4', 'request_id': 'req-337eaf6a-4a6f-42a3-978f-2ffd568497b9'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:22.168639 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-337eaf6a-4a6f-42a3-978f-2ffd568497b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c93e5d7315e4584ae255a077344aed4', 'request_id': 'req-337eaf6a-4a6f-42a3-978f-2ffd568497b9'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:22.180679 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-337eaf6a-4a6f-42a3-978f-2ffd568497b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c93e5d7315e4584ae255a077344aed4', 'request_id': 'req-337eaf6a-4a6f-42a3-978f-2ffd568497b9'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:22.203597 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-337eaf6a-4a6f-42a3-978f-2ffd568497b9 admin admin] The token cache is being invalidate because project 9c93e5d7315e4584ae255a077344aed4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:46:22.204084 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-337eaf6a-4a6f-42a3-978f-2ffd568497b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:22.205059 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-337eaf6a-4a6f-42a3-978f-2ffd568497b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:22.207787 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1118/2235] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:46:21 2022] DELETE /identity/v3/projects/9c93e5d7315e4584ae255a077344aed4 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:22.212034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c7865-2b20-4590-9b6e-3cc6cd8df05f service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:22.222404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c7865-2b20-4590-9b6e-3cc6cd8df05f service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:22.347101 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defeda93-5273-451a-8529-9cd45d5ffe67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:22.348105 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defeda93-5273-451a-8529-9cd45d5ffe67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:22.348364 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defeda93-5273-451a-8529-9cd45d5ffe67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:22.348713 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defeda93-5273-451a-8529-9cd45d5ffe67 admin admin] PATH_INFO: `/v3/users/d1ee2323422f4f34a0b4d25ae455eddd` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:22.350165 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defeda93-5273-451a-8529-9cd45d5ffe67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1ee2323422f4f34a0b4d25ae455eddd)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:22.353196 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defeda93-5273-451a-8529-9cd45d5ffe67 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:22.477521 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-defeda93-5273-451a-8529-9cd45d5ffe67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1ee2323422f4f34a0b4d25ae455eddd'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:22.491824 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-defeda93-5273-451a-8529-9cd45d5ffe67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1ee2323422f4f34a0b4d25ae455eddd'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:22.510239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-defeda93-5273-451a-8529-9cd45d5ffe67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1ee2323422f4f34a0b4d25ae455eddd'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:22.511310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-defeda93-5273-451a-8529-9cd45d5ffe67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1ee2323422f4f34a0b4d25ae455eddd'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:22.520736 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-defeda93-5273-451a-8529-9cd45d5ffe67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1ee2323422f4f34a0b4d25ae455eddd'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:22.528176 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1118/2236] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:46:22 2022] DELETE /identity/v3/users/d1ee2323422f4f34a0b4d25ae455eddd => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:22.894213 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337eaf6a-4a6f-42a3-978f-2ffd568497b9 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:22.895925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-337eaf6a-4a6f-42a3-978f-2ffd568497b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:22.911676 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337eaf6a-4a6f-42a3-978f-2ffd568497b9 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:22.924395 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:22.994982 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d714a7-17d1-413a-87d7-1ec1905cfade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:22.996175 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d714a7-17d1-413a-87d7-1ec1905cfade admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:22.996638 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d714a7-17d1-413a-87d7-1ec1905cfade admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:22.997910 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d714a7-17d1-413a-87d7-1ec1905cfade admin admin] PATH_INFO: `/v3/projects/df2d1bbd5aa14ad089def8028d6c90ab` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:22.999485 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d714a7-17d1-413a-87d7-1ec1905cfade admin admin] RBAC: Authorizing `identity:delete_project(project_id=df2d1bbd5aa14ad089def8028d6c90ab)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:23.001762 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d714a7-17d1-413a-87d7-1ec1905cfade admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:23.083634 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-62d714a7-17d1-413a-87d7-1ec1905cfade admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df2d1bbd5aa14ad089def8028d6c90ab', 'request_id': 'req-62d714a7-17d1-413a-87d7-1ec1905cfade'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:23.091639 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-62d714a7-17d1-413a-87d7-1ec1905cfade admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df2d1bbd5aa14ad089def8028d6c90ab', 'request_id': 'req-62d714a7-17d1-413a-87d7-1ec1905cfade'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:23.103786 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-62d714a7-17d1-413a-87d7-1ec1905cfade admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df2d1bbd5aa14ad089def8028d6c90ab', 'request_id': 'req-62d714a7-17d1-413a-87d7-1ec1905cfade'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:23.125454 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-62d714a7-17d1-413a-87d7-1ec1905cfade admin admin] The token cache is being invalidate because project df2d1bbd5aa14ad089def8028d6c90ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:46:23.125775 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-62d714a7-17d1-413a-87d7-1ec1905cfade admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:23.126451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-62d714a7-17d1-413a-87d7-1ec1905cfade admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:23.128593 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1119/2237] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:46:22 2022] DELETE /identity/v3/projects/df2d1bbd5aa14ad089def8028d6c90ab => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:23.133396 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb8c7d-d484-49fd-a6a3-4fafd9fadd0a None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:23.133679 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb8c7d-d484-49fd-a6a3-4fafd9fadd0a None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:23.133951 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb8c7d-d484-49fd-a6a3-4fafd9fadd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:23.158496 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-80cb8c7d-d484-49fd-a6a3-4fafd9fadd0a None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:23.159622 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-80cb8c7d-d484-49fd-a6a3-4fafd9fadd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:23.258921 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1119/2238] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:46:23.263938 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f8a85-22e0-4e58-94c7-b46ea74f0d10 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:23.264452 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f8a85-22e0-4e58-94c7-b46ea74f0d10 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:23.264614 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f8a85-22e0-4e58-94c7-b46ea74f0d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:23.301751 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-673f8a85-22e0-4e58-94c7-b46ea74f0d10 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:23.303247 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-673f8a85-22e0-4e58-94c7-b46ea74f0d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:23.319698 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1120/2239] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:23.323999 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb8c7d-d484-49fd-a6a3-4fafd9fadd0a None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:23.331641 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:23.338962 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb8c7d-d484-49fd-a6a3-4fafd9fadd0a None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:23.349015 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d004070-ca7b-4f74-922a-e5abe4a38781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:23.349785 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d004070-ca7b-4f74-922a-e5abe4a38781 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:23.350096 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d004070-ca7b-4f74-922a-e5abe4a38781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:23.351123 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d004070-ca7b-4f74-922a-e5abe4a38781 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:23.352484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d004070-ca7b-4f74-922a-e5abe4a38781 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:46:23.352921 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d004070-ca7b-4f74-922a-e5abe4a38781 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:23.355526 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d004070-ca7b-4f74-922a-e5abe4a38781 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:23.375096 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1120/2240] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:46:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:46:23.380032 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f8a85-22e0-4e58-94c7-b46ea74f0d10 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:23.390342 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f8a85-22e0-4e58-94c7-b46ea74f0d10 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:23.398905 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c81f3-a81f-4e87-9891-ba8319f3a8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:23.399578 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c81f3-a81f-4e87-9891-ba8319f3a8fb admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:23.399926 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c81f3-a81f-4e87-9891-ba8319f3a8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:23.400184 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c81f3-a81f-4e87-9891-ba8319f3a8fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:23.403790 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c81f3-a81f-4e87-9891-ba8319f3a8fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:23.404338 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c81f3-a81f-4e87-9891-ba8319f3a8fb admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:23.464193 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1121/2241] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:46:23 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:46:23.470554 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d004070-ca7b-4f74-922a-e5abe4a38781 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:23.496459 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d004070-ca7b-4f74-922a-e5abe4a38781 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:23.608526 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b174c-5f17-4170-9ef8-3138b5f09a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:23.609983 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b174c-5f17-4170-9ef8-3138b5f09a6f admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:23.610718 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b174c-5f17-4170-9ef8-3138b5f09a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:23.611392 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b174c-5f17-4170-9ef8-3138b5f09a6f admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:23.612344 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b174c-5f17-4170-9ef8-3138b5f09a6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:23.617094 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b174c-5f17-4170-9ef8-3138b5f09a6f admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:23.650694 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1121/2242] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:46:23 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:46:23.656132 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c81f3-a81f-4e87-9891-ba8319f3a8fb admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:23.672228 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c81f3-a81f-4e87-9891-ba8319f3a8fb admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:23.688311 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa41a9c-72b9-41ac-b2f7-906fad1b5d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:23.688879 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa41a9c-72b9-41ac-b2f7-906fad1b5d63 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:23.689162 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa41a9c-72b9-41ac-b2f7-906fad1b5d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:23.689425 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa41a9c-72b9-41ac-b2f7-906fad1b5d63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:23.690064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa41a9c-72b9-41ac-b2f7-906fad1b5d63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:23.691835 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa41a9c-72b9-41ac-b2f7-906fad1b5d63 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:23.727113 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1122/2243] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:46:23.738320 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b174c-5f17-4170-9ef8-3138b5f09a6f admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:23.751051 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b174c-5f17-4170-9ef8-3138b5f09a6f admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:23.759941 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08678aae-aec8-4aa3-aee6-5d58aa29402f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:23.760577 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08678aae-aec8-4aa3-aee6-5d58aa29402f admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:23.761002 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08678aae-aec8-4aa3-aee6-5d58aa29402f admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:23.761287 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08678aae-aec8-4aa3-aee6-5d58aa29402f admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:23.762183 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08678aae-aec8-4aa3-aee6-5d58aa29402f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:23.767170 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08678aae-aec8-4aa3-aee6-5d58aa29402f admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:23.784884 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1122/2244] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:23 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:46:23.791768 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa41a9c-72b9-41ac-b2f7-906fad1b5d63 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:23.809884 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa41a9c-72b9-41ac-b2f7-906fad1b5d63 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:23.817039 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf35eee-4d51-4732-9fb9-c12f7ee1e338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:23.817913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf35eee-4d51-4732-9fb9-c12f7ee1e338 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:23.818234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf35eee-4d51-4732-9fb9-c12f7ee1e338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:23.818510 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf35eee-4d51-4732-9fb9-c12f7ee1e338 admin admin] PATH_INFO: `/v3/projects/ae96c9968e184ef48b50ed1cdb047310/users/74ef280861ec46efb89139fb043e5fda/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:23.846221 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf35eee-4d51-4732-9fb9-c12f7ee1e338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae96c9968e184ef48b50ed1cdb047310, user_id=74ef280861ec46efb89139fb043e5fda, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:23.851943 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf35eee-4d51-4732-9fb9-c12f7ee1e338 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:23.910833 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1123/2245] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:46:23 2022] PUT /identity/v3/projects/ae96c9968e184ef48b50ed1cdb047310/users/74ef280861ec46efb89139fb043e5fda/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:46:23.926865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c2af4-e276-4259-af70-461c9d2d5461 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:23.927125 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c2af4-e276-4259-af70-461c9d2d5461 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:23.927294 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c2af4-e276-4259-af70-461c9d2d5461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:23.960007 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-a36c2af4-e276-4259-af70-461c9d2d5461 None None] MFA Rules not processed for user `74ef280861ec46efb89139fb043e5fda`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:23.963063 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a36c2af4-e276-4259-af70-461c9d2d5461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:24.051400 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1123/2246] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:24.066227 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf35eee-4d51-4732-9fb9-c12f7ee1e338 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:24.068330 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9bf35eee-4d51-4732-9fb9-c12f7ee1e338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:24.120149 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:24.141178 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf35eee-4d51-4732-9fb9-c12f7ee1e338 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:24.147929 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68004e12-7755-4eca-aa93-a0fe1754c9bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:24.148893 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68004e12-7755-4eca-aa93-a0fe1754c9bf service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:24.149349 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68004e12-7755-4eca-aa93-a0fe1754c9bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:24.149740 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68004e12-7755-4eca-aa93-a0fe1754c9bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:24.165301 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68004e12-7755-4eca-aa93-a0fe1754c9bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:24.168035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68004e12-7755-4eca-aa93-a0fe1754c9bf service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:24.186612 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1124/2247] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:46:24.218144 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c2af4-e276-4259-af70-461c9d2d5461 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:24.301026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:24.307707 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c2af4-e276-4259-af70-461c9d2d5461 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:24.313404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb9393-819e-4212-83a8-7365f140bd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:24.314085 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb9393-819e-4212-83a8-7365f140bd31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:24.314358 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb9393-819e-4212-83a8-7365f140bd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:24.314645 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb9393-819e-4212-83a8-7365f140bd31 admin admin] PATH_INFO: `/v3/users/74ef280861ec46efb89139fb043e5fda` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:24.315989 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb9393-819e-4212-83a8-7365f140bd31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74ef280861ec46efb89139fb043e5fda)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:24.317974 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffb9393-819e-4212-83a8-7365f140bd31 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:24.391662 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-7ffb9393-819e-4212-83a8-7365f140bd31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74ef280861ec46efb89139fb043e5fda'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:24.408063 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-7ffb9393-819e-4212-83a8-7365f140bd31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74ef280861ec46efb89139fb043e5fda'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:24.444531 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-7ffb9393-819e-4212-83a8-7365f140bd31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74ef280861ec46efb89139fb043e5fda'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:24.445603 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-7ffb9393-819e-4212-83a8-7365f140bd31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74ef280861ec46efb89139fb043e5fda'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:24.464853 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-7ffb9393-819e-4212-83a8-7365f140bd31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74ef280861ec46efb89139fb043e5fda'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:24.488025 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1124/2248] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:46:24 2022] DELETE /identity/v3/users/74ef280861ec46efb89139fb043e5fda => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:24.492730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ccbff-2a96-441f-852e-23af89055c57 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:24.493306 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ccbff-2a96-441f-852e-23af89055c57 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:24.493306 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ccbff-2a96-441f-852e-23af89055c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:24.522217 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-8a5ccbff-2a96-441f-852e-23af89055c57 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:24.523696 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8a5ccbff-2a96-441f-852e-23af89055c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:24.598809 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1125/2249] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:24.609936 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb9393-819e-4212-83a8-7365f140bd31 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:24.613658 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-7ffb9393-819e-4212-83a8-7365f140bd31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:24.687203 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb9393-819e-4212-83a8-7365f140bd31 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:24.691527 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57551725-ddc6-41a7-bbaf-50caae8c32a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:24.692216 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57551725-ddc6-41a7-bbaf-50caae8c32a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:24.692482 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57551725-ddc6-41a7-bbaf-50caae8c32a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:24.692742 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57551725-ddc6-41a7-bbaf-50caae8c32a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:24.703368 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57551725-ddc6-41a7-bbaf-50caae8c32a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:24.704760 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57551725-ddc6-41a7-bbaf-50caae8c32a9 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:24.722695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1125/2250] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:46:25.136561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ccbff-2a96-441f-852e-23af89055c57 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:25.139126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8a5ccbff-2a96-441f-852e-23af89055c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:25.164626 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ccbff-2a96-441f-852e-23af89055c57 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:25.181989 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a980b-3399-4c6f-ae8e-957bbde2ef33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:25.183011 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a980b-3399-4c6f-ae8e-957bbde2ef33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:25.183942 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a980b-3399-4c6f-ae8e-957bbde2ef33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:25.184418 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a980b-3399-4c6f-ae8e-957bbde2ef33 admin admin] PATH_INFO: `/v3/projects/ae96c9968e184ef48b50ed1cdb047310` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:25.186594 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a980b-3399-4c6f-ae8e-957bbde2ef33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae96c9968e184ef48b50ed1cdb047310)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:25.191311 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a980b-3399-4c6f-ae8e-957bbde2ef33 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:25.275228 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-aa9a980b-3399-4c6f-ae8e-957bbde2ef33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae96c9968e184ef48b50ed1cdb047310', 'request_id': 'req-aa9a980b-3399-4c6f-ae8e-957bbde2ef33'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:25.287081 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-aa9a980b-3399-4c6f-ae8e-957bbde2ef33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae96c9968e184ef48b50ed1cdb047310', 'request_id': 'req-aa9a980b-3399-4c6f-ae8e-957bbde2ef33'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:25.295005 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-aa9a980b-3399-4c6f-ae8e-957bbde2ef33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae96c9968e184ef48b50ed1cdb047310', 'request_id': 'req-aa9a980b-3399-4c6f-ae8e-957bbde2ef33'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:25.331472 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-aa9a980b-3399-4c6f-ae8e-957bbde2ef33 admin admin] The token cache is being invalidate because project ae96c9968e184ef48b50ed1cdb047310 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:46:25.332590 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-aa9a980b-3399-4c6f-ae8e-957bbde2ef33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:25.342872 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-aa9a980b-3399-4c6f-ae8e-957bbde2ef33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:25.352177 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1126/2251] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:46:25 2022] DELETE /identity/v3/projects/ae96c9968e184ef48b50ed1cdb047310 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:25.356177 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d267f2-a8ff-4746-9436-7fad6de11877 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:25.356177 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d267f2-a8ff-4746-9436-7fad6de11877 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:25.356764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d267f2-a8ff-4746-9436-7fad6de11877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:25.390546 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-74d267f2-a8ff-4746-9436-7fad6de11877 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:25.392223 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-74d267f2-a8ff-4746-9436-7fad6de11877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:25.536093 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1126/2252] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:25.544353 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ae8eb-aa95-4f98-8126-1322f64389c0 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:25.544954 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ae8eb-aa95-4f98-8126-1322f64389c0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:25.545173 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ae8eb-aa95-4f98-8126-1322f64389c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:25.579084 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-cd2ae8eb-aa95-4f98-8126-1322f64389c0 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:25.580451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-cd2ae8eb-aa95-4f98-8126-1322f64389c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:25.590783 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1127/2253] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:25.596351 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d267f2-a8ff-4746-9436-7fad6de11877 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:25.611140 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d267f2-a8ff-4746-9436-7fad6de11877 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:25.618628 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039c3f9-1c00-4827-baf5-d3d6941a2efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:25.620610 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039c3f9-1c00-4827-baf5-d3d6941a2efc admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:25.621091 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039c3f9-1c00-4827-baf5-d3d6941a2efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:25.621557 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039c3f9-1c00-4827-baf5-d3d6941a2efc admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:25.622762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3039c3f9-1c00-4827-baf5-d3d6941a2efc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:46:25.623506 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3039c3f9-1c00-4827-baf5-d3d6941a2efc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:25.629104 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3039c3f9-1c00-4827-baf5-d3d6941a2efc admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:25.654385 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1127/2254] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:46:25.659131 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ae8eb-aa95-4f98-8126-1322f64389c0 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:25.669516 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ae8eb-aa95-4f98-8126-1322f64389c0 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:25.676325 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c064ae-b867-4ca5-a77c-03a6f1cd8e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:25.677080 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c064ae-b867-4ca5-a77c-03a6f1cd8e51 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:25.677359 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c064ae-b867-4ca5-a77c-03a6f1cd8e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:25.677855 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c064ae-b867-4ca5-a77c-03a6f1cd8e51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:25.678621 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c064ae-b867-4ca5-a77c-03a6f1cd8e51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:25.680842 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c064ae-b867-4ca5-a77c-03a6f1cd8e51 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:25.728909 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1128/2255] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:46:25 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:46:25.730629 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039c3f9-1c00-4827-baf5-d3d6941a2efc admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:25.746776 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039c3f9-1c00-4827-baf5-d3d6941a2efc admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:25.752113 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:25.839807 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3bc5e-ca61-4a45-849f-c4573b55287b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:25.840444 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3bc5e-ca61-4a45-849f-c4573b55287b admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:25.840719 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3bc5e-ca61-4a45-849f-c4573b55287b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:25.840986 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d3bc5e-ca61-4a45-849f-c4573b55287b admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:25.841629 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3bc5e-ca61-4a45-849f-c4573b55287b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:25.843580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d3bc5e-ca61-4a45-849f-c4573b55287b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:25.876843 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1128/2256] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:46:25 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:46:25.881961 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c064ae-b867-4ca5-a77c-03a6f1cd8e51 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:25.894432 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c064ae-b867-4ca5-a77c-03a6f1cd8e51 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:25.899611 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4023ea1-d444-4f77-a85b-d2c7c7a61270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:25.900366 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4023ea1-d444-4f77-a85b-d2c7c7a61270 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:25.900644 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4023ea1-d444-4f77-a85b-d2c7c7a61270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:25.900925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4023ea1-d444-4f77-a85b-d2c7c7a61270 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:25.901736 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4023ea1-d444-4f77-a85b-d2c7c7a61270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:25.903441 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4023ea1-d444-4f77-a85b-d2c7c7a61270 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:25.915038 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1129/2257] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:46:25.919630 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3bc5e-ca61-4a45-849f-c4573b55287b admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:25.933061 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d3bc5e-ca61-4a45-849f-c4573b55287b admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:25.939989 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcc278-6803-44ce-9703-0df5ed74907f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:25.940685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcc278-6803-44ce-9703-0df5ed74907f admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:25.940956 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcc278-6803-44ce-9703-0df5ed74907f admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:25.941222 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcc278-6803-44ce-9703-0df5ed74907f admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:25.941888 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dcc278-6803-44ce-9703-0df5ed74907f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:25.943541 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dcc278-6803-44ce-9703-0df5ed74907f admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:25.956959 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1129/2258] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:46:25.961722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4023ea1-d444-4f77-a85b-d2c7c7a61270 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:25.973870 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4023ea1-d444-4f77-a85b-d2c7c7a61270 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:25.980800 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebad0d7-cd68-4cd7-99e7-d684c7c69216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:25.981483 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebad0d7-cd68-4cd7-99e7-d684c7c69216 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:25.981835 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebad0d7-cd68-4cd7-99e7-d684c7c69216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:25.982115 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebad0d7-cd68-4cd7-99e7-d684c7c69216 admin admin] PATH_INFO: `/v3/projects/b53a2a85abe64c579cd4c3bcee325810/users/c41d8add98814bdabb80ac1721773ef6/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:25.999998 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebad0d7-cd68-4cd7-99e7-d684c7c69216 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b53a2a85abe64c579cd4c3bcee325810, user_id=c41d8add98814bdabb80ac1721773ef6, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:26.002797 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebad0d7-cd68-4cd7-99e7-d684c7c69216 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:26.018882 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1130/2259] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:46:25 2022] PUT /identity/v3/projects/b53a2a85abe64c579cd4c3bcee325810/users/c41d8add98814bdabb80ac1721773ef6/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:26.029983 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a671dd4-cf95-4146-9891-06da37fbbeb0 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:26.030240 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a671dd4-cf95-4146-9891-06da37fbbeb0 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:26.030515 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a671dd4-cf95-4146-9891-06da37fbbeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:26.066597 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-0a671dd4-cf95-4146-9891-06da37fbbeb0 None None] MFA Rules not processed for user `c41d8add98814bdabb80ac1721773ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:26.068875 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0a671dd4-cf95-4146-9891-06da37fbbeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:26.173730 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1130/2260] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:26.185425 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebad0d7-cd68-4cd7-99e7-d684c7c69216 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:26.187580 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6ebad0d7-cd68-4cd7-99e7-d684c7c69216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:26.193430 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:26.265419 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebad0d7-cd68-4cd7-99e7-d684c7c69216 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:26.269237 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801280e4-1146-426b-a4ab-f5b987fe2257 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:26.269858 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801280e4-1146-426b-a4ab-f5b987fe2257 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:26.270375 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801280e4-1146-426b-a4ab-f5b987fe2257 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:26.270651 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801280e4-1146-426b-a4ab-f5b987fe2257 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:26.280390 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801280e4-1146-426b-a4ab-f5b987fe2257 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:26.281897 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801280e4-1146-426b-a4ab-f5b987fe2257 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:26.291578 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1131/2261] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:46:32.513280 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a671dd4-cf95-4146-9891-06da37fbbeb0 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:32.514804 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0a671dd4-cf95-4146-9891-06da37fbbeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:32.625478 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a671dd4-cf95-4146-9891-06da37fbbeb0 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:32.632493 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a17627-d5a0-4f69-8439-2d9f8c851fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:32.633474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a17627-d5a0-4f69-8439-2d9f8c851fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:32.634121 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a17627-d5a0-4f69-8439-2d9f8c851fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:32.634484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a17627-d5a0-4f69-8439-2d9f8c851fc8 admin admin] PATH_INFO: `/v3/users/c940e07b8bd14e0c87a1594650eb7f8d` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:32.636123 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a17627-d5a0-4f69-8439-2d9f8c851fc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c940e07b8bd14e0c87a1594650eb7f8d)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:32.639616 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a17627-d5a0-4f69-8439-2d9f8c851fc8 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:32.660330 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:32.726374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-78a17627-d5a0-4f69-8439-2d9f8c851fc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c940e07b8bd14e0c87a1594650eb7f8d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:32.741151 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-78a17627-d5a0-4f69-8439-2d9f8c851fc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c940e07b8bd14e0c87a1594650eb7f8d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:32.756155 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-78a17627-d5a0-4f69-8439-2d9f8c851fc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c940e07b8bd14e0c87a1594650eb7f8d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:32.756951 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-78a17627-d5a0-4f69-8439-2d9f8c851fc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c940e07b8bd14e0c87a1594650eb7f8d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:32.767623 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-78a17627-d5a0-4f69-8439-2d9f8c851fc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c940e07b8bd14e0c87a1594650eb7f8d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:32.780918 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1131/2262] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:46:32 2022] DELETE /identity/v3/users/c940e07b8bd14e0c87a1594650eb7f8d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:46:32.786276 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae6d59-74e5-4ade-8bad-d1f4da75e3fe None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:32.786276 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae6d59-74e5-4ade-8bad-d1f4da75e3fe None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:32.787320 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae6d59-74e5-4ade-8bad-d1f4da75e3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:32.812821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-32ae6d59-74e5-4ade-8bad-d1f4da75e3fe None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:32.815568 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-32ae6d59-74e5-4ade-8bad-d1f4da75e3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:32.896296 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1132/2263] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:32.915063 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a17627-d5a0-4f69-8439-2d9f8c851fc8 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:32.915063 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-78a17627-d5a0-4f69-8439-2d9f8c851fc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:32.976251 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a17627-d5a0-4f69-8439-2d9f8c851fc8 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:32.981892 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fe557-4975-4123-99ba-4066ff2bbeea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:32.982235 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fe557-4975-4123-99ba-4066ff2bbeea service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:32.982607 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fe557-4975-4123-99ba-4066ff2bbeea service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:32.982965 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fe557-4975-4123-99ba-4066ff2bbeea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:32.997358 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fe557-4975-4123-99ba-4066ff2bbeea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:32.998875 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fe557-4975-4123-99ba-4066ff2bbeea service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:33.009846 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1132/2264] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:46:33.803005 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae6d59-74e5-4ade-8bad-d1f4da75e3fe None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:33.804704 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-32ae6d59-74e5-4ade-8bad-d1f4da75e3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:33.822915 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae6d59-74e5-4ade-8bad-d1f4da75e3fe None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:33.829438 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b15da-00fe-4f61-be34-1af5b906adba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:33.830396 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b15da-00fe-4f61-be34-1af5b906adba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:33.830835 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b15da-00fe-4f61-be34-1af5b906adba admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:33.836665 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b15da-00fe-4f61-be34-1af5b906adba admin admin] PATH_INFO: `/v3/projects/36f22a1fa71c41fd9d7f0616204af7a7` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:33.840211 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b15da-00fe-4f61-be34-1af5b906adba admin admin] RBAC: Authorizing `identity:delete_project(project_id=36f22a1fa71c41fd9d7f0616204af7a7)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:33.841413 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b15da-00fe-4f61-be34-1af5b906adba admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:33.912522 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-802b15da-00fe-4f61-be34-1af5b906adba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36f22a1fa71c41fd9d7f0616204af7a7', 'request_id': 'req-802b15da-00fe-4f61-be34-1af5b906adba'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:33.922119 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-802b15da-00fe-4f61-be34-1af5b906adba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36f22a1fa71c41fd9d7f0616204af7a7', 'request_id': 'req-802b15da-00fe-4f61-be34-1af5b906adba'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:33.932845 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-802b15da-00fe-4f61-be34-1af5b906adba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36f22a1fa71c41fd9d7f0616204af7a7', 'request_id': 'req-802b15da-00fe-4f61-be34-1af5b906adba'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:33.961470 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-802b15da-00fe-4f61-be34-1af5b906adba admin admin] The token cache is being invalidate because project 36f22a1fa71c41fd9d7f0616204af7a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:46:33.962098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-802b15da-00fe-4f61-be34-1af5b906adba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:33.964113 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-802b15da-00fe-4f61-be34-1af5b906adba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:33.972072 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1133/2265] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:46:33 2022] DELETE /identity/v3/projects/36f22a1fa71c41fd9d7f0616204af7a7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:34.409839 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fe557-4975-4123-99ba-4066ff2bbeea service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:34.412213 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-391fe557-4975-4123-99ba-4066ff2bbeea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:34.433371 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fe557-4975-4123-99ba-4066ff2bbeea service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:34.526198 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ab46b-3f98-47fc-863e-808f08e13a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:34.526863 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ab46b-3f98-47fc-863e-808f08e13a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:34.527284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ab46b-3f98-47fc-863e-808f08e13a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:34.527691 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5ab46b-3f98-47fc-863e-808f08e13a7b admin admin] PATH_INFO: `/v3/users/c41d8add98814bdabb80ac1721773ef6` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:34.529667 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ab46b-3f98-47fc-863e-808f08e13a7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c41d8add98814bdabb80ac1721773ef6)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:34.532967 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5ab46b-3f98-47fc-863e-808f08e13a7b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:34.594777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:34.605003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-ef5ab46b-3f98-47fc-863e-808f08e13a7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c41d8add98814bdabb80ac1721773ef6'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:34.613656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-ef5ab46b-3f98-47fc-863e-808f08e13a7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c41d8add98814bdabb80ac1721773ef6'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:34.628267 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-ef5ab46b-3f98-47fc-863e-808f08e13a7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c41d8add98814bdabb80ac1721773ef6'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:34.629163 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-ef5ab46b-3f98-47fc-863e-808f08e13a7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c41d8add98814bdabb80ac1721773ef6'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:34.636946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-ef5ab46b-3f98-47fc-863e-808f08e13a7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c41d8add98814bdabb80ac1721773ef6'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:34.643394 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1133/2266] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:46:34 2022] DELETE /identity/v3/users/c41d8add98814bdabb80ac1721773ef6 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:34.648435 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95700eb-15a8-4378-8af6-a58d305a6f94 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:34.648716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95700eb-15a8-4378-8af6-a58d305a6f94 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:34.649021 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95700eb-15a8-4378-8af6-a58d305a6f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:34.672043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-f95700eb-15a8-4378-8af6-a58d305a6f94 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:34.673271 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f95700eb-15a8-4378-8af6-a58d305a6f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:34.701579 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:34.745525 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1134/2267] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:34.755959 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ab46b-3f98-47fc-863e-808f08e13a7b admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:34.757496 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ef5ab46b-3f98-47fc-863e-808f08e13a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:34.823474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5ab46b-3f98-47fc-863e-808f08e13a7b admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:34.829640 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fc475-9795-4efe-b68f-e850d4b07ec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:34.830506 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fc475-9795-4efe-b68f-e850d4b07ec3 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:34.831845 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fc475-9795-4efe-b68f-e850d4b07ec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:34.832192 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fc475-9795-4efe-b68f-e850d4b07ec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:34.847203 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fc475-9795-4efe-b68f-e850d4b07ec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:34.848726 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fc475-9795-4efe-b68f-e850d4b07ec3 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:34.860746 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1134/2268] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:46:35.161981 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95700eb-15a8-4378-8af6-a58d305a6f94 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:35.163639 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f95700eb-15a8-4378-8af6-a58d305a6f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:35.190509 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95700eb-15a8-4378-8af6-a58d305a6f94 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:35.195685 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa794e-fe0c-4033-b0ba-3dabadf10f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:35.196399 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa794e-fe0c-4033-b0ba-3dabadf10f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:35.196673 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa794e-fe0c-4033-b0ba-3dabadf10f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:35.196942 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa794e-fe0c-4033-b0ba-3dabadf10f73 admin admin] PATH_INFO: `/v3/projects/b53a2a85abe64c579cd4c3bcee325810` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:35.198361 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa794e-fe0c-4033-b0ba-3dabadf10f73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b53a2a85abe64c579cd4c3bcee325810)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:35.200372 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa794e-fe0c-4033-b0ba-3dabadf10f73 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:35.265203 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-67aa794e-fe0c-4033-b0ba-3dabadf10f73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b53a2a85abe64c579cd4c3bcee325810', 'request_id': 'req-67aa794e-fe0c-4033-b0ba-3dabadf10f73'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:35.278674 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-67aa794e-fe0c-4033-b0ba-3dabadf10f73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b53a2a85abe64c579cd4c3bcee325810', 'request_id': 'req-67aa794e-fe0c-4033-b0ba-3dabadf10f73'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:35.287233 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-67aa794e-fe0c-4033-b0ba-3dabadf10f73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b53a2a85abe64c579cd4c3bcee325810', 'request_id': 'req-67aa794e-fe0c-4033-b0ba-3dabadf10f73'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:35.309673 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-67aa794e-fe0c-4033-b0ba-3dabadf10f73 admin admin] The token cache is being invalidate because project b53a2a85abe64c579cd4c3bcee325810 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:46:35.310380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-67aa794e-fe0c-4033-b0ba-3dabadf10f73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:35.311600 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-67aa794e-fe0c-4033-b0ba-3dabadf10f73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:35.318482 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1135/2269] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:46:35 2022] DELETE /identity/v3/projects/b53a2a85abe64c579cd4c3bcee325810 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:35.320027 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa9758-63f4-45b0-ae08-eed452dd022d None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:35.320313 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa9758-63f4-45b0-ae08-eed452dd022d None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:35.320578 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa9758-63f4-45b0-ae08-eed452dd022d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:35.342145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-94aa9758-63f4-45b0-ae08-eed452dd022d None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:35.344117 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-94aa9758-63f4-45b0-ae08-eed452dd022d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:35.419792 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1135/2270] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:35.429113 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2b253-cd3b-46cf-a271-3a2ae8d2a935 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:35.429393 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2b253-cd3b-46cf-a271-3a2ae8d2a935 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:35.429666 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2b253-cd3b-46cf-a271-3a2ae8d2a935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:35.450542 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-39c2b253-cd3b-46cf-a271-3a2ae8d2a935 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:35.451780 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-39c2b253-cd3b-46cf-a271-3a2ae8d2a935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:35.459695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1136/2271] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:35.464276 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa9758-63f4-45b0-ae08-eed452dd022d None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:35.474309 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa9758-63f4-45b0-ae08-eed452dd022d None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:35.480109 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3717a91-76d4-4bc6-8be5-5a75fe21d52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:35.480589 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3717a91-76d4-4bc6-8be5-5a75fe21d52b admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:35.480925 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3717a91-76d4-4bc6-8be5-5a75fe21d52b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:35.481105 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3717a91-76d4-4bc6-8be5-5a75fe21d52b admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:35.481759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3717a91-76d4-4bc6-8be5-5a75fe21d52b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:46:35.482052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3717a91-76d4-4bc6-8be5-5a75fe21d52b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:35.483663 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3717a91-76d4-4bc6-8be5-5a75fe21d52b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:35.501759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1136/2272] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:46:35.506401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2b253-cd3b-46cf-a271-3a2ae8d2a935 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:35.516606 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2b253-cd3b-46cf-a271-3a2ae8d2a935 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:35.527972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481a2ab-1dde-4c91-858e-0d38e068ad54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:35.527972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481a2ab-1dde-4c91-858e-0d38e068ad54 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:35.527972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481a2ab-1dde-4c91-858e-0d38e068ad54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:35.527972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481a2ab-1dde-4c91-858e-0d38e068ad54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:35.528531 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3481a2ab-1dde-4c91-858e-0d38e068ad54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:35.528531 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3481a2ab-1dde-4c91-858e-0d38e068ad54 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:35.557363 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1137/2273] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:46:35 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:46:35.562302 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3717a91-76d4-4bc6-8be5-5a75fe21d52b admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:35.573230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3717a91-76d4-4bc6-8be5-5a75fe21d52b admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:35.624073 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:35.651005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8d0d5-25c9-4f54-9319-cf6ee9224261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:35.651671 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8d0d5-25c9-4f54-9319-cf6ee9224261 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:35.651986 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8d0d5-25c9-4f54-9319-cf6ee9224261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:35.652266 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8d0d5-25c9-4f54-9319-cf6ee9224261 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:35.653321 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8d0d5-25c9-4f54-9319-cf6ee9224261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:35.655307 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8d0d5-25c9-4f54-9319-cf6ee9224261 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:35.685197 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1137/2274] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:46:35 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:46:35.686959 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481a2ab-1dde-4c91-858e-0d38e068ad54 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:35.699547 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481a2ab-1dde-4c91-858e-0d38e068ad54 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:35.709972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5b032-4c37-4e0a-8819-19252e6a5b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:35.714103 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5b032-4c37-4e0a-8819-19252e6a5b67 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:35.714597 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5b032-4c37-4e0a-8819-19252e6a5b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:35.715112 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5b032-4c37-4e0a-8819-19252e6a5b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:35.716585 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5b032-4c37-4e0a-8819-19252e6a5b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:35.719861 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5b032-4c37-4e0a-8819-19252e6a5b67 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:35.736817 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1138/2275] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:46:35.741420 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8d0d5-25c9-4f54-9319-cf6ee9224261 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:35.752156 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8d0d5-25c9-4f54-9319-cf6ee9224261 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:35.757829 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6678eb-e785-4074-b002-e6e02284bc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:35.758482 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6678eb-e785-4074-b002-e6e02284bc1b admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:35.758755 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6678eb-e785-4074-b002-e6e02284bc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:35.759101 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6678eb-e785-4074-b002-e6e02284bc1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:35.759848 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6678eb-e785-4074-b002-e6e02284bc1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:35.761501 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6678eb-e785-4074-b002-e6e02284bc1b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:35.773258 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1138/2276] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:46:35.777653 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5b032-4c37-4e0a-8819-19252e6a5b67 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:35.788506 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5b032-4c37-4e0a-8819-19252e6a5b67 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:35.794187 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd6285-e0b7-418e-99b3-a4a3e7d6ff08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:35.795005 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd6285-e0b7-418e-99b3-a4a3e7d6ff08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:35.795332 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd6285-e0b7-418e-99b3-a4a3e7d6ff08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:35.795607 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd6285-e0b7-418e-99b3-a4a3e7d6ff08 admin admin] PATH_INFO: `/v3/projects/c6b249c7b7604a638ab130919173a9bd/users/665db5f440124ff39df6fdf9a9896b75/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:35.812363 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd6285-e0b7-418e-99b3-a4a3e7d6ff08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b249c7b7604a638ab130919173a9bd, user_id=665db5f440124ff39df6fdf9a9896b75, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:35.815104 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd6285-e0b7-418e-99b3-a4a3e7d6ff08 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:35.830613 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1139/2277] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:46:35 2022] PUT /identity/v3/projects/c6b249c7b7604a638ab130919173a9bd/users/665db5f440124ff39df6fdf9a9896b75/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:35.841118 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4491c01-0802-453e-973a-249116ad65a2 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:35.841390 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4491c01-0802-453e-973a-249116ad65a2 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:35.841660 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4491c01-0802-453e-973a-249116ad65a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:35.875434 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-e4491c01-0802-453e-973a-249116ad65a2 None None] MFA Rules not processed for user `665db5f440124ff39df6fdf9a9896b75`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:35.876631 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e4491c01-0802-453e-973a-249116ad65a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:35.949656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1139/2278] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:35.954914 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd6285-e0b7-418e-99b3-a4a3e7d6ff08 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:36.009010 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:36.026708 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd6285-e0b7-418e-99b3-a4a3e7d6ff08 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:36.031920 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b82233-bd2f-4fd6-a454-3872542b19b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:36.032542 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b82233-bd2f-4fd6-a454-3872542b19b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:36.032817 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b82233-bd2f-4fd6-a454-3872542b19b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:36.033078 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b82233-bd2f-4fd6-a454-3872542b19b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:36.033723 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b82233-bd2f-4fd6-a454-3872542b19b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:36.035658 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b82233-bd2f-4fd6-a454-3872542b19b3 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:36.064626 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1140/2279] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:46:35 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:46:36.069285 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4491c01-0802-453e-973a-249116ad65a2 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:36.080793 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4491c01-0802-453e-973a-249116ad65a2 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:36.140906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6cfde-ad52-415d-b3e4-14068bb7b577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:36.141429 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6cfde-ad52-415d-b3e4-14068bb7b577 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:36.141703 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6cfde-ad52-415d-b3e4-14068bb7b577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:36.141964 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6cfde-ad52-415d-b3e4-14068bb7b577 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:36.142594 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6cfde-ad52-415d-b3e4-14068bb7b577 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:36.144543 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c6cfde-ad52-415d-b3e4-14068bb7b577 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:36.167981 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1140/2280] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:46:36 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:46:36.173428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b82233-bd2f-4fd6-a454-3872542b19b3 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:36.190367 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b82233-bd2f-4fd6-a454-3872542b19b3 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:36.197799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154d1a4-f9b6-45cb-b9a5-c9f219acd918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:36.198826 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154d1a4-f9b6-45cb-b9a5-c9f219acd918 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:36.199303 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154d1a4-f9b6-45cb-b9a5-c9f219acd918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:36.199822 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154d1a4-f9b6-45cb-b9a5-c9f219acd918 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:36.200981 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154d1a4-f9b6-45cb-b9a5-c9f219acd918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:36.203709 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1154d1a4-f9b6-45cb-b9a5-c9f219acd918 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:36.223440 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1141/2281] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:46:36.228186 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6cfde-ad52-415d-b3e4-14068bb7b577 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:36.244793 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6cfde-ad52-415d-b3e4-14068bb7b577 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:36.250256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d795480e-09a5-4996-8cbd-71966bca8a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:36.250880 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795480e-09a5-4996-8cbd-71966bca8a7d admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:36.251155 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795480e-09a5-4996-8cbd-71966bca8a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:36.251421 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795480e-09a5-4996-8cbd-71966bca8a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:36.252097 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795480e-09a5-4996-8cbd-71966bca8a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:36.253700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d795480e-09a5-4996-8cbd-71966bca8a7d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:36.265149 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1141/2282] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:46:36.269710 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154d1a4-f9b6-45cb-b9a5-c9f219acd918 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:36.282538 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154d1a4-f9b6-45cb-b9a5-c9f219acd918 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:36.290728 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79cf5a-f443-4728-8877-0c0949155401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:36.291629 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79cf5a-f443-4728-8877-0c0949155401 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:36.292229 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79cf5a-f443-4728-8877-0c0949155401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:36.292643 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79cf5a-f443-4728-8877-0c0949155401 admin admin] PATH_INFO: `/v3/projects/4377c6c7914d43f88c6cfbe3979b4871/users/82589ccda28342f68847b8a59c70e104/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:36.313008 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79cf5a-f443-4728-8877-0c0949155401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4377c6c7914d43f88c6cfbe3979b4871, user_id=82589ccda28342f68847b8a59c70e104, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:36.315779 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79cf5a-f443-4728-8877-0c0949155401 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:36.331374 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1142/2283] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:46:36 2022] PUT /identity/v3/projects/4377c6c7914d43f88c6cfbe3979b4871/users/82589ccda28342f68847b8a59c70e104/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:36.343636 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce736f78-eed9-4139-b02b-2b8007449d0d None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:36.343962 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce736f78-eed9-4139-b02b-2b8007449d0d None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:36.344230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce736f78-eed9-4139-b02b-2b8007449d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:36.374439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-ce736f78-eed9-4139-b02b-2b8007449d0d None None] MFA Rules not processed for user `82589ccda28342f68847b8a59c70e104`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:36.375649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ce736f78-eed9-4139-b02b-2b8007449d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:36.397380 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:36.470438 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1142/2284] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:36.471669 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79cf5a-f443-4728-8877-0c0949155401 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:36.558568 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79cf5a-f443-4728-8877-0c0949155401 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:36.566187 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690267d0-02b4-4c3b-8e6a-cafdf03aa658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:36.566932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690267d0-02b4-4c3b-8e6a-cafdf03aa658 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:36.567307 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690267d0-02b4-4c3b-8e6a-cafdf03aa658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:36.567669 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690267d0-02b4-4c3b-8e6a-cafdf03aa658 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:36.568468 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690267d0-02b4-4c3b-8e6a-cafdf03aa658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:36.570934 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690267d0-02b4-4c3b-8e6a-cafdf03aa658 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:36.628057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1143/2285] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:46:36 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:46:36.632408 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce736f78-eed9-4139-b02b-2b8007449d0d None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:36.647763 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce736f78-eed9-4139-b02b-2b8007449d0d None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:36.735762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd968a-1835-4da9-a259-0253e3a17073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:36.736613 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd968a-1835-4da9-a259-0253e3a17073 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:36.736991 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd968a-1835-4da9-a259-0253e3a17073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:36.737396 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd968a-1835-4da9-a259-0253e3a17073 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:36.738216 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd968a-1835-4da9-a259-0253e3a17073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:36.740704 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd968a-1835-4da9-a259-0253e3a17073 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:36.771986 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1143/2286] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:46:36 2022] POST /identity/v3/users => generated 294 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:46:36.776577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690267d0-02b4-4c3b-8e6a-cafdf03aa658 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:36.788142 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690267d0-02b4-4c3b-8e6a-cafdf03aa658 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:36.794556 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03402612-b486-476a-b768-037453f1345a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:36.795523 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03402612-b486-476a-b768-037453f1345a admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:36.796400 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03402612-b486-476a-b768-037453f1345a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:36.796839 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03402612-b486-476a-b768-037453f1345a admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:36.797972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03402612-b486-476a-b768-037453f1345a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:36.801246 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03402612-b486-476a-b768-037453f1345a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:36.817953 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1144/2287] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:46:36.824801 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd968a-1835-4da9-a259-0253e3a17073 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:36.841115 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd968a-1835-4da9-a259-0253e3a17073 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:36.848362 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3173f7d-2862-4041-b77a-bef9c9d9a443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:36.849411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3173f7d-2862-4041-b77a-bef9c9d9a443 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:36.849849 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3173f7d-2862-4041-b77a-bef9c9d9a443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:36.850291 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3173f7d-2862-4041-b77a-bef9c9d9a443 admin admin] PATH_INFO: `/v3/projects/753fcbe395644402b60a9655bd453760/users/9a41d02837584b2e82ce2b99277b120e/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:36.880645 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3173f7d-2862-4041-b77a-bef9c9d9a443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=753fcbe395644402b60a9655bd453760, user_id=9a41d02837584b2e82ce2b99277b120e, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:36.887430 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3173f7d-2862-4041-b77a-bef9c9d9a443 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:36.910213 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1144/2288] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:46:36 2022] PUT /identity/v3/projects/753fcbe395644402b60a9655bd453760/users/9a41d02837584b2e82ce2b99277b120e/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:36.911674 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03402612-b486-476a-b768-037453f1345a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:36.933283 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03402612-b486-476a-b768-037453f1345a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:37.069655 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27fce0-45cb-49d6-9526-245121f5afe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:37.070281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27fce0-45cb-49d6-9526-245121f5afe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:37.070734 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27fce0-45cb-49d6-9526-245121f5afe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:37.071161 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27fce0-45cb-49d6-9526-245121f5afe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:37.071861 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27fce0-45cb-49d6-9526-245121f5afe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:37.073838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27fce0-45cb-49d6-9526-245121f5afe5 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:37.087783 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1145/2289] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:46:37.090808 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3173f7d-2862-4041-b77a-bef9c9d9a443 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:37.102616 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3173f7d-2862-4041-b77a-bef9c9d9a443 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:37.107530 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ffa3e5-2ba0-4898-8393-2b2a98538a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:37.108230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffa3e5-2ba0-4898-8393-2b2a98538a8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:37.108501 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffa3e5-2ba0-4898-8393-2b2a98538a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:37.108767 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ffa3e5-2ba0-4898-8393-2b2a98538a8e admin admin] PATH_INFO: `/v3/projects/753fcbe395644402b60a9655bd453760/users/9a41d02837584b2e82ce2b99277b120e/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:37.110680 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ffa3e5-2ba0-4898-8393-2b2a98538a8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=753fcbe395644402b60a9655bd453760, user_id=9a41d02837584b2e82ce2b99277b120e, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:37.113335 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ffa3e5-2ba0-4898-8393-2b2a98538a8e admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:37.131676 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1145/2290] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:46:37 2022] PUT /identity/v3/projects/753fcbe395644402b60a9655bd453760/users/9a41d02837584b2e82ce2b99277b120e/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:37.148768 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70879c-bc24-4232-a3a2-6d2841f74b51 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:37.149051 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70879c-bc24-4232-a3a2-6d2841f74b51 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:37.149318 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70879c-bc24-4232-a3a2-6d2841f74b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:37.173163 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:37.185765 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-be70879c-bc24-4232-a3a2-6d2841f74b51 None None] MFA Rules not processed for user `9a41d02837584b2e82ce2b99277b120e`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:37.187289 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-be70879c-bc24-4232-a3a2-6d2841f74b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:37.268881 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1146/2291] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:37.282318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ffa3e5-2ba0-4898-8393-2b2a98538a8e admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:37.284788 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-45ffa3e5-2ba0-4898-8393-2b2a98538a8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:37.351442 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ffa3e5-2ba0-4898-8393-2b2a98538a8e admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:37.355678 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446d02b-82aa-4bea-a0cc-17d989986edc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:37.356361 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446d02b-82aa-4bea-a0cc-17d989986edc service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:37.356628 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446d02b-82aa-4bea-a0cc-17d989986edc service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:37.356885 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446d02b-82aa-4bea-a0cc-17d989986edc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:37.388375 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:37.421499 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446d02b-82aa-4bea-a0cc-17d989986edc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:37.422943 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446d02b-82aa-4bea-a0cc-17d989986edc service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:37.433042 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1146/2292] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:46:40.057280 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70879c-bc24-4232-a3a2-6d2841f74b51 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:40.067746 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70879c-bc24-4232-a3a2-6d2841f74b51 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:40.071272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8439e-713a-45f6-ad85-36b6b867c338 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:40.071995 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8439e-713a-45f6-ad85-36b6b867c338 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:40.072343 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8439e-713a-45f6-ad85-36b6b867c338 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:40.072679 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8439e-713a-45f6-ad85-36b6b867c338 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:40.137167 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8439e-713a-45f6-ad85-36b6b867c338 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:40.138622 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8439e-713a-45f6-ad85-36b6b867c338 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:40.148744 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1147/2293] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:46:40.857017 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446d02b-82aa-4bea-a0cc-17d989986edc service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:40.868047 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446d02b-82aa-4bea-a0cc-17d989986edc service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:40.873445 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95108e30-823e-4b89-b34d-aa189fd95ecc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:40.874245 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95108e30-823e-4b89-b34d-aa189fd95ecc service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:40.874607 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95108e30-823e-4b89-b34d-aa189fd95ecc service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:40.874967 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95108e30-823e-4b89-b34d-aa189fd95ecc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:40.887688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95108e30-823e-4b89-b34d-aa189fd95ecc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:40.889149 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95108e30-823e-4b89-b34d-aa189fd95ecc service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:40.901254 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1147/2294] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:46:45.184211 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768fed9-d8ac-4d75-9552-732b7c7322f1 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:45.184755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768fed9-d8ac-4d75-9552-732b7c7322f1 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:45.185170 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768fed9-d8ac-4d75-9552-732b7c7322f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:45.211811 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c768fed9-d8ac-4d75-9552-732b7c7322f1 None None] MFA Rules not processed for user `5bdaf32400b94aa291ad43a3131e1d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:45.212992 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c768fed9-d8ac-4d75-9552-732b7c7322f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:45.278542 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1148/2295] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Sep 26 05:46:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:45.327768 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95108e30-823e-4b89-b34d-aa189fd95ecc service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:45.330323 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-95108e30-823e-4b89-b34d-aa189fd95ecc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:45.417693 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95108e30-823e-4b89-b34d-aa189fd95ecc service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:45.424444 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0400326a-938b-422c-8d2c-555ae89f669a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '830cd52ac42548b2ade17b5215aefd28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:45.425062 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400326a-938b-422c-8d2c-555ae89f669a service swift] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:45.425334 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400326a-938b-422c-8d2c-555ae89f669a service swift] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:45.425601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0400326a-938b-422c-8d2c-555ae89f669a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:45.436747 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400326a-938b-422c-8d2c-555ae89f669a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:45.438367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0400326a-938b-422c-8d2c-555ae89f669a service swift] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:45.448857 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1148/2296] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 26 05:46:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 05:46:46.141724 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768fed9-d8ac-4d75-9552-732b7c7322f1 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:46.263329 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:46.320501 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768fed9-d8ac-4d75-9552-732b7c7322f1 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:46.328444 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822782e-aa6d-4a0d-832b-41c4711c38c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:46.329578 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822782e-aa6d-4a0d-832b-41c4711c38c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:46.330049 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822782e-aa6d-4a0d-832b-41c4711c38c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:46.330530 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d822782e-aa6d-4a0d-832b-41c4711c38c8 admin admin] PATH_INFO: `/v3/users/665db5f440124ff39df6fdf9a9896b75` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:46.332756 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d822782e-aa6d-4a0d-832b-41c4711c38c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=665db5f440124ff39df6fdf9a9896b75)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:46.336701 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d822782e-aa6d-4a0d-832b-41c4711c38c8 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:46.455885 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d822782e-aa6d-4a0d-832b-41c4711c38c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '665db5f440124ff39df6fdf9a9896b75'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:46.484306 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d822782e-aa6d-4a0d-832b-41c4711c38c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '665db5f440124ff39df6fdf9a9896b75'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:46.485116 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d822782e-aa6d-4a0d-832b-41c4711c38c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '665db5f440124ff39df6fdf9a9896b75'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:46.505368 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d822782e-aa6d-4a0d-832b-41c4711c38c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '665db5f440124ff39df6fdf9a9896b75'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:46.525282 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d822782e-aa6d-4a0d-832b-41c4711c38c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '665db5f440124ff39df6fdf9a9896b75'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:46.532936 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1149/2297] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:46:46 2022] DELETE /identity/v3/users/665db5f440124ff39df6fdf9a9896b75 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:46.538340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35eaaa-98f4-4e82-b662-69f6c7ecfa1b None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:46.539726 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35eaaa-98f4-4e82-b662-69f6c7ecfa1b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:46.539975 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35eaaa-98f4-4e82-b662-69f6c7ecfa1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:46.579787 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-1e35eaaa-98f4-4e82-b662-69f6c7ecfa1b None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:46.582918 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1e35eaaa-98f4-4e82-b662-69f6c7ecfa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:46.756682 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1149/2298] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:46.769648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822782e-aa6d-4a0d-832b-41c4711c38c8 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:46.784419 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d822782e-aa6d-4a0d-832b-41c4711c38c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:46.877637 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d822782e-aa6d-4a0d-832b-41c4711c38c8 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:46.882789 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99570d1-f509-477a-b90f-3363bbc641b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:46.883561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99570d1-f509-477a-b90f-3363bbc641b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:46.884042 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99570d1-f509-477a-b90f-3363bbc641b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:46.884372 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99570d1-f509-477a-b90f-3363bbc641b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:46.895506 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99570d1-f509-477a-b90f-3363bbc641b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:46.897304 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99570d1-f509-477a-b90f-3363bbc641b2 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:46.909428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1150/2299] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:46:47.372467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35eaaa-98f4-4e82-b662-69f6c7ecfa1b None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:47.374633 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1e35eaaa-98f4-4e82-b662-69f6c7ecfa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:47.488556 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:47.497421 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35eaaa-98f4-4e82-b662-69f6c7ecfa1b None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:47.502870 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3f4b8-c622-4ccf-bd7d-b405f998e084 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:47.504307 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3f4b8-c622-4ccf-bd7d-b405f998e084 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:47.504860 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3f4b8-c622-4ccf-bd7d-b405f998e084 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:47.505589 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3f4b8-c622-4ccf-bd7d-b405f998e084 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:47.508959 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-88f3f4b8-c622-4ccf-bd7d-b405f998e084 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:47.577811 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99570d1-f509-477a-b90f-3363bbc641b2 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:47.580397 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a99570d1-f509-477a-b90f-3363bbc641b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:47.599820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99570d1-f509-477a-b90f-3363bbc641b2 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:47.609386 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a8ef9-4343-4818-8258-b8d8db89e723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:47.610192 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a8ef9-4343-4818-8258-b8d8db89e723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:47.610470 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a8ef9-4343-4818-8258-b8d8db89e723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:47.610908 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a8ef9-4343-4818-8258-b8d8db89e723 admin admin] PATH_INFO: `/v3/projects/c6b249c7b7604a638ab130919173a9bd` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:47.612743 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a8ef9-4343-4818-8258-b8d8db89e723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6b249c7b7604a638ab130919173a9bd)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:47.615311 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a8ef9-4343-4818-8258-b8d8db89e723 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:47.701804 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3f4b8-c622-4ccf-bd7d-b405f998e084 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:47.712408 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3f4b8-c622-4ccf-bd7d-b405f998e084 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:47.733464 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4f1a8ef9-4343-4818-8258-b8d8db89e723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6b249c7b7604a638ab130919173a9bd', 'request_id': 'req-4f1a8ef9-4343-4818-8258-b8d8db89e723'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:47.740390 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:47.744577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4f1a8ef9-4343-4818-8258-b8d8db89e723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6b249c7b7604a638ab130919173a9bd', 'request_id': 'req-4f1a8ef9-4343-4818-8258-b8d8db89e723'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:47.746870 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1150/2300] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:46:47.759220 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4f1a8ef9-4343-4818-8258-b8d8db89e723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6b249c7b7604a638ab130919173a9bd', 'request_id': 'req-4f1a8ef9-4343-4818-8258-b8d8db89e723'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:47.804736 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4f1a8ef9-4343-4818-8258-b8d8db89e723 admin admin] The token cache is being invalidate because project c6b249c7b7604a638ab130919173a9bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:46:47.805299 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4f1a8ef9-4343-4818-8258-b8d8db89e723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:47.806460 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4f1a8ef9-4343-4818-8258-b8d8db89e723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:47.809791 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1151/2301] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:46:47 2022] DELETE /identity/v3/projects/c6b249c7b7604a638ab130919173a9bd => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:47.813836 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3f4b8-c622-4ccf-bd7d-b405f998e084 service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:47.826857 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3f4b8-c622-4ccf-bd7d-b405f998e084 service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:47.960844 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b76099-03de-4e34-923c-1f84e7794242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:47.961564 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b76099-03de-4e34-923c-1f84e7794242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:47.961868 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b76099-03de-4e34-923c-1f84e7794242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:47.962138 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b76099-03de-4e34-923c-1f84e7794242 admin admin] PATH_INFO: `/v3/users/82589ccda28342f68847b8a59c70e104` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:47.966809 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b76099-03de-4e34-923c-1f84e7794242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82589ccda28342f68847b8a59c70e104)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:47.973452 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b76099-03de-4e34-923c-1f84e7794242 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:48.101354 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-50b76099-03de-4e34-923c-1f84e7794242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82589ccda28342f68847b8a59c70e104'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:48.120103 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-50b76099-03de-4e34-923c-1f84e7794242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82589ccda28342f68847b8a59c70e104'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:48.139255 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-50b76099-03de-4e34-923c-1f84e7794242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82589ccda28342f68847b8a59c70e104'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:48.140026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-50b76099-03de-4e34-923c-1f84e7794242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82589ccda28342f68847b8a59c70e104'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:48.147801 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-50b76099-03de-4e34-923c-1f84e7794242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82589ccda28342f68847b8a59c70e104'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:48.155073 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1151/2302] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:46:47 2022] DELETE /identity/v3/users/82589ccda28342f68847b8a59c70e104 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:46:48.552982 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a8ef9-4343-4818-8258-b8d8db89e723 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:48.555220 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4f1a8ef9-4343-4818-8258-b8d8db89e723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:48.596924 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a8ef9-4343-4818-8258-b8d8db89e723 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:48.789792 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91199d-b05e-40d9-93ff-2e6d2536178f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:48.791369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91199d-b05e-40d9-93ff-2e6d2536178f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:48.792074 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91199d-b05e-40d9-93ff-2e6d2536178f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:48.792780 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91199d-b05e-40d9-93ff-2e6d2536178f admin admin] PATH_INFO: `/v3/projects/4377c6c7914d43f88c6cfbe3979b4871` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:48.819538 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f91199d-b05e-40d9-93ff-2e6d2536178f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4377c6c7914d43f88c6cfbe3979b4871)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:48.829643 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f91199d-b05e-40d9-93ff-2e6d2536178f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:48.945367 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0f91199d-b05e-40d9-93ff-2e6d2536178f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4377c6c7914d43f88c6cfbe3979b4871', 'request_id': 'req-0f91199d-b05e-40d9-93ff-2e6d2536178f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:48.957183 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0f91199d-b05e-40d9-93ff-2e6d2536178f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4377c6c7914d43f88c6cfbe3979b4871', 'request_id': 'req-0f91199d-b05e-40d9-93ff-2e6d2536178f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:48.965103 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0f91199d-b05e-40d9-93ff-2e6d2536178f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4377c6c7914d43f88c6cfbe3979b4871', 'request_id': 'req-0f91199d-b05e-40d9-93ff-2e6d2536178f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:48.991554 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0f91199d-b05e-40d9-93ff-2e6d2536178f admin admin] The token cache is being invalidate because project 4377c6c7914d43f88c6cfbe3979b4871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:46:48.992825 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0f91199d-b05e-40d9-93ff-2e6d2536178f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:48.993711 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0f91199d-b05e-40d9-93ff-2e6d2536178f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:48.998730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1152/2303] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:46:48 2022] DELETE /identity/v3/projects/4377c6c7914d43f88c6cfbe3979b4871 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:49.002787 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b76099-03de-4e34-923c-1f84e7794242 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:49.004782 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-50b76099-03de-4e34-923c-1f84e7794242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:49.021488 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b76099-03de-4e34-923c-1f84e7794242 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:49.042529 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:49.154668 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46908150-5916-4f57-8f23-c4938a22ed39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:49.156413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46908150-5916-4f57-8f23-c4938a22ed39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:49.156754 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46908150-5916-4f57-8f23-c4938a22ed39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:49.157015 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46908150-5916-4f57-8f23-c4938a22ed39 admin admin] PATH_INFO: `/v3/users/9a41d02837584b2e82ce2b99277b120e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:49.161575 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46908150-5916-4f57-8f23-c4938a22ed39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a41d02837584b2e82ce2b99277b120e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:49.168933 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46908150-5916-4f57-8f23-c4938a22ed39 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:49.293204 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-46908150-5916-4f57-8f23-c4938a22ed39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a41d02837584b2e82ce2b99277b120e'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:49.310579 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-46908150-5916-4f57-8f23-c4938a22ed39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a41d02837584b2e82ce2b99277b120e'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:49.358089 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-46908150-5916-4f57-8f23-c4938a22ed39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a41d02837584b2e82ce2b99277b120e'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:49.359181 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-46908150-5916-4f57-8f23-c4938a22ed39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a41d02837584b2e82ce2b99277b120e'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:49.371702 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-46908150-5916-4f57-8f23-c4938a22ed39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a41d02837584b2e82ce2b99277b120e'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:49.386055 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1152/2304] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:46:49 2022] DELETE /identity/v3/users/9a41d02837584b2e82ce2b99277b120e => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:46:49.799245 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91199d-b05e-40d9-93ff-2e6d2536178f admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:49.801777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0f91199d-b05e-40d9-93ff-2e6d2536178f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:49.834378 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91199d-b05e-40d9-93ff-2e6d2536178f admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:50.020424 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f453f0-7aca-4139-8af9-6f6c874e6aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:50.021477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f453f0-7aca-4139-8af9-6f6c874e6aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:50.021968 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f453f0-7aca-4139-8af9-6f6c874e6aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:50.022425 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f453f0-7aca-4139-8af9-6f6c874e6aad admin admin] PATH_INFO: `/v3/projects/753fcbe395644402b60a9655bd453760` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:50.024692 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f453f0-7aca-4139-8af9-6f6c874e6aad admin admin] RBAC: Authorizing `identity:delete_project(project_id=753fcbe395644402b60a9655bd453760)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:50.028835 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f453f0-7aca-4139-8af9-6f6c874e6aad admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:50.054133 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:50.111982 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-40f453f0-7aca-4139-8af9-6f6c874e6aad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '753fcbe395644402b60a9655bd453760', 'request_id': 'req-40f453f0-7aca-4139-8af9-6f6c874e6aad'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:50.122220 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-40f453f0-7aca-4139-8af9-6f6c874e6aad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '753fcbe395644402b60a9655bd453760', 'request_id': 'req-40f453f0-7aca-4139-8af9-6f6c874e6aad'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:50.132084 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-40f453f0-7aca-4139-8af9-6f6c874e6aad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '753fcbe395644402b60a9655bd453760', 'request_id': 'req-40f453f0-7aca-4139-8af9-6f6c874e6aad'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:50.152342 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-40f453f0-7aca-4139-8af9-6f6c874e6aad admin admin] The token cache is being invalidate because project 753fcbe395644402b60a9655bd453760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:46:50.152776 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-40f453f0-7aca-4139-8af9-6f6c874e6aad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:50.153692 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-40f453f0-7aca-4139-8af9-6f6c874e6aad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:50.155756 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1153/2305] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:46:49 2022] DELETE /identity/v3/projects/753fcbe395644402b60a9655bd453760 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:50.168267 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbe79b-6fef-4784-b211-0cb0ed9fd632 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:50.169025 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbe79b-6fef-4784-b211-0cb0ed9fd632 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:50.169127 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbe79b-6fef-4784-b211-0cb0ed9fd632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:50.195536 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-0acbe79b-6fef-4784-b211-0cb0ed9fd632 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:50.197135 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0acbe79b-6fef-4784-b211-0cb0ed9fd632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:50.285258 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1153/2306] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:50.294634 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70206e-4a8f-4f0b-81de-ea0d900db9bc None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:50.295183 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70206e-4a8f-4f0b-81de-ea0d900db9bc None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:50.296042 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70206e-4a8f-4f0b-81de-ea0d900db9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:50.330655 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-2c70206e-4a8f-4f0b-81de-ea0d900db9bc None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:50.332069 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2c70206e-4a8f-4f0b-81de-ea0d900db9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:50.347777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1154/2307] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:46:50.349565 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbe79b-6fef-4784-b211-0cb0ed9fd632 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:50.360741 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbe79b-6fef-4784-b211-0cb0ed9fd632 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:50.366122 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e7dcc-d1f4-4c89-bc06-0b0858d60358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:50.366986 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e7dcc-d1f4-4c89-bc06-0b0858d60358 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:50.367367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e7dcc-d1f4-4c89-bc06-0b0858d60358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:50.367709 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e7dcc-d1f4-4c89-bc06-0b0858d60358 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:50.368521 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e7dcc-d1f4-4c89-bc06-0b0858d60358 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:46:50.368893 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e7dcc-d1f4-4c89-bc06-0b0858d60358 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:50.370804 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e7dcc-d1f4-4c89-bc06-0b0858d60358 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:50.387776 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1154/2308] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:46:50.394241 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70206e-4a8f-4f0b-81de-ea0d900db9bc None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:50.407765 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70206e-4a8f-4f0b-81de-ea0d900db9bc None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:50.426114 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8885d17-d059-487a-8578-d9bd148d38e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:50.430739 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8885d17-d059-487a-8578-d9bd148d38e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:50.431187 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8885d17-d059-487a-8578-d9bd148d38e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:50.432245 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8885d17-d059-487a-8578-d9bd148d38e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:50.435779 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8885d17-d059-487a-8578-d9bd148d38e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:50.440419 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8885d17-d059-487a-8578-d9bd148d38e2 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:50.452890 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e7dcc-d1f4-4c89-bc06-0b0858d60358 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:50.454911 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-116e7dcc-d1f4-4c89-bc06-0b0858d60358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:50.476461 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e7dcc-d1f4-4c89-bc06-0b0858d60358 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:50.487066 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe715b-17f1-49b8-b0de-92626af93e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:50.489035 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe715b-17f1-49b8-b0de-92626af93e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:50.489695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe715b-17f1-49b8-b0de-92626af93e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:50.490417 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe715b-17f1-49b8-b0de-92626af93e7a admin admin] PATH_INFO: `/v3/users/d5339f1ce63746478bdf2e157836baf9` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:50.492499 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe715b-17f1-49b8-b0de-92626af93e7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5339f1ce63746478bdf2e157836baf9)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:50.495215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe715b-17f1-49b8-b0de-92626af93e7a admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:50.499546 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1155/2309] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:46:50 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:46:50.504551 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8885d17-d059-487a-8578-d9bd148d38e2 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:50.533404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:50.601779 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8885d17-d059-487a-8578-d9bd148d38e2 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:50.608664 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad3c36-742a-4480-9e94-ed0374aa11e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:50.609479 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad3c36-742a-4480-9e94-ed0374aa11e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:50.609846 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad3c36-742a-4480-9e94-ed0374aa11e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:50.610211 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad3c36-742a-4480-9e94-ed0374aa11e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:50.610945 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad3c36-742a-4480-9e94-ed0374aa11e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:50.613907 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad3c36-742a-4480-9e94-ed0374aa11e9 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:50.627016 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9cfe715b-17f1-49b8-b0de-92626af93e7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5339f1ce63746478bdf2e157836baf9'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:50.641142 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9cfe715b-17f1-49b8-b0de-92626af93e7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5339f1ce63746478bdf2e157836baf9'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:50.659634 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1156/2310] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:46:50 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:46:50.661276 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad3c36-742a-4480-9e94-ed0374aa11e9 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:50.673401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad3c36-742a-4480-9e94-ed0374aa11e9 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:50.678324 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3abee5-8e71-4721-a39e-a5739862601b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:50.678968 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3abee5-8e71-4721-a39e-a5739862601b admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:50.679276 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3abee5-8e71-4721-a39e-a5739862601b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:50.679477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3abee5-8e71-4721-a39e-a5739862601b admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:50.680306 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3abee5-8e71-4721-a39e-a5739862601b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:50.682897 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3abee5-8e71-4721-a39e-a5739862601b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:50.690974 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9cfe715b-17f1-49b8-b0de-92626af93e7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5339f1ce63746478bdf2e157836baf9'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:50.691794 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9cfe715b-17f1-49b8-b0de-92626af93e7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5339f1ce63746478bdf2e157836baf9'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:50.695804 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1157/2311] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:46:50.710118 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-9cfe715b-17f1-49b8-b0de-92626af93e7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5339f1ce63746478bdf2e157836baf9'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:50.710340 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3abee5-8e71-4721-a39e-a5739862601b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:50.712260 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ba3abee5-8e71-4721-a39e-a5739862601b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:50.719811 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1155/2312] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:46:50 2022] DELETE /identity/v3/users/d5339f1ce63746478bdf2e157836baf9 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:46:50.724386 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94715ae-003b-4954-bede-b21d2e501763 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:50.724750 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94715ae-003b-4954-bede-b21d2e501763 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:50.725099 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94715ae-003b-4954-bede-b21d2e501763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:50.725456 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3abee5-8e71-4721-a39e-a5739862601b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:50.750960 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-c94715ae-003b-4954-bede-b21d2e501763 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:50.752361 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c94715ae-003b-4954-bede-b21d2e501763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:50.833665 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:50.855356 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7dbf72-e599-4894-8a9c-8c37ca2714d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:50.856387 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7dbf72-e599-4894-8a9c-8c37ca2714d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:50.856671 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7dbf72-e599-4894-8a9c-8c37ca2714d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:50.856934 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7dbf72-e599-4894-8a9c-8c37ca2714d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:50.857594 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7dbf72-e599-4894-8a9c-8c37ca2714d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:50.859305 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7dbf72-e599-4894-8a9c-8c37ca2714d2 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:50.871801 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1158/2313] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:46:50 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:46:50.875890 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1156/2314] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:46:50.877039 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7dbf72-e599-4894-8a9c-8c37ca2714d2 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:50.888480 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7dbf72-e599-4894-8a9c-8c37ca2714d2 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:50.889809 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94715ae-003b-4954-bede-b21d2e501763 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:50.892180 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c94715ae-003b-4954-bede-b21d2e501763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:50.893794 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12adb265-7839-4629-8bf5-564c1d6762a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:50.894488 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12adb265-7839-4629-8bf5-564c1d6762a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:50.894764 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12adb265-7839-4629-8bf5-564c1d6762a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:50.895065 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12adb265-7839-4629-8bf5-564c1d6762a0 admin admin] PATH_INFO: `/v3/projects/b72a95ef293143b29d3086905a0633aa/users/7b570ef0cd6140bd87089a3eb6be2561/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:50.915201 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12adb265-7839-4629-8bf5-564c1d6762a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b72a95ef293143b29d3086905a0633aa, user_id=7b570ef0cd6140bd87089a3eb6be2561, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:50.921112 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12adb265-7839-4629-8bf5-564c1d6762a0 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:50.951852 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1159/2315] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:46:50 2022] PUT /identity/v3/projects/b72a95ef293143b29d3086905a0633aa/users/7b570ef0cd6140bd87089a3eb6be2561/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:50.956941 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfed74a-46b6-4a5f-b821-3ed8a5eb311d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:50.957866 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfed74a-46b6-4a5f-b821-3ed8a5eb311d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:50.958603 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfed74a-46b6-4a5f-b821-3ed8a5eb311d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:50.999554 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-7dfed74a-46b6-4a5f-b821-3ed8a5eb311d None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:51.001938 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7dfed74a-46b6-4a5f-b821-3ed8a5eb311d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:51.003845 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94715ae-003b-4954-bede-b21d2e501763 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:51.119026 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1160/2316] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:46:51.131598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfed74a-46b6-4a5f-b821-3ed8a5eb311d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:51.146736 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc8012-2680-4651-9ac4-a1eb49114899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:51.147507 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc8012-2680-4651-9ac4-a1eb49114899 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:51.147947 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc8012-2680-4651-9ac4-a1eb49114899 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:51.148409 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dc8012-2680-4651-9ac4-a1eb49114899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:51.163718 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:51.171252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc8012-2680-4651-9ac4-a1eb49114899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:51.175586 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dc8012-2680-4651-9ac4-a1eb49114899 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:51.203498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1157/2317] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:46:51.255871 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfed74a-46b6-4a5f-b821-3ed8a5eb311d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:51.270694 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d398b63-c571-4961-bb68-f1ebcecaef49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:51.271647 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d398b63-c571-4961-bb68-f1ebcecaef49 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:51.272005 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d398b63-c571-4961-bb68-f1ebcecaef49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:51.272376 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d398b63-c571-4961-bb68-f1ebcecaef49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:51.283944 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d398b63-c571-4961-bb68-f1ebcecaef49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:51.286344 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d398b63-c571-4961-bb68-f1ebcecaef49 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:51.298877 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1161/2318] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:46:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:46:52.083153 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc8012-2680-4651-9ac4-a1eb49114899 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:52.085052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-87dc8012-2680-4651-9ac4-a1eb49114899 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:52.111542 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dc8012-2680-4651-9ac4-a1eb49114899 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:52.123436 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66657a0f-b857-4786-82d0-59687a61c2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:52.124144 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66657a0f-b857-4786-82d0-59687a61c2e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:52.124419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66657a0f-b857-4786-82d0-59687a61c2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:52.124686 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66657a0f-b857-4786-82d0-59687a61c2e0 admin admin] PATH_INFO: `/v3/projects/b007ec059292458e9a62734a01065da3` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:52.126157 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66657a0f-b857-4786-82d0-59687a61c2e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b007ec059292458e9a62734a01065da3)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:52.129370 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66657a0f-b857-4786-82d0-59687a61c2e0 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:52.260166 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-66657a0f-b857-4786-82d0-59687a61c2e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b007ec059292458e9a62734a01065da3', 'request_id': 'req-66657a0f-b857-4786-82d0-59687a61c2e0'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:52.283559 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-66657a0f-b857-4786-82d0-59687a61c2e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b007ec059292458e9a62734a01065da3', 'request_id': 'req-66657a0f-b857-4786-82d0-59687a61c2e0'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:52.305306 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-66657a0f-b857-4786-82d0-59687a61c2e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b007ec059292458e9a62734a01065da3', 'request_id': 'req-66657a0f-b857-4786-82d0-59687a61c2e0'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:52.342808 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-66657a0f-b857-4786-82d0-59687a61c2e0 admin admin] The token cache is being invalidate because project b007ec059292458e9a62734a01065da3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:46:52.343299 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-66657a0f-b857-4786-82d0-59687a61c2e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:52.355301 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-66657a0f-b857-4786-82d0-59687a61c2e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:46:52.381687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1158/2319] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:46:52 2022] DELETE /identity/v3/projects/b007ec059292458e9a62734a01065da3 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:46:59.532039 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e6fba-e318-48c3-891b-95e2873619db None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:59.532614 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e6fba-e318-48c3-891b-95e2873619db None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:59.532614 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e6fba-e318-48c3-891b-95e2873619db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:59.587477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-ad5e6fba-e318-48c3-891b-95e2873619db None None] MFA Rules not processed for user `7b570ef0cd6140bd87089a3eb6be2561`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:46:59.589097 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ad5e6fba-e318-48c3-891b-95e2873619db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:59.742226 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:46:59.758219 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1162/2320] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:46:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:46:59.758738 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66657a0f-b857-4786-82d0-59687a61c2e0 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:59.761110 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-66657a0f-b857-4786-82d0-59687a61c2e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:46:59.878682 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66657a0f-b857-4786-82d0-59687a61c2e0 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:46:59.887139 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58eb96f-851b-43fc-ac76-7bcf9e90c0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:46:59.888270 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58eb96f-851b-43fc-ac76-7bcf9e90c0a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:46:59.888612 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58eb96f-851b-43fc-ac76-7bcf9e90c0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:46:59.888936 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58eb96f-851b-43fc-ac76-7bcf9e90c0a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:46:59.889864 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58eb96f-851b-43fc-ac76-7bcf9e90c0a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:46:59.892132 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58eb96f-851b-43fc-ac76-7bcf9e90c0a9 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:46:59.946492 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1159/2321] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:46:59 2022] POST /identity/v3/projects => generated 373 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:46:59.951454 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e6fba-e318-48c3-891b-95e2873619db None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:46:59.965531 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e6fba-e318-48c3-891b-95e2873619db None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:47:00.038316 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ff719-be4c-452e-8fef-1d4c67ae8d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:47:00.038949 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ff719-be4c-452e-8fef-1d4c67ae8d83 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:00.039228 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ff719-be4c-452e-8fef-1d4c67ae8d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:00.039497 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ff719-be4c-452e-8fef-1d4c67ae8d83 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:00.040189 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ff719-be4c-452e-8fef-1d4c67ae8d83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:47:00.042577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ff719-be4c-452e-8fef-1d4c67ae8d83 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:47:00.082185 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1163/2322] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:46:59 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:47:00.086639 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58eb96f-851b-43fc-ac76-7bcf9e90c0a9 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:47:00.098487 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58eb96f-851b-43fc-ac76-7bcf9e90c0a9 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:47:00.103519 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33b114-211a-42c4-9bc2-3f033896e556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:47:00.104186 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33b114-211a-42c4-9bc2-3f033896e556 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:00.104669 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33b114-211a-42c4-9bc2-3f033896e556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:00.104921 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33b114-211a-42c4-9bc2-3f033896e556 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:00.105650 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33b114-211a-42c4-9bc2-3f033896e556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:47:00.107687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33b114-211a-42c4-9bc2-3f033896e556 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:47:00.128729 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ff719-be4c-452e-8fef-1d4c67ae8d83 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:47:00.145748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1160/2323] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:47:00.146693 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ff719-be4c-452e-8fef-1d4c67ae8d83 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:47:00.152433 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398cd946-32d4-42da-a58a-dba7f4b2b3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:47:00.153187 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cd946-32d4-42da-a58a-dba7f4b2b3c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:00.153465 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cd946-32d4-42da-a58a-dba7f4b2b3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:00.153730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398cd946-32d4-42da-a58a-dba7f4b2b3c9 admin admin] PATH_INFO: `/v3/projects/90bae8adb5c34c42815410fa0caae5c6/users/ba0d5e9440ed45859e8ac5079139c97a/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:00.180072 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398cd946-32d4-42da-a58a-dba7f4b2b3c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90bae8adb5c34c42815410fa0caae5c6, user_id=ba0d5e9440ed45859e8ac5079139c97a, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:47:00.183040 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398cd946-32d4-42da-a58a-dba7f4b2b3c9 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:47:00.204153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1164/2324] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:47:00 2022] PUT /identity/v3/projects/90bae8adb5c34c42815410fa0caae5c6/users/ba0d5e9440ed45859e8ac5079139c97a/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:47:00.206484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33b114-211a-42c4-9bc2-3f033896e556 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:47:00.219676 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33b114-211a-42c4-9bc2-3f033896e556 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:47:00.383869 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:47:00.404855 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb71e4-08be-4c14-9e28-076c38a3a4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:47:00.405590 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb71e4-08be-4c14-9e28-076c38a3a4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:00.405937 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb71e4-08be-4c14-9e28-076c38a3a4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:00.406275 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb71e4-08be-4c14-9e28-076c38a3a4b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:00.407003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb71e4-08be-4c14-9e28-076c38a3a4b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:47:00.408824 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb71e4-08be-4c14-9e28-076c38a3a4b3 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:47:00.430069 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1161/2325] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:47:00 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:47:00.431584 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398cd946-32d4-42da-a58a-dba7f4b2b3c9 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:47:00.447405 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398cd946-32d4-42da-a58a-dba7f4b2b3c9 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:47:00.470875 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea44e7f-69e1-47f1-b74d-0574333b4984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:47:00.471798 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea44e7f-69e1-47f1-b74d-0574333b4984 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:00.472181 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea44e7f-69e1-47f1-b74d-0574333b4984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:00.472516 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea44e7f-69e1-47f1-b74d-0574333b4984 admin admin] PATH_INFO: `/v3/projects/90bae8adb5c34c42815410fa0caae5c6/users/ba0d5e9440ed45859e8ac5079139c97a/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:00.481159 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea44e7f-69e1-47f1-b74d-0574333b4984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90bae8adb5c34c42815410fa0caae5c6, user_id=ba0d5e9440ed45859e8ac5079139c97a, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:47:00.483677 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea44e7f-69e1-47f1-b74d-0574333b4984 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:47:00.503795 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1165/2326] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:47:00 2022] PUT /identity/v3/projects/90bae8adb5c34c42815410fa0caae5c6/users/ba0d5e9440ed45859e8ac5079139c97a/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:47:08.148528 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219046a-ab02-4a45-8c86-8ad0b4e1021e None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:08.149186 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219046a-ab02-4a45-8c86-8ad0b4e1021e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:08.149271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219046a-ab02-4a45-8c86-8ad0b4e1021e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:08.210158 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-2219046a-ab02-4a45-8c86-8ad0b4e1021e None None] MFA Rules not processed for user `5224b2ba12d54146855fe3a993dc0915`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:47:08.211416 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2219046a-ab02-4a45-8c86-8ad0b4e1021e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:47:08.376761 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1162/2327] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:47:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:47:08.696234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d44b8-1c54-421e-8647-c885b14ea2ea None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:08.696851 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d44b8-1c54-421e-8647-c885b14ea2ea None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:08.696958 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d44b8-1c54-421e-8647-c885b14ea2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:08.739302 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-7c1d44b8-1c54-421e-8647-c885b14ea2ea None None] MFA Rules not processed for user `ba0d5e9440ed45859e8ac5079139c97a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:47:08.740711 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7c1d44b8-1c54-421e-8647-c885b14ea2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:47:08.910374 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1166/2328] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:47:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:47:08.929920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219046a-ab02-4a45-8c86-8ad0b4e1021e None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:47:08.933380 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2219046a-ab02-4a45-8c86-8ad0b4e1021e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:47:09.047218 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219046a-ab02-4a45-8c86-8ad0b4e1021e None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:47:09.054862 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da878e-63ac-41a1-b6af-ceb16d0977c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:47:09.055504 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da878e-63ac-41a1-b6af-ceb16d0977c5 service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:09.055817 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da878e-63ac-41a1-b6af-ceb16d0977c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:09.056084 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da878e-63ac-41a1-b6af-ceb16d0977c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:09.137400 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da878e-63ac-41a1-b6af-ceb16d0977c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:47:09.141665 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da878e-63ac-41a1-b6af-ceb16d0977c5 service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:47:09.172874 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1163/2329] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:47:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:47:11.876180 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad29d9c-4dd0-4f18-b8a3-d0ac0f20d09b None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:11.876691 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad29d9c-4dd0-4f18-b8a3-d0ac0f20d09b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:11.876691 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad29d9c-4dd0-4f18-b8a3-d0ac0f20d09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:11.922233 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-6ad29d9c-4dd0-4f18-b8a3-d0ac0f20d09b None None] MFA Rules not processed for user `7b570ef0cd6140bd87089a3eb6be2561`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:47:11.925951 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6ad29d9c-4dd0-4f18-b8a3-d0ac0f20d09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:47:11.945606 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1167/2330] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:47:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:47:15.854554 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf51fcc-60e6-4dd4-87e8-6f00764f843e None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:15.855119 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf51fcc-60e6-4dd4-87e8-6f00764f843e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:15.855119 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf51fcc-60e6-4dd4-87e8-6f00764f843e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:15.875868 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-ebf51fcc-60e6-4dd4-87e8-6f00764f843e None None] MFA Rules not processed for user `5bdaf32400b94aa291ad43a3131e1d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:47:15.877150 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ebf51fcc-60e6-4dd4-87e8-6f00764f843e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:47:15.903004 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:47:15.941918 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1164/2331] 10.222.0.66 () {58 vars in 967 bytes} [Mon Sep 26 05:47:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:47:15.957750 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad29d9c-4dd0-4f18-b8a3-d0ac0f20d09b None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:47:15.959268 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6ad29d9c-4dd0-4f18-b8a3-d0ac0f20d09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:47:15.993587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:47:16.036230 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad29d9c-4dd0-4f18-b8a3-d0ac0f20d09b None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:47:16.041252 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6402d-7e73-44a2-85ba-aa6abddba2ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '830cd52ac42548b2ade17b5215aefd28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:47:16.041866 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6402d-7e73-44a2-85ba-aa6abddba2ae service swift] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:16.042162 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6402d-7e73-44a2-85ba-aa6abddba2ae service swift] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:16.042411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc6402d-7e73-44a2-85ba-aa6abddba2ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:16.052997 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6402d-7e73-44a2-85ba-aa6abddba2ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:47:16.054600 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc6402d-7e73-44a2-85ba-aa6abddba2ae service swift] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:47:16.063591 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1168/2332] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 26 05:47:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 05:47:16.299225 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf51fcc-60e6-4dd4-87e8-6f00764f843e None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:47:16.301990 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ebf51fcc-60e6-4dd4-87e8-6f00764f843e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:47:16.391649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf51fcc-60e6-4dd4-87e8-6f00764f843e None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:47:16.396819 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2750ca1-6a46-4573-938f-bb5da99462d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:47:16.397460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2750ca1-6a46-4573-938f-bb5da99462d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:16.397731 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2750ca1-6a46-4573-938f-bb5da99462d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:16.398063 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2750ca1-6a46-4573-938f-bb5da99462d5 admin admin] PATH_INFO: `/v3/users/8f2670af97d34c95be6fda61c5d88516` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:16.399304 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2750ca1-6a46-4573-938f-bb5da99462d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f2670af97d34c95be6fda61c5d88516)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:47:16.416411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2750ca1-6a46-4573-938f-bb5da99462d5 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:47:16.476546 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-f2750ca1-6a46-4573-938f-bb5da99462d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f2670af97d34c95be6fda61c5d88516'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:47:16.486514 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-f2750ca1-6a46-4573-938f-bb5da99462d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f2670af97d34c95be6fda61c5d88516'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:47:16.512703 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-f2750ca1-6a46-4573-938f-bb5da99462d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f2670af97d34c95be6fda61c5d88516'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:47:16.513448 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-f2750ca1-6a46-4573-938f-bb5da99462d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f2670af97d34c95be6fda61c5d88516'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:47:16.522751 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-f2750ca1-6a46-4573-938f-bb5da99462d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f2670af97d34c95be6fda61c5d88516'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:47:16.530501 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1165/2333] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:47:16 2022] DELETE /identity/v3/users/8f2670af97d34c95be6fda61c5d88516 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:47:16.726579 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6402d-7e73-44a2-85ba-aa6abddba2ae service swift] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:47:16.748255 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc6402d-7e73-44a2-85ba-aa6abddba2ae service swift] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:47:16.817794 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fefd028-fac4-44b8-bc76-445a6802dee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:47:16.818432 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefd028-fac4-44b8-bc76-445a6802dee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:16.818843 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefd028-fac4-44b8-bc76-445a6802dee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:16.819118 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fefd028-fac4-44b8-bc76-445a6802dee6 admin admin] PATH_INFO: `/v3/projects/26b383f7796b41a2b87d7a6d88c8fc28` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:16.820296 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fefd028-fac4-44b8-bc76-445a6802dee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26b383f7796b41a2b87d7a6d88c8fc28)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:47:16.822236 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fefd028-fac4-44b8-bc76-445a6802dee6 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:47:16.875124 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6fefd028-fac4-44b8-bc76-445a6802dee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26b383f7796b41a2b87d7a6d88c8fc28', 'request_id': 'req-6fefd028-fac4-44b8-bc76-445a6802dee6'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:47:16.883021 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6fefd028-fac4-44b8-bc76-445a6802dee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26b383f7796b41a2b87d7a6d88c8fc28', 'request_id': 'req-6fefd028-fac4-44b8-bc76-445a6802dee6'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:47:16.890716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6fefd028-fac4-44b8-bc76-445a6802dee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26b383f7796b41a2b87d7a6d88c8fc28', 'request_id': 'req-6fefd028-fac4-44b8-bc76-445a6802dee6'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:47:16.904747 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6fefd028-fac4-44b8-bc76-445a6802dee6 admin admin] The token cache is being invalidate because project 26b383f7796b41a2b87d7a6d88c8fc28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:47:16.905037 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6fefd028-fac4-44b8-bc76-445a6802dee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:47:16.905645 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6fefd028-fac4-44b8-bc76-445a6802dee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:47:16.907137 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1169/2334] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:47:16 2022] DELETE /identity/v3/projects/26b383f7796b41a2b87d7a6d88c8fc28 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:47:16.911376 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2750ca1-6a46-4573-938f-bb5da99462d5 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:47:16.912778 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f2750ca1-6a46-4573-938f-bb5da99462d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:47:16.926060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2750ca1-6a46-4573-938f-bb5da99462d5 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:47:16.980667 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:47:16.995230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280216dd-2b44-4fc8-897b-f332e651aed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:47:16.995917 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280216dd-2b44-4fc8-897b-f332e651aed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:16.996558 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280216dd-2b44-4fc8-897b-f332e651aed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:16.996964 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280216dd-2b44-4fc8-897b-f332e651aed2 admin admin] PATH_INFO: `/v3/users/d3464b09124348b1a1e315d23fd7ec63` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:16.998713 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280216dd-2b44-4fc8-897b-f332e651aed2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3464b09124348b1a1e315d23fd7ec63)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:47:17.000910 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280216dd-2b44-4fc8-897b-f332e651aed2 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:47:17.075899 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-280216dd-2b44-4fc8-897b-f332e651aed2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3464b09124348b1a1e315d23fd7ec63'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:47:17.085378 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-280216dd-2b44-4fc8-897b-f332e651aed2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3464b09124348b1a1e315d23fd7ec63'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:47:17.102926 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-280216dd-2b44-4fc8-897b-f332e651aed2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3464b09124348b1a1e315d23fd7ec63'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:47:17.104032 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-280216dd-2b44-4fc8-897b-f332e651aed2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3464b09124348b1a1e315d23fd7ec63'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:47:17.111649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-280216dd-2b44-4fc8-897b-f332e651aed2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3464b09124348b1a1e315d23fd7ec63'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:47:17.117750 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1166/2335] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:47:16 2022] DELETE /identity/v3/users/d3464b09124348b1a1e315d23fd7ec63 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:47:17.319645 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fefd028-fac4-44b8-bc76-445a6802dee6 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:47:17.321291 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6fefd028-fac4-44b8-bc76-445a6802dee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:47:17.337026 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fefd028-fac4-44b8-bc76-445a6802dee6 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:47:17.394793 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:47:17.409263 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3049c00-61e0-44d2-9772-10c0c7f8740f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:47:17.409934 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3049c00-61e0-44d2-9772-10c0c7f8740f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:17.410208 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3049c00-61e0-44d2-9772-10c0c7f8740f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:17.410501 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3049c00-61e0-44d2-9772-10c0c7f8740f admin admin] PATH_INFO: `/v3/projects/4fed9f59d1b8408ca185f8a2f683994d` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:17.411641 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3049c00-61e0-44d2-9772-10c0c7f8740f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fed9f59d1b8408ca185f8a2f683994d)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:47:17.413572 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3049c00-61e0-44d2-9772-10c0c7f8740f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:47:17.461452 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a3049c00-61e0-44d2-9772-10c0c7f8740f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fed9f59d1b8408ca185f8a2f683994d', 'request_id': 'req-a3049c00-61e0-44d2-9772-10c0c7f8740f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:47:17.467419 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a3049c00-61e0-44d2-9772-10c0c7f8740f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fed9f59d1b8408ca185f8a2f683994d', 'request_id': 'req-a3049c00-61e0-44d2-9772-10c0c7f8740f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:47:17.473819 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a3049c00-61e0-44d2-9772-10c0c7f8740f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fed9f59d1b8408ca185f8a2f683994d', 'request_id': 'req-a3049c00-61e0-44d2-9772-10c0c7f8740f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:47:17.489796 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a3049c00-61e0-44d2-9772-10c0c7f8740f admin admin] The token cache is being invalidate because project 4fed9f59d1b8408ca185f8a2f683994d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:47:17.490087 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a3049c00-61e0-44d2-9772-10c0c7f8740f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:47:17.490735 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-a3049c00-61e0-44d2-9772-10c0c7f8740f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:47:17.492290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1170/2336] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:47:17 2022] DELETE /identity/v3/projects/4fed9f59d1b8408ca185f8a2f683994d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:47:17.497410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5d293-ec3f-4a1e-aa39-6be43a281560 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:17.497697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5d293-ec3f-4a1e-aa39-6be43a281560 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:17.497972 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5d293-ec3f-4a1e-aa39-6be43a281560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:17.519435 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-8aa5d293-ec3f-4a1e-aa39-6be43a281560 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:47:17.520699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-8aa5d293-ec3f-4a1e-aa39-6be43a281560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:47:17.607434 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1167/2337] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:47:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:47:17.615939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350dea1-7ac4-4a7b-aa8d-b23ec74c986e None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:17.616241 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350dea1-7ac4-4a7b-aa8d-b23ec74c986e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:17.616477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350dea1-7ac4-4a7b-aa8d-b23ec74c986e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:17.645792 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-7350dea1-7ac4-4a7b-aa8d-b23ec74c986e None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:47:17.647706 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7350dea1-7ac4-4a7b-aa8d-b23ec74c986e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:47:17.657275 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1171/2338] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:47:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:47:17.661773 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5d293-ec3f-4a1e-aa39-6be43a281560 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:47:17.674531 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5d293-ec3f-4a1e-aa39-6be43a281560 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:47:17.679669 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5245676-ee99-44a5-b80c-228291c7cf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:47:17.680528 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5245676-ee99-44a5-b80c-228291c7cf7a admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:17.680851 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5245676-ee99-44a5-b80c-228291c7cf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:17.681167 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5245676-ee99-44a5-b80c-228291c7cf7a admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:17.681856 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5245676-ee99-44a5-b80c-228291c7cf7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:47:17.682217 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5245676-ee99-44a5-b80c-228291c7cf7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:47:17.684066 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5245676-ee99-44a5-b80c-228291c7cf7a admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:47:17.731464 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1168/2339] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:47:17.737501 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350dea1-7ac4-4a7b-aa8d-b23ec74c986e None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:47:17.750299 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350dea1-7ac4-4a7b-aa8d-b23ec74c986e None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:47:17.765485 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f101ee-fdf1-4c38-be16-44d19b902374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:47:17.770574 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f101ee-fdf1-4c38-be16-44d19b902374 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:17.771499 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f101ee-fdf1-4c38-be16-44d19b902374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:17.772211 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f101ee-fdf1-4c38-be16-44d19b902374 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:17.773690 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f101ee-fdf1-4c38-be16-44d19b902374 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:47:17.775800 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f101ee-fdf1-4c38-be16-44d19b902374 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:47:17.809587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1172/2340] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:47:17 2022] POST /identity/v3/projects => generated 365 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:47:17.814523 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5245676-ee99-44a5-b80c-228291c7cf7a admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:47:17.825557 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5245676-ee99-44a5-b80c-228291c7cf7a admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:47:17.891278 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8411c6-f372-44b7-a226-b123ce01f08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:47:17.891937 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8411c6-f372-44b7-a226-b123ce01f08c admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:17.892213 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8411c6-f372-44b7-a226-b123ce01f08c admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:17.892492 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8411c6-f372-44b7-a226-b123ce01f08c admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:17.893139 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8411c6-f372-44b7-a226-b123ce01f08c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:47:17.895052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8411c6-f372-44b7-a226-b123ce01f08c admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:47:17.906218 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:47:17.928031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1169/2341] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:47:17 2022] POST /identity/v3/users => generated 283 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:47:17.937466 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f101ee-fdf1-4c38-be16-44d19b902374 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:47:17.948200 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f101ee-fdf1-4c38-be16-44d19b902374 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:47:17.954913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9d0e5-27c6-4169-b6fd-4888ac4c90c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:47:17.955605 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9d0e5-27c6-4169-b6fd-4888ac4c90c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:17.955960 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9d0e5-27c6-4169-b6fd-4888ac4c90c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:17.956238 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9d0e5-27c6-4169-b6fd-4888ac4c90c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:17.957000 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9d0e5-27c6-4169-b6fd-4888ac4c90c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:47:17.958818 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9d0e5-27c6-4169-b6fd-4888ac4c90c2 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:47:17.970028 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1173/2342] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:47:17.974120 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8411c6-f372-44b7-a226-b123ce01f08c admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:47:17.985878 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8411c6-f372-44b7-a226-b123ce01f08c admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:47:17.991044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8655709-1991-4924-8f15-b2bcd1d779f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:47:17.991667 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8655709-1991-4924-8f15-b2bcd1d779f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:17.991970 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8655709-1991-4924-8f15-b2bcd1d779f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:17.992233 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8655709-1991-4924-8f15-b2bcd1d779f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:17.992877 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8655709-1991-4924-8f15-b2bcd1d779f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:47:17.994714 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8655709-1991-4924-8f15-b2bcd1d779f6 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:47:18.006022 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1170/2343] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:47:18.010267 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9d0e5-27c6-4169-b6fd-4888ac4c90c2 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:47:18.020440 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9d0e5-27c6-4169-b6fd-4888ac4c90c2 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:47:18.025487 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d5bf0-716e-4e1a-97bc-8291c27ad901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:47:18.026171 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d5bf0-716e-4e1a-97bc-8291c27ad901 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:18.026718 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d5bf0-716e-4e1a-97bc-8291c27ad901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:18.026824 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d5bf0-716e-4e1a-97bc-8291c27ad901 admin admin] PATH_INFO: `/v3/projects/deefbac2cd2b4c2ca2efc566b55fd680/users/288e4f89991b4b38bb5956a6bfaf2cdd/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:18.042802 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d5bf0-716e-4e1a-97bc-8291c27ad901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=deefbac2cd2b4c2ca2efc566b55fd680, user_id=288e4f89991b4b38bb5956a6bfaf2cdd, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:47:18.045937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d5bf0-716e-4e1a-97bc-8291c27ad901 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:47:18.060708 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1174/2344] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:47:18 2022] PUT /identity/v3/projects/deefbac2cd2b4c2ca2efc566b55fd680/users/288e4f89991b4b38bb5956a6bfaf2cdd/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:47:18.071249 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50edec-0834-4912-bd00-174c35d4eb37 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:18.071503 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50edec-0834-4912-bd00-174c35d4eb37 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:18.072002 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50edec-0834-4912-bd00-174c35d4eb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:18.102103 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-2a50edec-0834-4912-bd00-174c35d4eb37 None None] MFA Rules not processed for user `288e4f89991b4b38bb5956a6bfaf2cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:47:18.103335 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2a50edec-0834-4912-bd00-174c35d4eb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:47:18.188606 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1171/2345] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:47:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:47:18.189909 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d5bf0-716e-4e1a-97bc-8291c27ad901 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:47:18.191947 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-549d5bf0-716e-4e1a-97bc-8291c27ad901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:47:18.196861 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50edec-0834-4912-bd00-174c35d4eb37 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:47:18.199930 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2a50edec-0834-4912-bd00-174c35d4eb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:47:18.258917 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50edec-0834-4912-bd00-174c35d4eb37 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:47:18.262608 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e7015-2d75-40d3-a827-99190ba3181e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:47:18.263218 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e7015-2d75-40d3-a827-99190ba3181e service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:18.263488 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e7015-2d75-40d3-a827-99190ba3181e service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:18.263765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e7015-2d75-40d3-a827-99190ba3181e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:18.266389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d5bf0-716e-4e1a-97bc-8291c27ad901 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:47:18.271235 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78a1e0-b450-4819-b449-618c5e297a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:47:18.271903 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78a1e0-b450-4819-b449-618c5e297a29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:18.272194 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78a1e0-b450-4819-b449-618c5e297a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:18.272434 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78a1e0-b450-4819-b449-618c5e297a29 admin admin] PATH_INFO: `/v3/users/867510e21fed4ac68228500d540081e5` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:18.272843 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e7015-2d75-40d3-a827-99190ba3181e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:47:18.273613 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78a1e0-b450-4819-b449-618c5e297a29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=867510e21fed4ac68228500d540081e5)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:47:18.274263 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e7015-2d75-40d3-a827-99190ba3181e service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:47:18.275580 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78a1e0-b450-4819-b449-618c5e297a29 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:47:18.284752 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1172/2346] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:47:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:47:18.292195 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:47:18.325547 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7b78a1e0-b450-4819-b449-618c5e297a29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '867510e21fed4ac68228500d540081e5'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:47:18.334216 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7b78a1e0-b450-4819-b449-618c5e297a29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '867510e21fed4ac68228500d540081e5'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:47:18.334865 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7b78a1e0-b450-4819-b449-618c5e297a29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '867510e21fed4ac68228500d540081e5'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:47:18.349086 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7b78a1e0-b450-4819-b449-618c5e297a29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '867510e21fed4ac68228500d540081e5'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:47:18.358032 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7b78a1e0-b450-4819-b449-618c5e297a29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '867510e21fed4ac68228500d540081e5'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:47:18.364226 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1175/2347] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:47:18 2022] DELETE /identity/v3/users/867510e21fed4ac68228500d540081e5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:47:18.587999 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e7015-2d75-40d3-a827-99190ba3181e service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:47:18.600110 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e7015-2d75-40d3-a827-99190ba3181e service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:47:18.699517 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810a751-71d0-4c34-9e7e-4c2c79cec663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:47:18.700140 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810a751-71d0-4c34-9e7e-4c2c79cec663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:18.700514 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810a751-71d0-4c34-9e7e-4c2c79cec663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:18.700678 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810a751-71d0-4c34-9e7e-4c2c79cec663 admin admin] PATH_INFO: `/v3/projects/2110ac49bfef4ae1a2852cb68416806c` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:18.701843 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3810a751-71d0-4c34-9e7e-4c2c79cec663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2110ac49bfef4ae1a2852cb68416806c)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:47:18.703799 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3810a751-71d0-4c34-9e7e-4c2c79cec663 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:47:18.727324 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:47:18.769168 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3810a751-71d0-4c34-9e7e-4c2c79cec663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2110ac49bfef4ae1a2852cb68416806c', 'request_id': 'req-3810a751-71d0-4c34-9e7e-4c2c79cec663'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:47:18.777673 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3810a751-71d0-4c34-9e7e-4c2c79cec663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2110ac49bfef4ae1a2852cb68416806c', 'request_id': 'req-3810a751-71d0-4c34-9e7e-4c2c79cec663'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:47:18.784357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3810a751-71d0-4c34-9e7e-4c2c79cec663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2110ac49bfef4ae1a2852cb68416806c', 'request_id': 'req-3810a751-71d0-4c34-9e7e-4c2c79cec663'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:47:18.796278 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3810a751-71d0-4c34-9e7e-4c2c79cec663 admin admin] The token cache is being invalidate because project 2110ac49bfef4ae1a2852cb68416806c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:47:18.796564 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3810a751-71d0-4c34-9e7e-4c2c79cec663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:47:18.797206 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3810a751-71d0-4c34-9e7e-4c2c79cec663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:47:18.798708 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1173/2348] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:47:18 2022] DELETE /identity/v3/projects/2110ac49bfef4ae1a2852cb68416806c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:47:18.803682 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ddf1d0-24bd-442e-8361-ff26cc8c9977 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:18.803987 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ddf1d0-24bd-442e-8361-ff26cc8c9977 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:18.804268 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ddf1d0-24bd-442e-8361-ff26cc8c9977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:18.827051 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-39ddf1d0-24bd-442e-8361-ff26cc8c9977 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:47:18.828343 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-39ddf1d0-24bd-442e-8361-ff26cc8c9977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:47:18.904933 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1176/2349] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:47:18.913137 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c62c2d-3f87-467d-98e8-deb60897cfe5 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:18.913416 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c62c2d-3f87-467d-98e8-deb60897cfe5 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:18.913679 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c62c2d-3f87-467d-98e8-deb60897cfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:18.934394 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-28c62c2d-3f87-467d-98e8-deb60897cfe5 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:47:18.935612 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-28c62c2d-3f87-467d-98e8-deb60897cfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:47:18.944695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1174/2350] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:47:18.949269 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ddf1d0-24bd-442e-8361-ff26cc8c9977 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:47:18.962198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ddf1d0-24bd-442e-8361-ff26cc8c9977 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:47:18.967650 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5e238-c875-489a-af35-8dd549152bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:47:18.968333 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5e238-c875-489a-af35-8dd549152bcc admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:18.968878 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5e238-c875-489a-af35-8dd549152bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:18.969157 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5e238-c875-489a-af35-8dd549152bcc admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:18.969805 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5e238-c875-489a-af35-8dd549152bcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:47:18.970104 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5e238-c875-489a-af35-8dd549152bcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:47:18.971755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e5e238-c875-489a-af35-8dd549152bcc admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:47:18.995270 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1177/2351] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:47:18.999881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c62c2d-3f87-467d-98e8-deb60897cfe5 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:47:19.011254 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c62c2d-3f87-467d-98e8-deb60897cfe5 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:47:19.017406 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a0f50-52ef-433f-8a40-656d1c62981e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:47:19.018201 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a0f50-52ef-433f-8a40-656d1c62981e admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:19.018363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a0f50-52ef-433f-8a40-656d1c62981e admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:19.018641 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a0f50-52ef-433f-8a40-656d1c62981e admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:19.019338 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a0f50-52ef-433f-8a40-656d1c62981e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:47:19.021247 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a0f50-52ef-433f-8a40-656d1c62981e admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:47:19.052931 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1175/2352] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:47:18 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:47:19.057442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5e238-c875-489a-af35-8dd549152bcc admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:47:19.069831 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5e238-c875-489a-af35-8dd549152bcc admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:47:19.136543 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb90eb-515f-4282-bc95-2b3b375d9684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:47:19.137169 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb90eb-515f-4282-bc95-2b3b375d9684 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:19.137445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb90eb-515f-4282-bc95-2b3b375d9684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:19.137712 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb90eb-515f-4282-bc95-2b3b375d9684 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:19.138346 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb90eb-515f-4282-bc95-2b3b375d9684 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:47:19.140303 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb90eb-515f-4282-bc95-2b3b375d9684 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:47:19.164021 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1178/2353] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:47:19 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:47:19.168706 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a0f50-52ef-433f-8a40-656d1c62981e admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:47:19.180996 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a0f50-52ef-433f-8a40-656d1c62981e admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:47:19.185933 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb076d4-110d-4fda-9131-3a54d70de734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:47:19.186597 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb076d4-110d-4fda-9131-3a54d70de734 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:19.186875 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb076d4-110d-4fda-9131-3a54d70de734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:19.187151 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb076d4-110d-4fda-9131-3a54d70de734 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:19.187868 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb076d4-110d-4fda-9131-3a54d70de734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:47:19.189474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb076d4-110d-4fda-9131-3a54d70de734 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:47:19.200199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1176/2354] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:47:19.204359 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb90eb-515f-4282-bc95-2b3b375d9684 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:47:19.214737 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb90eb-515f-4282-bc95-2b3b375d9684 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:47:19.219858 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108abccb-0619-4d7d-b55d-e266392727d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:47:19.220472 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108abccb-0619-4d7d-b55d-e266392727d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:19.220745 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108abccb-0619-4d7d-b55d-e266392727d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:19.221012 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108abccb-0619-4d7d-b55d-e266392727d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:19.221657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108abccb-0619-4d7d-b55d-e266392727d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:47:19.223265 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108abccb-0619-4d7d-b55d-e266392727d6 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:47:19.228907 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:47:19.235098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1179/2355] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:47:19.239923 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb076d4-110d-4fda-9131-3a54d70de734 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:47:19.249927 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb076d4-110d-4fda-9131-3a54d70de734 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:47:19.254652 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817007b-0ba8-4744-bbd2-820cf803fd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:47:19.255308 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817007b-0ba8-4744-bbd2-820cf803fd91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:19.255579 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817007b-0ba8-4744-bbd2-820cf803fd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:19.255887 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817007b-0ba8-4744-bbd2-820cf803fd91 admin admin] PATH_INFO: `/v3/projects/4b28e068c53f4d1eb2c62a6559615c35/users/5977a64fd7554c968abf7fcf8b7ff2a2/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:19.270964 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817007b-0ba8-4744-bbd2-820cf803fd91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b28e068c53f4d1eb2c62a6559615c35, user_id=5977a64fd7554c968abf7fcf8b7ff2a2, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:47:19.273568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817007b-0ba8-4744-bbd2-820cf803fd91 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:47:19.287600 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1177/2356] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:47:19 2022] PUT /identity/v3/projects/4b28e068c53f4d1eb2c62a6559615c35/users/5977a64fd7554c968abf7fcf8b7ff2a2/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:47:19.292751 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f80d76-4e4c-4137-a533-f21e2d4b516e None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:19.293029 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f80d76-4e4c-4137-a533-f21e2d4b516e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:19.293295 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f80d76-4e4c-4137-a533-f21e2d4b516e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:19.313393 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-20f80d76-4e4c-4137-a533-f21e2d4b516e None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:47:19.314613 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-20f80d76-4e4c-4137-a533-f21e2d4b516e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:47:19.384549 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1180/2357] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:47:19.396030 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817007b-0ba8-4744-bbd2-820cf803fd91 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:47:19.398195 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c817007b-0ba8-4744-bbd2-820cf803fd91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:47:19.465524 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817007b-0ba8-4744-bbd2-820cf803fd91 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:47:19.469150 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc8bea7-4cce-4dc7-aa16-a0bbe1262734 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:47:19.469747 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc8bea7-4cce-4dc7-aa16-a0bbe1262734 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:19.470013 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc8bea7-4cce-4dc7-aa16-a0bbe1262734 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:19.470273 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc8bea7-4cce-4dc7-aa16-a0bbe1262734 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:19.480729 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc8bea7-4cce-4dc7-aa16-a0bbe1262734 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:47:19.482171 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc8bea7-4cce-4dc7-aa16-a0bbe1262734 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:47:19.492090 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1178/2358] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:47:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:47:20.217359 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad426a8-6221-4f7c-9925-c69be55876f8 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:20.218039 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad426a8-6221-4f7c-9925-c69be55876f8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:20.219170 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad426a8-6221-4f7c-9925-c69be55876f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:20.265985 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-2ad426a8-6221-4f7c-9925-c69be55876f8 None None] MFA Rules not processed for user `5977a64fd7554c968abf7fcf8b7ff2a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:47:20.267391 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2ad426a8-6221-4f7c-9925-c69be55876f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:47:20.436096 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1181/2359] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:47:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:47:20.444876 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc8bea7-4cce-4dc7-aa16-a0bbe1262734 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:47:20.447063 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5dc8bea7-4cce-4dc7-aa16-a0bbe1262734 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:47:20.500254 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:47:20.519142 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc8bea7-4cce-4dc7-aa16-a0bbe1262734 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:47:20.531809 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16f2a3-c20a-4250-bd5d-966126119afe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:47:20.534011 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16f2a3-c20a-4250-bd5d-966126119afe service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:20.534722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16f2a3-c20a-4250-bd5d-966126119afe service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:20.535648 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16f2a3-c20a-4250-bd5d-966126119afe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:20.553727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16f2a3-c20a-4250-bd5d-966126119afe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:47:20.556559 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16f2a3-c20a-4250-bd5d-966126119afe service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:47:20.583821 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1179/2360] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:47:20 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:47:21.992021 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7655951-1c5f-491c-a637-98e5cfc10fec None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:21.992867 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7655951-1c5f-491c-a637-98e5cfc10fec None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:21.992867 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7655951-1c5f-491c-a637-98e5cfc10fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:22.014034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-f7655951-1c5f-491c-a637-98e5cfc10fec None None] MFA Rules not processed for user `5977a64fd7554c968abf7fcf8b7ff2a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:47:22.015307 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f7655951-1c5f-491c-a637-98e5cfc10fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:47:22.022761 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1182/2361] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:47:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:47:30.571666 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=8 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:47:32.007885 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=62 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:47:42.372090 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699747d0-dd3a-452d-8611-a2609227ae19 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:42.372552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699747d0-dd3a-452d-8611-a2609227ae19 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:42.372552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699747d0-dd3a-452d-8611-a2609227ae19 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:42.373998 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1180/2362] 10.222.0.66 () {54 vars in 961 bytes} [Mon Sep 26 05:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:47:42.379230 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863ed46-636e-4989-a0a0-fd85c725c311 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:42.379700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863ed46-636e-4989-a0a0-fd85c725c311 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:42.379837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863ed46-636e-4989-a0a0-fd85c725c311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:42.402776 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-0863ed46-636e-4989-a0a0-fd85c725c311 None None] MFA Rules not processed for user `895edcfb20484b188a3877c9de8b59c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:47:42.404021 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0863ed46-636e-4989-a0a0-fd85c725c311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:47:42.469489 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1183/2363] 10.222.0.66 () {58 vars in 1058 bytes} [Mon Sep 26 05:47:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:47:42.477537 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699747d0-dd3a-452d-8611-a2609227ae19 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:47:42.493018 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699747d0-dd3a-452d-8611-a2609227ae19 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:47:42.498195 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78566f6c-461d-474c-859a-4e7dde25e86a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895edcfb20484b188a3877c9de8b59c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:47:42.498814 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78566f6c-461d-474c-859a-4e7dde25e86a service placement] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:42.499085 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78566f6c-461d-474c-859a-4e7dde25e86a service placement] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:42.499347 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78566f6c-461d-474c-859a-4e7dde25e86a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:42.501376 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-78566f6c-461d-474c-859a-4e7dde25e86a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:47:42.513152 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78566f6c-461d-474c-859a-4e7dde25e86a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:47:42.514799 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78566f6c-461d-474c-859a-4e7dde25e86a service placement] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:47:42.525597 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1181/2364] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:47:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:47:52.461192 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=29 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:47:52.521154 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=6 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:47:58.960171 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863ed46-636e-4989-a0a0-fd85c725c311 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:47:58.970290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863ed46-636e-4989-a0a0-fd85c725c311 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:47:58.974194 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39390ed0-036c-4914-9a1d-017e4e8863cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:47:58.974917 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39390ed0-036c-4914-9a1d-017e4e8863cb service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:47:58.975162 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39390ed0-036c-4914-9a1d-017e4e8863cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:47:58.975447 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39390ed0-036c-4914-9a1d-017e4e8863cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:47:58.977524 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-39390ed0-036c-4914-9a1d-017e4e8863cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:47:59.073123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39390ed0-036c-4914-9a1d-017e4e8863cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:47:59.075717 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39390ed0-036c-4914-9a1d-017e4e8863cb service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:47:59.090204 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1184/2365] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:47:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:48:09.021750 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e4b9b-d5a9-45eb-865c-aeb95a56ebf0 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:09.021750 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e4b9b-d5a9-45eb-865c-aeb95a56ebf0 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:09.022765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e4b9b-d5a9-45eb-865c-aeb95a56ebf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:09.043110 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-295e4b9b-d5a9-45eb-865c-aeb95a56ebf0 None None] MFA Rules not processed for user `9b19bf41fdb74cc4a8e0e048f86bf3c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:48:09.044370 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-295e4b9b-d5a9-45eb-865c-aeb95a56ebf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:09.082123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=30 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:48:09.109642 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1182/2366] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:48:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:48:13.194695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39390ed0-036c-4914-9a1d-017e4e8863cb service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:13.196210 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-39390ed0-036c-4914-9a1d-017e4e8863cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:13.210456 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39390ed0-036c-4914-9a1d-017e4e8863cb service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:13.215281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b1fcb-17c6-417a-a3be-f7965a5a4d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:13.216280 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b1fcb-17c6-417a-a3be-f7965a5a4d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:13.216612 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b1fcb-17c6-417a-a3be-f7965a5a4d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:13.216883 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b1fcb-17c6-417a-a3be-f7965a5a4d57 admin admin] PATH_INFO: `/v3/users/288e4f89991b4b38bb5956a6bfaf2cdd` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:13.218143 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b1fcb-17c6-417a-a3be-f7965a5a4d57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=288e4f89991b4b38bb5956a6bfaf2cdd)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:13.220086 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b1fcb-17c6-417a-a3be-f7965a5a4d57 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:13.287900 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-119b1fcb-17c6-417a-a3be-f7965a5a4d57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '288e4f89991b4b38bb5956a6bfaf2cdd'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:48:13.298566 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-119b1fcb-17c6-417a-a3be-f7965a5a4d57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '288e4f89991b4b38bb5956a6bfaf2cdd'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:48:13.299915 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-119b1fcb-17c6-417a-a3be-f7965a5a4d57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '288e4f89991b4b38bb5956a6bfaf2cdd'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:48:13.316339 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-119b1fcb-17c6-417a-a3be-f7965a5a4d57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '288e4f89991b4b38bb5956a6bfaf2cdd'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:48:13.325257 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-119b1fcb-17c6-417a-a3be-f7965a5a4d57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '288e4f89991b4b38bb5956a6bfaf2cdd'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:48:13.333428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1185/2367] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:48:13 2022] DELETE /identity/v3/users/288e4f89991b4b38bb5956a6bfaf2cdd => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:48:13.340674 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1a08c-8277-4895-acdf-c580f024188c None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:13.341069 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1a08c-8277-4895-acdf-c580f024188c None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:13.342854 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd1a08c-8277-4895-acdf-c580f024188c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:13.378315 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-dcd1a08c-8277-4895-acdf-c580f024188c None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:48:13.380316 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-dcd1a08c-8277-4895-acdf-c580f024188c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:13.508120 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1183/2368] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:48:13.518344 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b1fcb-17c6-417a-a3be-f7965a5a4d57 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:13.519845 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-119b1fcb-17c6-417a-a3be-f7965a5a4d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:13.636887 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b1fcb-17c6-417a-a3be-f7965a5a4d57 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:13.647406 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8aaba4-67e1-40ad-bf2a-942437d70224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:13.648099 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8aaba4-67e1-40ad-bf2a-942437d70224 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:13.648380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8aaba4-67e1-40ad-bf2a-942437d70224 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:13.648649 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8aaba4-67e1-40ad-bf2a-942437d70224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:13.664216 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8aaba4-67e1-40ad-bf2a-942437d70224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:13.666409 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8aaba4-67e1-40ad-bf2a-942437d70224 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:13.682612 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1186/2369] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:48:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:48:14.143434 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1a08c-8277-4895-acdf-c580f024188c None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:14.146148 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-dcd1a08c-8277-4895-acdf-c580f024188c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:14.167825 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd1a08c-8277-4895-acdf-c580f024188c None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:14.174517 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f74d5-919f-4c63-8917-b8b19266395a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:14.175170 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f74d5-919f-4c63-8917-b8b19266395a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:14.175330 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f74d5-919f-4c63-8917-b8b19266395a admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:14.175558 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f74d5-919f-4c63-8917-b8b19266395a admin admin] PATH_INFO: `/v3/projects/deefbac2cd2b4c2ca2efc566b55fd680` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:14.177272 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f74d5-919f-4c63-8917-b8b19266395a admin admin] RBAC: Authorizing `identity:delete_project(project_id=deefbac2cd2b4c2ca2efc566b55fd680)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:14.179184 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f74d5-919f-4c63-8917-b8b19266395a admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:14.241712 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3a9f74d5-919f-4c63-8917-b8b19266395a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deefbac2cd2b4c2ca2efc566b55fd680', 'request_id': 'req-3a9f74d5-919f-4c63-8917-b8b19266395a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:48:14.254022 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3a9f74d5-919f-4c63-8917-b8b19266395a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deefbac2cd2b4c2ca2efc566b55fd680', 'request_id': 'req-3a9f74d5-919f-4c63-8917-b8b19266395a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:48:14.266785 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3a9f74d5-919f-4c63-8917-b8b19266395a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deefbac2cd2b4c2ca2efc566b55fd680', 'request_id': 'req-3a9f74d5-919f-4c63-8917-b8b19266395a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:48:14.288579 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3a9f74d5-919f-4c63-8917-b8b19266395a admin admin] The token cache is being invalidate because project deefbac2cd2b4c2ca2efc566b55fd680 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:48:14.289059 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3a9f74d5-919f-4c63-8917-b8b19266395a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:48:14.290115 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3a9f74d5-919f-4c63-8917-b8b19266395a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:48:14.293028 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1184/2370] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:48:14 2022] DELETE /identity/v3/projects/deefbac2cd2b4c2ca2efc566b55fd680 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:48:14.300770 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4a8fb-1afd-4a47-a557-c368615d4917 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:14.301663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4a8fb-1afd-4a47-a557-c368615d4917 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:14.301663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d4a8fb-1afd-4a47-a557-c368615d4917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:14.327407 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-78d4a8fb-1afd-4a47-a557-c368615d4917 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:48:14.329272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-78d4a8fb-1afd-4a47-a557-c368615d4917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:14.408433 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1187/2371] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:48:14.416922 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980969b-d496-4679-be49-ca3a2e1176eb None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:14.417485 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980969b-d496-4679-be49-ca3a2e1176eb None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:14.417653 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980969b-d496-4679-be49-ca3a2e1176eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:14.449586 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-8980969b-d496-4679-be49-ca3a2e1176eb None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:48:14.452410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-8980969b-d496-4679-be49-ca3a2e1176eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:14.467841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1185/2372] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:48:14.473033 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4a8fb-1afd-4a47-a557-c368615d4917 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:14.486948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d4a8fb-1afd-4a47-a557-c368615d4917 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:14.493949 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1cb26-6c81-4353-8fe9-26fba5f271dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:14.494887 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1cb26-6c81-4353-8fe9-26fba5f271dd admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:14.495351 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1cb26-6c81-4353-8fe9-26fba5f271dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:14.495846 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1cb26-6c81-4353-8fe9-26fba5f271dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:14.497030 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1cb26-6c81-4353-8fe9-26fba5f271dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:48:14.497436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1cb26-6c81-4353-8fe9-26fba5f271dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:14.499535 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1cb26-6c81-4353-8fe9-26fba5f271dd admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:14.523522 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1188/2373] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:48:14.528756 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980969b-d496-4679-be49-ca3a2e1176eb None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:14.541060 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980969b-d496-4679-be49-ca3a2e1176eb None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:14.547211 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95aa24-6315-4c44-b3a3-fd9c5b372dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:14.548086 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95aa24-6315-4c44-b3a3-fd9c5b372dd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:14.548478 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95aa24-6315-4c44-b3a3-fd9c5b372dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:14.548813 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95aa24-6315-4c44-b3a3-fd9c5b372dd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:14.549537 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95aa24-6315-4c44-b3a3-fd9c5b372dd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:14.552115 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95aa24-6315-4c44-b3a3-fd9c5b372dd1 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:14.582767 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:48:14.599671 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1186/2374] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:48:14 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:48:14.605293 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1cb26-6c81-4353-8fe9-26fba5f271dd admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:14.611096 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:48:14.618608 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1cb26-6c81-4353-8fe9-26fba5f271dd admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:14.725181 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d70829-b03c-4a03-825c-eeb02e3a0483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:14.725951 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d70829-b03c-4a03-825c-eeb02e3a0483 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:14.726327 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d70829-b03c-4a03-825c-eeb02e3a0483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:14.726643 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d70829-b03c-4a03-825c-eeb02e3a0483 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:14.727453 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d70829-b03c-4a03-825c-eeb02e3a0483 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:14.730341 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d70829-b03c-4a03-825c-eeb02e3a0483 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:14.758072 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1189/2375] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:48:14 2022] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:48:14.762608 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95aa24-6315-4c44-b3a3-fd9c5b372dd1 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:14.783636 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95aa24-6315-4c44-b3a3-fd9c5b372dd1 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:14.789201 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041c2d8-a05a-4dff-9f49-48a61c2f18c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:14.790423 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041c2d8-a05a-4dff-9f49-48a61c2f18c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:14.790768 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041c2d8-a05a-4dff-9f49-48a61c2f18c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:14.791106 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041c2d8-a05a-4dff-9f49-48a61c2f18c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:14.792250 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041c2d8-a05a-4dff-9f49-48a61c2f18c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:14.794365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9041c2d8-a05a-4dff-9f49-48a61c2f18c2 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:14.806264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1187/2376] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:48:14.811030 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d70829-b03c-4a03-825c-eeb02e3a0483 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:14.829594 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d70829-b03c-4a03-825c-eeb02e3a0483 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:14.834639 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0159abb7-17f5-4165-986e-f401b98771ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:14.835251 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159abb7-17f5-4165-986e-f401b98771ee admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:14.835527 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159abb7-17f5-4165-986e-f401b98771ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:14.835823 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0159abb7-17f5-4165-986e-f401b98771ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:14.836468 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0159abb7-17f5-4165-986e-f401b98771ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:14.838088 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0159abb7-17f5-4165-986e-f401b98771ee admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:14.856190 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1190/2377] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:48:14.860541 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041c2d8-a05a-4dff-9f49-48a61c2f18c2 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:14.872128 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041c2d8-a05a-4dff-9f49-48a61c2f18c2 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:14.878645 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b4f43-b586-4b54-9b97-32f38d788b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:14.879467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b4f43-b586-4b54-9b97-32f38d788b76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:14.880030 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b4f43-b586-4b54-9b97-32f38d788b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:14.880377 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b4f43-b586-4b54-9b97-32f38d788b76 admin admin] PATH_INFO: `/v3/projects/05c66edcee724315be7d53d29b8e1169/users/4269bbeb8bdd4b018c6abf0cce43333d/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:14.899850 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b4f43-b586-4b54-9b97-32f38d788b76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05c66edcee724315be7d53d29b8e1169, user_id=4269bbeb8bdd4b018c6abf0cce43333d, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:14.902538 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b4f43-b586-4b54-9b97-32f38d788b76 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:14.922431 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1188/2378] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:48:14 2022] PUT /identity/v3/projects/05c66edcee724315be7d53d29b8e1169/users/4269bbeb8bdd4b018c6abf0cce43333d/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:48:14.940223 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecb748-4100-426f-b001-c4baa81a0b24 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:14.940712 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecb748-4100-426f-b001-c4baa81a0b24 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:14.941214 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecb748-4100-426f-b001-c4baa81a0b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:14.989805 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-dcecb748-4100-426f-b001-c4baa81a0b24 None None] MFA Rules not processed for user `4269bbeb8bdd4b018c6abf0cce43333d`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:48:14.991125 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-dcecb748-4100-426f-b001-c4baa81a0b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:15.096024 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1191/2379] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:48:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:48:15.106244 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b4f43-b586-4b54-9b97-32f38d788b76 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:15.108319 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-9b9b4f43-b586-4b54-9b97-32f38d788b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:15.185117 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b4f43-b586-4b54-9b97-32f38d788b76 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:15.190126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab1192-cfff-468a-842c-acf64f54e482 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:15.190854 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab1192-cfff-468a-842c-acf64f54e482 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:15.191191 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab1192-cfff-468a-842c-acf64f54e482 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:15.191946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab1192-cfff-468a-842c-acf64f54e482 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:15.201497 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab1192-cfff-468a-842c-acf64f54e482 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:15.202953 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab1192-cfff-468a-842c-acf64f54e482 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:15.213865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1189/2380] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:48:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:48:15.239811 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecb748-4100-426f-b001-c4baa81a0b24 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:15.314907 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecb748-4100-426f-b001-c4baa81a0b24 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:15.320598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9d6cb-9502-4292-90a9-6015f424b87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:15.322017 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9d6cb-9502-4292-90a9-6015f424b87e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:15.322369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9d6cb-9502-4292-90a9-6015f424b87e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:15.322705 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b9d6cb-9502-4292-90a9-6015f424b87e admin admin] PATH_INFO: `/v3/users/4269bbeb8bdd4b018c6abf0cce43333d` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:15.324100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9d6cb-9502-4292-90a9-6015f424b87e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4269bbeb8bdd4b018c6abf0cce43333d)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:15.326301 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b9d6cb-9502-4292-90a9-6015f424b87e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:15.343225 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:48:15.390917 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d9b9d6cb-9502-4292-90a9-6015f424b87e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4269bbeb8bdd4b018c6abf0cce43333d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:48:15.399460 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d9b9d6cb-9502-4292-90a9-6015f424b87e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4269bbeb8bdd4b018c6abf0cce43333d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:48:15.400101 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d9b9d6cb-9502-4292-90a9-6015f424b87e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4269bbeb8bdd4b018c6abf0cce43333d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:48:15.413739 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d9b9d6cb-9502-4292-90a9-6015f424b87e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4269bbeb8bdd4b018c6abf0cce43333d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:48:15.422775 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d9b9d6cb-9502-4292-90a9-6015f424b87e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4269bbeb8bdd4b018c6abf0cce43333d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:48:15.430507 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1192/2381] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:48:15 2022] DELETE /identity/v3/users/4269bbeb8bdd4b018c6abf0cce43333d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:48:15.435262 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b444268-dd4e-481b-ab64-0965409fd892 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:15.436135 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b444268-dd4e-481b-ab64-0965409fd892 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:15.436135 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b444268-dd4e-481b-ab64-0965409fd892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:15.457002 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-3b444268-dd4e-481b-ab64-0965409fd892 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:48:15.458223 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-3b444268-dd4e-481b-ab64-0965409fd892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:15.534356 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1190/2382] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:48:15.544869 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9d6cb-9502-4292-90a9-6015f424b87e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:15.546479 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d9b9d6cb-9502-4292-90a9-6015f424b87e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:15.623688 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b9d6cb-9502-4292-90a9-6015f424b87e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:15.628007 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00d664-160c-4a5d-bfdd-83fac6bf70d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:15.628691 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00d664-160c-4a5d-bfdd-83fac6bf70d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:15.629011 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00d664-160c-4a5d-bfdd-83fac6bf70d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:15.629423 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00d664-160c-4a5d-bfdd-83fac6bf70d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:15.639943 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00d664-160c-4a5d-bfdd-83fac6bf70d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:15.641408 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00d664-160c-4a5d-bfdd-83fac6bf70d0 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:15.651999 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1193/2383] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:48:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:48:16.062036 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b444268-dd4e-481b-ab64-0965409fd892 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:16.064316 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-3b444268-dd4e-481b-ab64-0965409fd892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:16.088661 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b444268-dd4e-481b-ab64-0965409fd892 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:16.098179 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1284bb-231d-4f98-8811-b4c795eacde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:16.099609 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1284bb-231d-4f98-8811-b4c795eacde2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:16.100271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1284bb-231d-4f98-8811-b4c795eacde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:16.100806 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1284bb-231d-4f98-8811-b4c795eacde2 admin admin] PATH_INFO: `/v3/projects/05c66edcee724315be7d53d29b8e1169` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:16.102964 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1284bb-231d-4f98-8811-b4c795eacde2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05c66edcee724315be7d53d29b8e1169)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:16.106817 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1284bb-231d-4f98-8811-b4c795eacde2 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:16.177489 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-ca1284bb-231d-4f98-8811-b4c795eacde2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05c66edcee724315be7d53d29b8e1169', 'request_id': 'req-ca1284bb-231d-4f98-8811-b4c795eacde2'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:48:16.188046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-ca1284bb-231d-4f98-8811-b4c795eacde2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05c66edcee724315be7d53d29b8e1169', 'request_id': 'req-ca1284bb-231d-4f98-8811-b4c795eacde2'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:48:16.198734 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:48:16.202657 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-ca1284bb-231d-4f98-8811-b4c795eacde2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05c66edcee724315be7d53d29b8e1169', 'request_id': 'req-ca1284bb-231d-4f98-8811-b4c795eacde2'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:48:16.219777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-ca1284bb-231d-4f98-8811-b4c795eacde2 admin admin] The token cache is being invalidate because project 05c66edcee724315be7d53d29b8e1169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:48:16.220596 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-ca1284bb-231d-4f98-8811-b4c795eacde2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:48:16.221648 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-ca1284bb-231d-4f98-8811-b4c795eacde2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:48:16.223553 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1191/2384] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:48:16 2022] DELETE /identity/v3/projects/05c66edcee724315be7d53d29b8e1169 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:48:16.230144 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfcf37-f12b-4583-91d6-99be8466272b None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:16.230697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfcf37-f12b-4583-91d6-99be8466272b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:16.230969 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfcf37-f12b-4583-91d6-99be8466272b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:16.264292 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-25dfcf37-f12b-4583-91d6-99be8466272b None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:48:16.265560 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-25dfcf37-f12b-4583-91d6-99be8466272b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:16.355783 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1194/2385] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:48:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:48:16.427697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa13fa-57f1-4a14-a3f2-bede015098b8 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:16.428137 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa13fa-57f1-4a14-a3f2-bede015098b8 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:16.428472 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa13fa-57f1-4a14-a3f2-bede015098b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:16.452965 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-c6fa13fa-57f1-4a14-a3f2-bede015098b8 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:48:16.454203 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c6fa13fa-57f1-4a14-a3f2-bede015098b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:16.463807 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1192/2386] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:48:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:48:16.467960 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfcf37-f12b-4583-91d6-99be8466272b None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:16.478177 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dfcf37-f12b-4583-91d6-99be8466272b None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:16.482780 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050b7b4-0471-4122-a715-044bb895e706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:16.483403 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050b7b4-0471-4122-a715-044bb895e706 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:16.483677 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050b7b4-0471-4122-a715-044bb895e706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:16.483970 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050b7b4-0471-4122-a715-044bb895e706 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:16.484622 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050b7b4-0471-4122-a715-044bb895e706 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:48:16.484920 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050b7b4-0471-4122-a715-044bb895e706 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:16.486535 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050b7b4-0471-4122-a715-044bb895e706 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:16.499661 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1195/2387] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:48:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:48:16.507344 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa13fa-57f1-4a14-a3f2-bede015098b8 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:16.521430 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa13fa-57f1-4a14-a3f2-bede015098b8 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:16.526148 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee0d4d-4dac-4e52-9f8e-94cc9e3473a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:16.526780 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee0d4d-4dac-4e52-9f8e-94cc9e3473a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:16.527065 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee0d4d-4dac-4e52-9f8e-94cc9e3473a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:16.527335 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ee0d4d-4dac-4e52-9f8e-94cc9e3473a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:16.528656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee0d4d-4dac-4e52-9f8e-94cc9e3473a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:16.530856 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ee0d4d-4dac-4e52-9f8e-94cc9e3473a4 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:16.562132 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1193/2388] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:48:16 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:48:16.566559 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050b7b4-0471-4122-a715-044bb895e706 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:16.577220 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050b7b4-0471-4122-a715-044bb895e706 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:16.595264 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:48:16.640483 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f8060-7bae-46d8-bf0a-f44d18902263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:16.641101 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f8060-7bae-46d8-bf0a-f44d18902263 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:16.641361 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f8060-7bae-46d8-bf0a-f44d18902263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:16.641631 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f8060-7bae-46d8-bf0a-f44d18902263 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:16.642280 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f8060-7bae-46d8-bf0a-f44d18902263 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:16.644257 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f8060-7bae-46d8-bf0a-f44d18902263 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:16.667472 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1196/2389] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:48:16 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:48:16.672426 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee0d4d-4dac-4e52-9f8e-94cc9e3473a4 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:16.683692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ee0d4d-4dac-4e52-9f8e-94cc9e3473a4 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:16.688844 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076163ce-40fd-4fd5-8ac8-35207f1cc1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:16.689463 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076163ce-40fd-4fd5-8ac8-35207f1cc1ef admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:16.689732 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076163ce-40fd-4fd5-8ac8-35207f1cc1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:16.689992 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076163ce-40fd-4fd5-8ac8-35207f1cc1ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:16.690633 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076163ce-40fd-4fd5-8ac8-35207f1cc1ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:16.692265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076163ce-40fd-4fd5-8ac8-35207f1cc1ef admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:16.703582 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1194/2390] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:48:16.709652 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f8060-7bae-46d8-bf0a-f44d18902263 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:16.719950 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f8060-7bae-46d8-bf0a-f44d18902263 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:16.725568 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614bc468-c45f-4b22-bd02-f1e0b6d459f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:16.726170 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bc468-c45f-4b22-bd02-f1e0b6d459f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:16.726449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bc468-c45f-4b22-bd02-f1e0b6d459f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:16.726722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bc468-c45f-4b22-bd02-f1e0b6d459f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:16.727391 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614bc468-c45f-4b22-bd02-f1e0b6d459f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:16.729251 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614bc468-c45f-4b22-bd02-f1e0b6d459f1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:16.741874 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1197/2391] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:48:16.746353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076163ce-40fd-4fd5-8ac8-35207f1cc1ef admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:16.757568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076163ce-40fd-4fd5-8ac8-35207f1cc1ef admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:16.762637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74a384-fe61-4a39-b51a-a01b7b544c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:16.763325 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74a384-fe61-4a39-b51a-a01b7b544c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:16.763619 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74a384-fe61-4a39-b51a-a01b7b544c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:16.764004 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74a384-fe61-4a39-b51a-a01b7b544c63 admin admin] PATH_INFO: `/v3/projects/42b0dcbbd1f24a18bd94e815463513f8/users/eedcfe775589443aa2ff4379f8ddc9b7/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:16.782381 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74a384-fe61-4a39-b51a-a01b7b544c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42b0dcbbd1f24a18bd94e815463513f8, user_id=eedcfe775589443aa2ff4379f8ddc9b7, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:16.785661 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74a384-fe61-4a39-b51a-a01b7b544c63 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:16.802909 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1195/2392] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:48:16 2022] PUT /identity/v3/projects/42b0dcbbd1f24a18bd94e815463513f8/users/eedcfe775589443aa2ff4379f8ddc9b7/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:48:16.814809 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c471720-8852-4502-8eec-0de426164056 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:16.815085 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c471720-8852-4502-8eec-0de426164056 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:16.815357 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c471720-8852-4502-8eec-0de426164056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:16.847714 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-0c471720-8852-4502-8eec-0de426164056 None None] MFA Rules not processed for user `eedcfe775589443aa2ff4379f8ddc9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:48:16.849024 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0c471720-8852-4502-8eec-0de426164056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:16.921859 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1198/2393] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:48:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:48:16.934611 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74a384-fe61-4a39-b51a-a01b7b544c63 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:16.937505 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ee74a384-fe61-4a39-b51a-a01b7b544c63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:17.015256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74a384-fe61-4a39-b51a-a01b7b544c63 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:17.020588 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31780a2d-d4dd-4f06-b3a9-ec9293e8e3f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:17.021611 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31780a2d-d4dd-4f06-b3a9-ec9293e8e3f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:17.021970 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31780a2d-d4dd-4f06-b3a9-ec9293e8e3f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:17.022376 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31780a2d-d4dd-4f06-b3a9-ec9293e8e3f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:17.034687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31780a2d-d4dd-4f06-b3a9-ec9293e8e3f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:17.037616 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31780a2d-d4dd-4f06-b3a9-ec9293e8e3f0 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:17.056081 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1196/2394] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:48:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:48:19.594740 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd7492-800d-4c97-9c14-7d9920033189 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:19.595420 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd7492-800d-4c97-9c14-7d9920033189 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:19.595420 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd7492-800d-4c97-9c14-7d9920033189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:19.615625 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-dbcd7492-800d-4c97-9c14-7d9920033189 None None] MFA Rules not processed for user `eedcfe775589443aa2ff4379f8ddc9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:48:19.617562 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-dbcd7492-800d-4c97-9c14-7d9920033189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:19.627790 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1199/2395] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:48:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:48:23.683479 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3920d-91df-49e1-bf44-4a5e9c320207 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:23.684021 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3920d-91df-49e1-bf44-4a5e9c320207 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:23.684021 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3920d-91df-49e1-bf44-4a5e9c320207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:23.705143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-1bb3920d-91df-49e1-bf44-4a5e9c320207 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:48:23.706915 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1bb3920d-91df-49e1-bf44-4a5e9c320207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:23.771481 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1197/2396] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Sep 26 05:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:48:23.807943 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd7492-800d-4c97-9c14-7d9920033189 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:23.809468 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-dbcd7492-800d-4c97-9c14-7d9920033189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:23.892545 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd7492-800d-4c97-9c14-7d9920033189 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:23.900715 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3e6a4-21b4-477f-a374-81db91f6b0d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:23.901673 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3e6a4-21b4-477f-a374-81db91f6b0d1 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:23.902165 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3e6a4-21b4-477f-a374-81db91f6b0d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:23.902556 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3e6a4-21b4-477f-a374-81db91f6b0d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:23.917272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3e6a4-21b4-477f-a374-81db91f6b0d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:23.919929 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3e6a4-21b4-477f-a374-81db91f6b0d1 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:23.929838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1200/2397] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:48:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:48:28.240562 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e4391-dbbe-474e-ac3c-37109e2a9b19 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:28.241052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e4391-dbbe-474e-ac3c-37109e2a9b19 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:28.241149 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e4391-dbbe-474e-ac3c-37109e2a9b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:28.266536 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-473e4391-dbbe-474e-ac3c-37109e2a9b19 None None] MFA Rules not processed for user `5bdaf32400b94aa291ad43a3131e1d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:48:28.268020 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-473e4391-dbbe-474e-ac3c-37109e2a9b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:28.305421 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:48:28.345796 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1198/2398] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Sep 26 05:48:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:48:28.407721 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3e6a4-21b4-477f-a374-81db91f6b0d1 service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:28.409390 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-93f3e6a4-21b4-477f-a374-81db91f6b0d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:28.428955 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:48:28.502909 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3e6a4-21b4-477f-a374-81db91f6b0d1 service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:28.508916 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4249819-91ce-4c4e-9f71-a5ed9de6824d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '830cd52ac42548b2ade17b5215aefd28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:28.510297 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4249819-91ce-4c4e-9f71-a5ed9de6824d service swift] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:28.510581 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4249819-91ce-4c4e-9f71-a5ed9de6824d service swift] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:28.510984 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4249819-91ce-4c4e-9f71-a5ed9de6824d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:28.520600 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4249819-91ce-4c4e-9f71-a5ed9de6824d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:28.522314 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4249819-91ce-4c4e-9f71-a5ed9de6824d service swift] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:28.531211 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1201/2399] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 26 05:48:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 05:48:30.084262 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5919f24-e9a3-401a-9c17-dc6b742d6ec2 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:30.085818 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5919f24-e9a3-401a-9c17-dc6b742d6ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:30.086287 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5919f24-e9a3-401a-9c17-dc6b742d6ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:30.128759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-c5919f24-e9a3-401a-9c17-dc6b742d6ec2 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:48:30.141341 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c5919f24-e9a3-401a-9c17-dc6b742d6ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:30.154728 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1199/2400] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Sep 26 05:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:48:30.177474 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4249819-91ce-4c4e-9f71-a5ed9de6824d service swift] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:30.192925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4249819-91ce-4c4e-9f71-a5ed9de6824d service swift] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:30.204830 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2ec9a-745e-4f65-9b06-171d17afd840 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:30.205855 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2ec9a-745e-4f65-9b06-171d17afd840 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:30.206284 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2ec9a-745e-4f65-9b06-171d17afd840 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:30.206699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2ec9a-745e-4f65-9b06-171d17afd840 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:30.221136 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2ec9a-745e-4f65-9b06-171d17afd840 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:30.222866 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2ec9a-745e-4f65-9b06-171d17afd840 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:30.234875 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1202/2401] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:48:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:48:38.624882 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f25bd8-b822-4252-8ee1-2ebec4eae7fb None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:38.625516 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f25bd8-b822-4252-8ee1-2ebec4eae7fb None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:38.625516 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f25bd8-b822-4252-8ee1-2ebec4eae7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:38.650074 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-36f25bd8-b822-4252-8ee1-2ebec4eae7fb None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:48:38.656225 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-36f25bd8-b822-4252-8ee1-2ebec4eae7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:38.669989 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1200/2402] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Sep 26 05:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:48:38.692248 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2ec9a-745e-4f65-9b06-171d17afd840 service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:38.693789 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3ce2ec9a-745e-4f65-9b06-171d17afd840 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:38.719404 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2ec9a-745e-4f65-9b06-171d17afd840 service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:38.727006 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454be8ee-a15b-4534-a2ab-6bdac6f222cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:38.727641 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454be8ee-a15b-4534-a2ab-6bdac6f222cc service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:38.727953 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454be8ee-a15b-4534-a2ab-6bdac6f222cc service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:38.728224 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454be8ee-a15b-4534-a2ab-6bdac6f222cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:38.740825 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454be8ee-a15b-4534-a2ab-6bdac6f222cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:38.744104 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454be8ee-a15b-4534-a2ab-6bdac6f222cc service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:38.761916 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1203/2403] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:48:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:48:45.895280 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90c431-7c72-4436-8023-a77321f855ee None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:45.896295 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90c431-7c72-4436-8023-a77321f855ee None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:45.896883 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90c431-7c72-4436-8023-a77321f855ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:45.923162 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-0c90c431-7c72-4436-8023-a77321f855ee None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:48:45.925614 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0c90c431-7c72-4436-8023-a77321f855ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:45.935623 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1201/2404] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Sep 26 05:48:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:48:45.958389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454be8ee-a15b-4534-a2ab-6bdac6f222cc service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:45.969958 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454be8ee-a15b-4534-a2ab-6bdac6f222cc service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:45.977234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde06ec-8a2e-4ddf-8305-318e89ee0bd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:45.977883 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde06ec-8a2e-4ddf-8305-318e89ee0bd5 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:45.978463 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde06ec-8a2e-4ddf-8305-318e89ee0bd5 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:45.979022 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde06ec-8a2e-4ddf-8305-318e89ee0bd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:45.990523 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde06ec-8a2e-4ddf-8305-318e89ee0bd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:45.992514 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde06ec-8a2e-4ddf-8305-318e89ee0bd5 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:46.007969 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1204/2405] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:48:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:48:47.010570 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec8346-f91d-4f14-83da-32b725b32ed0 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:47.011237 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec8346-f91d-4f14-83da-32b725b32ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:47.011237 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec8346-f91d-4f14-83da-32b725b32ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:47.032465 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-2aec8346-f91d-4f14-83da-32b725b32ed0 None None] MFA Rules not processed for user `5bdaf32400b94aa291ad43a3131e1d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:48:47.033686 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2aec8346-f91d-4f14-83da-32b725b32ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:47.042619 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1202/2406] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Sep 26 05:48:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:48:47.054740 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde06ec-8a2e-4ddf-8305-318e89ee0bd5 service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:47.067066 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde06ec-8a2e-4ddf-8305-318e89ee0bd5 service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:47.072237 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64abe19-4e02-4c65-bb3e-b2799c8b67da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '830cd52ac42548b2ade17b5215aefd28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:47.072834 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64abe19-4e02-4c65-bb3e-b2799c8b67da service swift] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:47.073116 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64abe19-4e02-4c65-bb3e-b2799c8b67da service swift] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:47.073378 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64abe19-4e02-4c65-bb3e-b2799c8b67da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:47.082625 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64abe19-4e02-4c65-bb3e-b2799c8b67da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:47.084331 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64abe19-4e02-4c65-bb3e-b2799c8b67da service swift] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:47.092622 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1205/2407] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 26 05:48:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 05:48:47.683149 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583cf57-56dd-450c-acbe-9d88d50a53bd None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:47.683432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583cf57-56dd-450c-acbe-9d88d50a53bd None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:47.683684 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583cf57-56dd-450c-acbe-9d88d50a53bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:47.704593 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-3583cf57-56dd-450c-acbe-9d88d50a53bd None None] MFA Rules not processed for user `5bdaf32400b94aa291ad43a3131e1d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:48:47.705973 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-3583cf57-56dd-450c-acbe-9d88d50a53bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:47.717602 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1203/2408] 10.222.0.66 () {58 vars in 967 bytes} [Mon Sep 26 05:48:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:48:47.732893 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64abe19-4e02-4c65-bb3e-b2799c8b67da service swift] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:47.751266 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64abe19-4e02-4c65-bb3e-b2799c8b67da service swift] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:47.757996 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f3fb9-6d24-4c42-a276-f1b2f85087ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '830cd52ac42548b2ade17b5215aefd28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:47.758867 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f3fb9-6d24-4c42-a276-f1b2f85087ff service swift] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:47.759152 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f3fb9-6d24-4c42-a276-f1b2f85087ff service swift] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:47.759419 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f3fb9-6d24-4c42-a276-f1b2f85087ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:47.769230 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f3fb9-6d24-4c42-a276-f1b2f85087ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:47.770859 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f3fb9-6d24-4c42-a276-f1b2f85087ff service swift] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:47.780327 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1206/2409] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 26 05:48:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 05:48:48.040701 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54634ef-f6c3-4a9e-852f-e97e6be4f3f3 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:48.041194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54634ef-f6c3-4a9e-852f-e97e6be4f3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:48.041309 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54634ef-f6c3-4a9e-852f-e97e6be4f3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:48.061830 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-e54634ef-f6c3-4a9e-852f-e97e6be4f3f3 None None] MFA Rules not processed for user `5bdaf32400b94aa291ad43a3131e1d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:48:48.063052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e54634ef-f6c3-4a9e-852f-e97e6be4f3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:48.071142 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1204/2410] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Sep 26 05:48:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:48:48.085101 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f3fb9-6d24-4c42-a276-f1b2f85087ff service swift] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:48.097159 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f3fb9-6d24-4c42-a276-f1b2f85087ff service swift] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:48.103024 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311aa82b-51cf-451e-8b70-89a310c6c93c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '830cd52ac42548b2ade17b5215aefd28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:48.103657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311aa82b-51cf-451e-8b70-89a310c6c93c service swift] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:48.103985 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311aa82b-51cf-451e-8b70-89a310c6c93c service swift] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:48.104259 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311aa82b-51cf-451e-8b70-89a310c6c93c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:48.113822 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311aa82b-51cf-451e-8b70-89a310c6c93c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:48.115438 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311aa82b-51cf-451e-8b70-89a310c6c93c service swift] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:48.124977 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1207/2411] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 26 05:48:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 05:48:48.459198 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1f08a-5861-48c0-b1aa-0ad7af4a161b None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:48.459485 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1f08a-5861-48c0-b1aa-0ad7af4a161b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:48.459785 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1f08a-5861-48c0-b1aa-0ad7af4a161b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:48.479944 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-27d1f08a-5861-48c0-b1aa-0ad7af4a161b None None] MFA Rules not processed for user `5bdaf32400b94aa291ad43a3131e1d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:48:48.481090 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-27d1f08a-5861-48c0-b1aa-0ad7af4a161b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:48.489427 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1205/2412] 10.222.0.66 () {58 vars in 967 bytes} [Mon Sep 26 05:48:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:48:48.502679 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311aa82b-51cf-451e-8b70-89a310c6c93c service swift] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:48.514286 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311aa82b-51cf-451e-8b70-89a310c6c93c service swift] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:48.525358 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf65271-d2a0-4463-ab92-c1b9604cff1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '830cd52ac42548b2ade17b5215aefd28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:48.526497 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf65271-d2a0-4463-ab92-c1b9604cff1a service swift] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:48.527087 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf65271-d2a0-4463-ab92-c1b9604cff1a service swift] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:48.527378 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf65271-d2a0-4463-ab92-c1b9604cff1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:48.538605 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf65271-d2a0-4463-ab92-c1b9604cff1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:48.540617 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf65271-d2a0-4463-ab92-c1b9604cff1a service swift] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:48.550419 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1208/2413] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 26 05:48:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 05:48:50.777078 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1f08a-5861-48c0-b1aa-0ad7af4a161b None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:50.789448 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1f08a-5861-48c0-b1aa-0ad7af4a161b None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:50.794595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c572ce4-1372-4c50-baea-33aeb82881d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:50.795334 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c572ce4-1372-4c50-baea-33aeb82881d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:50.795603 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c572ce4-1372-4c50-baea-33aeb82881d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:50.795952 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c572ce4-1372-4c50-baea-33aeb82881d5 admin admin] PATH_INFO: `/v3/users/eedcfe775589443aa2ff4379f8ddc9b7` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:50.797066 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c572ce4-1372-4c50-baea-33aeb82881d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eedcfe775589443aa2ff4379f8ddc9b7)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:50.798985 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c572ce4-1372-4c50-baea-33aeb82881d5 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:50.860762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8c572ce4-1372-4c50-baea-33aeb82881d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eedcfe775589443aa2ff4379f8ddc9b7'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:48:50.875935 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8c572ce4-1372-4c50-baea-33aeb82881d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eedcfe775589443aa2ff4379f8ddc9b7'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:48:50.900706 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8c572ce4-1372-4c50-baea-33aeb82881d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eedcfe775589443aa2ff4379f8ddc9b7'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:48:50.902240 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8c572ce4-1372-4c50-baea-33aeb82881d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eedcfe775589443aa2ff4379f8ddc9b7'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:48:50.913006 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8c572ce4-1372-4c50-baea-33aeb82881d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eedcfe775589443aa2ff4379f8ddc9b7'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:48:50.921400 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1206/2414] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:48:50 2022] DELETE /identity/v3/users/eedcfe775589443aa2ff4379f8ddc9b7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:48:50.926082 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b21d2e-fb7e-42cb-a162-7a482257e4fd None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:50.926581 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b21d2e-fb7e-42cb-a162-7a482257e4fd None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:50.926677 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b21d2e-fb7e-42cb-a162-7a482257e4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:50.954017 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-82b21d2e-fb7e-42cb-a162-7a482257e4fd None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:48:50.954222 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b48c57-b990-475c-81a4-9e73e33a5f26 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:50.954382 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b48c57-b990-475c-81a4-9e73e33a5f26 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:50.955309 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b48c57-b990-475c-81a4-9e73e33a5f26 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:50.956815 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-82b21d2e-fb7e-42cb-a162-7a482257e4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:50.957038 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1207/2415] 10.222.0.66 () {54 vars in 921 bytes} [Mon Sep 26 05:48:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:48:50.968669 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819b980-b213-4a06-b13f-2f4310fa9de2 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:50.969169 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819b980-b213-4a06-b13f-2f4310fa9de2 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:50.969577 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819b980-b213-4a06-b13f-2f4310fa9de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:50.994099 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-a819b980-b213-4a06-b13f-2f4310fa9de2 None None] MFA Rules not processed for user `c559a36836be411b9afd076f4c9a0655`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:48:50.996045 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a819b980-b213-4a06-b13f-2f4310fa9de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:51.057328 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1209/2416] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:48:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:48:51.063941 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:48:51.071641 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b21d2e-fb7e-42cb-a162-7a482257e4fd None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:51.073230 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-82b21d2e-fb7e-42cb-a162-7a482257e4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:51.080535 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:48:51.082499 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1208/2417] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Sep 26 05:48:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:48:51.096452 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819b980-b213-4a06-b13f-2f4310fa9de2 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:51.098350 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a819b980-b213-4a06-b13f-2f4310fa9de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:51.143116 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b21d2e-fb7e-42cb-a162-7a482257e4fd None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:51.147009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e342b-5cde-40a2-9576-b3039a0ece35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:51.147797 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e342b-5cde-40a2-9576-b3039a0ece35 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:51.148078 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e342b-5cde-40a2-9576-b3039a0ece35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:51.148341 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e342b-5cde-40a2-9576-b3039a0ece35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:51.154619 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819b980-b213-4a06-b13f-2f4310fa9de2 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:51.157559 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e342b-5cde-40a2-9576-b3039a0ece35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:51.158365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f55d3-d743-4c83-88c0-e819daa483fc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '766ad3d6be374fc482a7c0bf6a1e56ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:51.158992 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f55d3-d743-4c83-88c0-e819daa483fc service glance] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:51.159110 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e342b-5cde-40a2-9576-b3039a0ece35 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:51.159242 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f55d3-d743-4c83-88c0-e819daa483fc service glance] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:51.159560 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f55d3-d743-4c83-88c0-e819daa483fc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:51.168936 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1210/2418] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:48:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:48:51.173129 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f55d3-d743-4c83-88c0-e819daa483fc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:51.174596 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f55d3-d743-4c83-88c0-e819daa483fc service glance] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:51.187543 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1209/2419] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:48:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:48:51.267764 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a2424-04ff-4545-8103-a3932fa09b05 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:51.268068 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a2424-04ff-4545-8103-a3932fa09b05 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:51.268348 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a2424-04ff-4545-8103-a3932fa09b05 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:51.269752 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1211/2420] 10.222.0.66 () {54 vars in 921 bytes} [Mon Sep 26 05:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:48:51.275514 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b406e0-84f3-4e60-919f-e08b99c1afd7 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:51.276734 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b406e0-84f3-4e60-919f-e08b99c1afd7 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:51.277008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b406e0-84f3-4e60-919f-e08b99c1afd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:51.303029 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-09b406e0-84f3-4e60-919f-e08b99c1afd7 None None] MFA Rules not processed for user `26b3d51ac6ca41cf9e535e751ac94675`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:48:51.304315 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-09b406e0-84f3-4e60-919f-e08b99c1afd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:51.312167 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1210/2421] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Sep 26 05:48:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:48:51.324351 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a2424-04ff-4545-8103-a3932fa09b05 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:51.326282 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-200a2424-04ff-4545-8103-a3932fa09b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:51.342861 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a2424-04ff-4545-8103-a3932fa09b05 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:51.347473 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e1d4d-f768-4120-b99c-265ccdfffcd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:51.348312 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e1d4d-f768-4120-b99c-265ccdfffcd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:51.348588 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e1d4d-f768-4120-b99c-265ccdfffcd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:51.348860 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e1d4d-f768-4120-b99c-265ccdfffcd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:51.359785 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e1d4d-f768-4120-b99c-265ccdfffcd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:51.363791 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e1d4d-f768-4120-b99c-265ccdfffcd8 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:51.374990 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b406e0-84f3-4e60-919f-e08b99c1afd7 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:51.385556 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-09b406e0-84f3-4e60-919f-e08b99c1afd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:51.406571 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b406e0-84f3-4e60-919f-e08b99c1afd7 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:51.409262 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1212/2422] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:48:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:48:51.411988 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8a041-72c8-4e9b-a25e-14a232e561eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:51.412639 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8a041-72c8-4e9b-a25e-14a232e561eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:51.412909 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8a041-72c8-4e9b-a25e-14a232e561eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:51.413173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8a041-72c8-4e9b-a25e-14a232e561eb admin admin] PATH_INFO: `/v3/projects/42b0dcbbd1f24a18bd94e815463513f8` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:51.415250 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8a041-72c8-4e9b-a25e-14a232e561eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=42b0dcbbd1f24a18bd94e815463513f8)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:51.417281 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8a041-72c8-4e9b-a25e-14a232e561eb admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:51.469141 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d3d8a041-72c8-4e9b-a25e-14a232e561eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42b0dcbbd1f24a18bd94e815463513f8', 'request_id': 'req-d3d8a041-72c8-4e9b-a25e-14a232e561eb'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:48:51.477368 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d3d8a041-72c8-4e9b-a25e-14a232e561eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42b0dcbbd1f24a18bd94e815463513f8', 'request_id': 'req-d3d8a041-72c8-4e9b-a25e-14a232e561eb'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:48:51.483619 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d3d8a041-72c8-4e9b-a25e-14a232e561eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42b0dcbbd1f24a18bd94e815463513f8', 'request_id': 'req-d3d8a041-72c8-4e9b-a25e-14a232e561eb'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:48:51.499125 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d3d8a041-72c8-4e9b-a25e-14a232e561eb admin admin] The token cache is being invalidate because project 42b0dcbbd1f24a18bd94e815463513f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:48:51.499418 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d3d8a041-72c8-4e9b-a25e-14a232e561eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:48:51.499665 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ad9b4-5e84-4f9b-b0ca-6b9c89905e5b None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:51.499897 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ad9b4-5e84-4f9b-b0ca-6b9c89905e5b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:51.500128 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d3d8a041-72c8-4e9b-a25e-14a232e561eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:48:51.500242 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ad9b4-5e84-4f9b-b0ca-6b9c89905e5b None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:51.501468 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1213/2423] 10.222.0.66 () {54 vars in 921 bytes} [Mon Sep 26 05:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:48:51.506942 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7185332-9dd2-46bf-a4bc-a7317d032cd6 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:51.507217 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7185332-9dd2-46bf-a4bc-a7317d032cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:51.507489 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7185332-9dd2-46bf-a4bc-a7317d032cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:51.519902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1211/2424] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:48:51 2022] DELETE /identity/v3/projects/42b0dcbbd1f24a18bd94e815463513f8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:48:51.531620 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b7185332-9dd2-46bf-a4bc-a7317d032cd6 None None] MFA Rules not processed for user `c559a36836be411b9afd076f4c9a0655`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:48:51.532924 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b7185332-9dd2-46bf-a4bc-a7317d032cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:51.609018 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1214/2425] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Sep 26 05:48:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:48:51.621170 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8a041-72c8-4e9b-a25e-14a232e561eb admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:51.622980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d3d8a041-72c8-4e9b-a25e-14a232e561eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:51.689736 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8a041-72c8-4e9b-a25e-14a232e561eb admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:51.694101 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a97a5-abef-4540-a0cb-c3705807161a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:51.694736 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a97a5-abef-4540-a0cb-c3705807161a service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:51.695017 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a97a5-abef-4540-a0cb-c3705807161a service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:51.695256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a97a5-abef-4540-a0cb-c3705807161a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:51.714052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a97a5-abef-4540-a0cb-c3705807161a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:51.715651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a97a5-abef-4540-a0cb-c3705807161a service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:51.729059 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1212/2426] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:48:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:48:53.223292 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162b879-eeb9-4351-ad1e-d68463a7caaf None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:53.223841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162b879-eeb9-4351-ad1e-d68463a7caaf None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:53.223841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8162b879-eeb9-4351-ad1e-d68463a7caaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:53.244845 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-8162b879-eeb9-4351-ad1e-d68463a7caaf None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:48:53.246065 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8162b879-eeb9-4351-ad1e-d68463a7caaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:53.329052 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1215/2427] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Sep 26 05:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:48:53.356739 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a97a5-abef-4540-a0cb-c3705807161a service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:53.358308 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-886a97a5-abef-4540-a0cb-c3705807161a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:53.374249 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a97a5-abef-4540-a0cb-c3705807161a service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:53.380425 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b87e09-4d10-4e89-9c0e-4dde24973134 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:53.381049 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b87e09-4d10-4e89-9c0e-4dde24973134 service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:53.381324 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b87e09-4d10-4e89-9c0e-4dde24973134 service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:53.381596 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b87e09-4d10-4e89-9c0e-4dde24973134 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:53.394643 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b87e09-4d10-4e89-9c0e-4dde24973134 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:53.397238 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b87e09-4d10-4e89-9c0e-4dde24973134 service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:53.408300 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1213/2428] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:48:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:48:56.756910 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27b161-b13b-4d4e-96ba-721eec1e82ca None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:56.757444 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27b161-b13b-4d4e-96ba-721eec1e82ca None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:56.757863 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27b161-b13b-4d4e-96ba-721eec1e82ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:56.790122 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-cf27b161-b13b-4d4e-96ba-721eec1e82ca None None] MFA Rules not processed for user `5bdaf32400b94aa291ad43a3131e1d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:48:56.792168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-cf27b161-b13b-4d4e-96ba-721eec1e82ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:56.826952 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:48:56.874411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1216/2429] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Sep 26 05:48:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:48:56.887173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b87e09-4d10-4e89-9c0e-4dde24973134 service nova] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:56.889147 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-44b87e09-4d10-4e89-9c0e-4dde24973134 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:56.898225 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:48:56.973813 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b87e09-4d10-4e89-9c0e-4dde24973134 service nova] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:56.979833 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1af128-dc4c-4e69-ace0-3a0a958cc8d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '830cd52ac42548b2ade17b5215aefd28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:56.980529 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1af128-dc4c-4e69-ace0-3a0a958cc8d2 service swift] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:56.980810 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1af128-dc4c-4e69-ace0-3a0a958cc8d2 service swift] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:56.981077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1af128-dc4c-4e69-ace0-3a0a958cc8d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:56.991597 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1af128-dc4c-4e69-ace0-3a0a958cc8d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:56.993265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1af128-dc4c-4e69-ace0-3a0a958cc8d2 service swift] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:57.002146 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1214/2430] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 26 05:48:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 05:48:58.466395 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65915172-69b3-45f2-b5d9-528a4628407e None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:58.467248 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65915172-69b3-45f2-b5d9-528a4628407e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:58.467248 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65915172-69b3-45f2-b5d9-528a4628407e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:58.490294 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-65915172-69b3-45f2-b5d9-528a4628407e None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:48:58.491646 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-65915172-69b3-45f2-b5d9-528a4628407e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:48:58.501821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1217/2431] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Sep 26 05:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:48:58.527403 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1af128-dc4c-4e69-ace0-3a0a958cc8d2 service swift] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:48:58.540479 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1af128-dc4c-4e69-ace0-3a0a958cc8d2 service swift] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:48:58.546073 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cb4e5-ab0f-42c0-a8cd-6054e343295e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:48:58.546697 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cb4e5-ab0f-42c0-a8cd-6054e343295e service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:48:58.546969 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cb4e5-ab0f-42c0-a8cd-6054e343295e service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:48:58.547243 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cb4e5-ab0f-42c0-a8cd-6054e343295e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:48:58.556819 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06cb4e5-ab0f-42c0-a8cd-6054e343295e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:48:58.558403 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06cb4e5-ab0f-42c0-a8cd-6054e343295e service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:48:58.569619 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1215/2432] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:48:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:49:08.483957 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=16 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:49:08.564599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=37 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:49:26.462855 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa8316-2bc2-4126-9908-b521be791dd0 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:49:26.463600 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa8316-2bc2-4126-9908-b521be791dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:49:26.463600 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa8316-2bc2-4126-9908-b521be791dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:49:26.484704 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b2aa8316-2bc2-4126-9908-b521be791dd0 None None] MFA Rules not processed for user `5bdaf32400b94aa291ad43a3131e1d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:49:26.485946 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b2aa8316-2bc2-4126-9908-b521be791dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:49:26.494918 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1218/2433] 10.222.0.66 () {58 vars in 967 bytes} [Mon Sep 26 05:49:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:49:26.507510 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cb4e5-ab0f-42c0-a8cd-6054e343295e service nova] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:49:26.521595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cb4e5-ab0f-42c0-a8cd-6054e343295e service nova] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:49:26.526810 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6423e-a20b-4868-80aa-a75c7d306de6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '830cd52ac42548b2ade17b5215aefd28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:49:26.527415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6423e-a20b-4868-80aa-a75c7d306de6 service swift] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:49:26.527800 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6423e-a20b-4868-80aa-a75c7d306de6 service swift] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:49:26.528098 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6423e-a20b-4868-80aa-a75c7d306de6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:49:26.536604 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6423e-a20b-4868-80aa-a75c7d306de6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:49:26.538540 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6423e-a20b-4868-80aa-a75c7d306de6 service swift] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:49:26.546515 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1216/2434] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 26 05:49:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 05:49:30.378232 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa8316-2bc2-4126-9908-b521be791dd0 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:49:30.380002 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b2aa8316-2bc2-4126-9908-b521be791dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:49:30.393295 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa8316-2bc2-4126-9908-b521be791dd0 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:49:30.398810 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f63153-9e65-4672-b94b-9b9aa4ced23f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:49:30.399605 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f63153-9e65-4672-b94b-9b9aa4ced23f service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:49:30.399998 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f63153-9e65-4672-b94b-9b9aa4ced23f service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:49:30.400354 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f63153-9e65-4672-b94b-9b9aa4ced23f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:49:30.402546 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-67f63153-9e65-4672-b94b-9b9aa4ced23f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:49:30.419121 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f63153-9e65-4672-b94b-9b9aa4ced23f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:49:30.420644 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f63153-9e65-4672-b94b-9b9aa4ced23f service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:49:30.433074 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1219/2435] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:49:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:49:36.543233 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=6 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:49:38.879081 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f6bd9-a476-472a-801e-994dd1cb9782 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:49:38.880209 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f6bd9-a476-472a-801e-994dd1cb9782 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:49:38.880209 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f6bd9-a476-472a-801e-994dd1cb9782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:49:38.904426 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-677f6bd9-a476-472a-801e-994dd1cb9782 None None] MFA Rules not processed for user `5977a64fd7554c968abf7fcf8b7ff2a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:49:38.905700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-677f6bd9-a476-472a-801e-994dd1cb9782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:49:38.970754 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1217/2436] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:49:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:49:39.592350 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f63153-9e65-4672-b94b-9b9aa4ced23f service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:49:39.601242 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f63153-9e65-4672-b94b-9b9aa4ced23f service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:49:39.605035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e8ae5-2b6b-4a55-8d0e-f92ba94ab55e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:49:39.605637 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e8ae5-2b6b-4a55-8d0e-f92ba94ab55e service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:49:39.605910 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e8ae5-2b6b-4a55-8d0e-f92ba94ab55e service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:49:39.606176 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e8ae5-2b6b-4a55-8d0e-f92ba94ab55e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:49:39.607942 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-690e8ae5-2b6b-4a55-8d0e-f92ba94ab55e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:49:39.621582 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e8ae5-2b6b-4a55-8d0e-f92ba94ab55e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:49:39.623027 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e8ae5-2b6b-4a55-8d0e-f92ba94ab55e service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:49:39.634532 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1220/2437] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:49:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:49:48.962657 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=25 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:49:49.629434 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=15 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:49:55.814200 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f6bd9-a476-472a-801e-994dd1cb9782 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:49:55.816107 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-677f6bd9-a476-472a-801e-994dd1cb9782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:49:55.834940 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f6bd9-a476-472a-801e-994dd1cb9782 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:49:55.841088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf8089-43fe-4b1b-b51e-e4ac5e44a42d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:49:55.841710 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf8089-43fe-4b1b-b51e-e4ac5e44a42d service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:49:55.841984 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf8089-43fe-4b1b-b51e-e4ac5e44a42d service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:49:55.842266 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf8089-43fe-4b1b-b51e-e4ac5e44a42d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:49:55.844131 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-66bf8089-43fe-4b1b-b51e-e4ac5e44a42d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:49:55.904591 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf8089-43fe-4b1b-b51e-e4ac5e44a42d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:49:55.906209 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bf8089-43fe-4b1b-b51e-e4ac5e44a42d service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:49:55.916121 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1218/2438] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:49:55 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:49:56.886540 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5cc66-4fe0-436a-9f42-bfe136a460c0 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:49:56.887174 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5cc66-4fe0-436a-9f42-bfe136a460c0 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:49:56.887174 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5cc66-4fe0-436a-9f42-bfe136a460c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:49:56.909200 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-40a5cc66-4fe0-436a-9f42-bfe136a460c0 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:49:56.910410 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-40a5cc66-4fe0-436a-9f42-bfe136a460c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:49:56.920335 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1221/2439] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Sep 26 05:49:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:49:56.943065 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf8089-43fe-4b1b-b51e-e4ac5e44a42d service nova] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:49:56.955515 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf8089-43fe-4b1b-b51e-e4ac5e44a42d service nova] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:49:56.963342 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55fb46-a13a-4d4d-93a9-9b02dba8bfce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:49:56.964003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55fb46-a13a-4d4d-93a9-9b02dba8bfce service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:49:56.964276 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55fb46-a13a-4d4d-93a9-9b02dba8bfce service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:49:56.964521 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55fb46-a13a-4d4d-93a9-9b02dba8bfce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:49:56.974168 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55fb46-a13a-4d4d-93a9-9b02dba8bfce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:49:56.975741 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55fb46-a13a-4d4d-93a9-9b02dba8bfce service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:49:56.987326 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1219/2440] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:49:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:50:01.178625 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8b72f-2f68-4d85-8161-2f397d1e2fae None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:50:01.179200 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8b72f-2f68-4d85-8161-2f397d1e2fae None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:50:01.179200 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8b72f-2f68-4d85-8161-2f397d1e2fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:50:01.201616 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-61e8b72f-2f68-4d85-8161-2f397d1e2fae None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:50:01.202722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-61e8b72f-2f68-4d85-8161-2f397d1e2fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:50:01.212050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1222/2441] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Sep 26 05:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:50:01.236098 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55fb46-a13a-4d4d-93a9-9b02dba8bfce service nova] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:50:01.247723 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55fb46-a13a-4d4d-93a9-9b02dba8bfce service nova] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:50:01.254872 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60853b-1d13-4bcf-95cc-17aab794b499 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:50:01.255473 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60853b-1d13-4bcf-95cc-17aab794b499 service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:50:01.255763 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60853b-1d13-4bcf-95cc-17aab794b499 service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:50:01.256044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60853b-1d13-4bcf-95cc-17aab794b499 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:50:01.264540 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c60853b-1d13-4bcf-95cc-17aab794b499 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:50:01.266134 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c60853b-1d13-4bcf-95cc-17aab794b499 service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:50:01.276463 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1220/2442] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:50:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:50:05.290480 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c573f32-55de-498d-baa4-01b6f7b5f50b None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:50:05.291100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c573f32-55de-498d-baa4-01b6f7b5f50b None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:50:05.291100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c573f32-55de-498d-baa4-01b6f7b5f50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:50:05.315358 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-7c573f32-55de-498d-baa4-01b6f7b5f50b None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:50:05.316602 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7c573f32-55de-498d-baa4-01b6f7b5f50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:50:05.326000 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1223/2443] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Sep 26 05:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:50:05.348183 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60853b-1d13-4bcf-95cc-17aab794b499 service nova] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:50:05.360923 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60853b-1d13-4bcf-95cc-17aab794b499 service nova] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:50:05.368539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6aa3d9-e980-40fc-b2c5-384cf625e13d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:50:05.369306 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6aa3d9-e980-40fc-b2c5-384cf625e13d service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:50:05.369578 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6aa3d9-e980-40fc-b2c5-384cf625e13d service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:50:05.369838 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6aa3d9-e980-40fc-b2c5-384cf625e13d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:50:05.384320 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6aa3d9-e980-40fc-b2c5-384cf625e13d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:50:05.385890 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6aa3d9-e980-40fc-b2c5-384cf625e13d service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:50:05.396062 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1221/2444] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:50:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:50:09.516438 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa0da9-db02-44b7-864d-310213c3d05f None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:50:09.516982 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa0da9-db02-44b7-864d-310213c3d05f None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:50:09.516982 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa0da9-db02-44b7-864d-310213c3d05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:50:09.542666 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-daaa0da9-db02-44b7-864d-310213c3d05f None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:50:09.544409 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-daaa0da9-db02-44b7-864d-310213c3d05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:50:09.556321 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1224/2445] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Sep 26 05:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:50:09.579475 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6aa3d9-e980-40fc-b2c5-384cf625e13d service nova] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:50:09.591764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6aa3d9-e980-40fc-b2c5-384cf625e13d service nova] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:50:09.599030 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e759b-bf80-41c8-98f6-2c53a076e692 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:50:09.599633 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e759b-bf80-41c8-98f6-2c53a076e692 service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:50:09.599918 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e759b-bf80-41c8-98f6-2c53a076e692 service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:50:09.600212 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e759b-bf80-41c8-98f6-2c53a076e692 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:50:09.609267 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e759b-bf80-41c8-98f6-2c53a076e692 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:50:09.610935 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e759b-bf80-41c8-98f6-2c53a076e692 service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:50:09.621418 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1222/2446] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:50:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:50:12.282904 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa0da9-db02-44b7-864d-310213c3d05f None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:50:12.294115 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaa0da9-db02-44b7-864d-310213c3d05f None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:50:12.298105 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f82a65-13a0-43bc-b14b-969ace9cd126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:50:12.298717 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f82a65-13a0-43bc-b14b-969ace9cd126 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:50:12.298988 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f82a65-13a0-43bc-b14b-969ace9cd126 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:50:12.299255 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f82a65-13a0-43bc-b14b-969ace9cd126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:50:12.301300 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d6f82a65-13a0-43bc-b14b-969ace9cd126 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:50:12.311237 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f82a65-13a0-43bc-b14b-969ace9cd126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:50:12.312686 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f82a65-13a0-43bc-b14b-969ace9cd126 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:50:12.320797 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1225/2447] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:50:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:50:15.134703 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ab669-79cd-4404-bfd1-e31b5815fa02 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:50:15.135284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ab669-79cd-4404-bfd1-e31b5815fa02 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:50:15.135284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ab669-79cd-4404-bfd1-e31b5815fa02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:50:15.157396 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-076ab669-79cd-4404-bfd1-e31b5815fa02 None None] MFA Rules not processed for user `5224b2ba12d54146855fe3a993dc0915`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:50:15.158622 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-076ab669-79cd-4404-bfd1-e31b5815fa02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:50:15.167518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1223/2448] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:50:15 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:50:16.840178 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28469e08-f86c-41a2-b9d4-2ae5e39116a8 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:50:16.840711 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28469e08-f86c-41a2-b9d4-2ae5e39116a8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:50:16.840711 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28469e08-f86c-41a2-b9d4-2ae5e39116a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:50:16.872097 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-28469e08-f86c-41a2-b9d4-2ae5e39116a8 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:50:16.873213 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-28469e08-f86c-41a2-b9d4-2ae5e39116a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:50:16.882279 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1226/2449] 10.222.0.26 () {58 vars in 1016 bytes} [Mon Sep 26 05:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:50:16.911670 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ab669-79cd-4404-bfd1-e31b5815fa02 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:50:16.928654 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ab669-79cd-4404-bfd1-e31b5815fa02 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:50:16.935944 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de18a5-8c27-4574-b975-c2623f6c433b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:50:16.936555 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de18a5-8c27-4574-b975-c2623f6c433b service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:50:16.936822 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de18a5-8c27-4574-b975-c2623f6c433b service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:50:16.937099 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de18a5-8c27-4574-b975-c2623f6c433b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:50:16.946678 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de18a5-8c27-4574-b975-c2623f6c433b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:50:16.948295 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de18a5-8c27-4574-b975-c2623f6c433b service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:50:16.958346 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1224/2450] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:50:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:50:22.805384 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28469e08-f86c-41a2-b9d4-2ae5e39116a8 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:50:22.814641 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=22 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:50:22.821463 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28469e08-f86c-41a2-b9d4-2ae5e39116a8 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:50:22.831815 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ea076-7c74-434e-93b5-cd7d1a40c47c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:50:22.832666 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ea076-7c74-434e-93b5-cd7d1a40c47c service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:50:22.832937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ea076-7c74-434e-93b5-cd7d1a40c47c service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:50:22.833203 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ea076-7c74-434e-93b5-cd7d1a40c47c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:50:22.835343 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-214ea076-7c74-434e-93b5-cd7d1a40c47c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:50:22.848354 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ea076-7c74-434e-93b5-cd7d1a40c47c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:50:22.850202 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214ea076-7c74-434e-93b5-cd7d1a40c47c service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:50:22.861189 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1227/2451] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:50:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:50:26.953852 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=61 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:50:28.606015 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de18a5-8c27-4574-b975-c2623f6c433b service nova] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:50:28.618112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de18a5-8c27-4574-b975-c2623f6c433b service nova] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:50:28.625344 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711eef4a-2515-4bfe-8328-c9cf9e479dc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:50:28.625946 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711eef4a-2515-4bfe-8328-c9cf9e479dc3 service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:50:28.626217 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711eef4a-2515-4bfe-8328-c9cf9e479dc3 service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:50:28.626476 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711eef4a-2515-4bfe-8328-c9cf9e479dc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:50:28.628582 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-711eef4a-2515-4bfe-8328-c9cf9e479dc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:50:28.693633 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711eef4a-2515-4bfe-8328-c9cf9e479dc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:50:28.695223 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711eef4a-2515-4bfe-8328-c9cf9e479dc3 service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:50:28.706233 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1225/2452] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:50:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:50:32.857142 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:50:34.404040 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ea076-7c74-434e-93b5-cd7d1a40c47c service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:50:34.417604 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ea076-7c74-434e-93b5-cd7d1a40c47c service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:50:34.428489 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c925947-76a2-4261-b096-3fbb74ed994d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:50:34.429117 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c925947-76a2-4261-b096-3fbb74ed994d service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:50:34.429588 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c925947-76a2-4261-b096-3fbb74ed994d service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:50:34.430052 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c925947-76a2-4261-b096-3fbb74ed994d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:50:34.433588 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3c925947-76a2-4261-b096-3fbb74ed994d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:50:34.453177 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c925947-76a2-4261-b096-3fbb74ed994d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:50:34.456483 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c925947-76a2-4261-b096-3fbb74ed994d service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:50:34.483000 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1228/2453] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:50:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:50:38.700395 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=28 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:50:44.467045 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=6 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:50:47.564372 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9ae88-c213-4219-be17-2a73af5b8c4d None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:50:47.564892 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9ae88-c213-4219-be17-2a73af5b8c4d None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:50:47.564892 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9ae88-c213-4219-be17-2a73af5b8c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:50:47.584294 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-80b9ae88-c213-4219-be17-2a73af5b8c4d None None] MFA Rules not processed for user `9b19bf41fdb74cc4a8e0e048f86bf3c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:50:47.585508 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-80b9ae88-c213-4219-be17-2a73af5b8c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:50:47.592843 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1226/2454] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:50:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:50:47.907268 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c925947-76a2-4261-b096-3fbb74ed994d service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:50:47.917536 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c925947-76a2-4261-b096-3fbb74ed994d service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:50:47.922538 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8fbdaa-7515-42b3-bc30-4b8fddc035a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:50:47.923137 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fbdaa-7515-42b3-bc30-4b8fddc035a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:50:47.923416 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fbdaa-7515-42b3-bc30-4b8fddc035a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:50:47.923920 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8fbdaa-7515-42b3-bc30-4b8fddc035a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:50:47.925807 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-fa8fbdaa-7515-42b3-bc30-4b8fddc035a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:50:47.935948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fbdaa-7515-42b3-bc30-4b8fddc035a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:50:47.937374 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8fbdaa-7515-42b3-bc30-4b8fddc035a3 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:50:47.945391 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1229/2455] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:50:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:50:48.286143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9ae88-c213-4219-be17-2a73af5b8c4d None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:50:48.287823 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-80b9ae88-c213-4219-be17-2a73af5b8c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:50:48.367273 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9ae88-c213-4219-be17-2a73af5b8c4d None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:50:48.372716 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfe2788-9aba-4736-b805-828bf1c6f4e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895edcfb20484b188a3877c9de8b59c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:50:48.373328 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe2788-9aba-4736-b805-828bf1c6f4e8 service placement] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:50:48.373603 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe2788-9aba-4736-b805-828bf1c6f4e8 service placement] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:50:48.373999 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe2788-9aba-4736-b805-828bf1c6f4e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:50:48.375767 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ccfe2788-9aba-4736-b805-828bf1c6f4e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:50:48.387780 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe2788-9aba-4736-b805-828bf1c6f4e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:50:48.389431 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfe2788-9aba-4736-b805-828bf1c6f4e8 service placement] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:50:48.400129 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1227/2456] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:50:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:50:56.729404 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a157a29-753a-4c9b-846d-1fb2e0cba2b8 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:50:56.729992 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a157a29-753a-4c9b-846d-1fb2e0cba2b8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:50:56.729992 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a157a29-753a-4c9b-846d-1fb2e0cba2b8 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:50:56.731395 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1230/2457] 10.222.0.66 () {54 vars in 921 bytes} [Mon Sep 26 05:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:50:56.742838 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37951012-d443-4940-90f0-d27a116554fc None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:50:56.743381 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37951012-d443-4940-90f0-d27a116554fc None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:50:56.743381 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37951012-d443-4940-90f0-d27a116554fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:50:56.764522 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-37951012-d443-4940-90f0-d27a116554fc None None] MFA Rules not processed for user `895edcfb20484b188a3877c9de8b59c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:50:56.765765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-37951012-d443-4940-90f0-d27a116554fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:50:56.778742 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1228/2458] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Sep 26 05:50:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:50:56.793496 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a157a29-753a-4c9b-846d-1fb2e0cba2b8 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:50:56.795708 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4a157a29-753a-4c9b-846d-1fb2e0cba2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:50:56.816782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a157a29-753a-4c9b-846d-1fb2e0cba2b8 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:50:56.825683 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899ae88-f74a-4ab5-ac5f-a13f86d2c4f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895edcfb20484b188a3877c9de8b59c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:50:56.826324 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899ae88-f74a-4ab5-ac5f-a13f86d2c4f4 service placement] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:50:56.826628 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899ae88-f74a-4ab5-ac5f-a13f86d2c4f4 service placement] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:50:56.827532 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899ae88-f74a-4ab5-ac5f-a13f86d2c4f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:50:56.843901 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37951012-d443-4940-90f0-d27a116554fc None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:50:56.845450 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-37951012-d443-4940-90f0-d27a116554fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:50:56.848020 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899ae88-f74a-4ab5-ac5f-a13f86d2c4f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:50:56.849751 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899ae88-f74a-4ab5-ac5f-a13f86d2c4f4 service placement] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:50:56.863821 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37951012-d443-4940-90f0-d27a116554fc None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:50:56.864046 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1231/2459] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:50:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:50:56.870091 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178bedc-35d2-4b5e-ba2b-ed0ddb363cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:50:56.870747 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178bedc-35d2-4b5e-ba2b-ed0ddb363cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:50:56.871009 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178bedc-35d2-4b5e-ba2b-ed0ddb363cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:50:56.871284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178bedc-35d2-4b5e-ba2b-ed0ddb363cb4 admin admin] PATH_INFO: `/v3/users/5977a64fd7554c968abf7fcf8b7ff2a2` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:50:56.872415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178bedc-35d2-4b5e-ba2b-ed0ddb363cb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5977a64fd7554c968abf7fcf8b7ff2a2)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:50:56.874332 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178bedc-35d2-4b5e-ba2b-ed0ddb363cb4 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:50:56.926018 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1178bedc-35d2-4b5e-ba2b-ed0ddb363cb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5977a64fd7554c968abf7fcf8b7ff2a2'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:50:56.935171 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1178bedc-35d2-4b5e-ba2b-ed0ddb363cb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5977a64fd7554c968abf7fcf8b7ff2a2'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:50:56.949009 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1178bedc-35d2-4b5e-ba2b-ed0ddb363cb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5977a64fd7554c968abf7fcf8b7ff2a2'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:50:56.949892 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1178bedc-35d2-4b5e-ba2b-ed0ddb363cb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5977a64fd7554c968abf7fcf8b7ff2a2'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:50:56.957002 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1178bedc-35d2-4b5e-ba2b-ed0ddb363cb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5977a64fd7554c968abf7fcf8b7ff2a2'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:50:56.964580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1229/2460] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:50:56 2022] DELETE /identity/v3/users/5977a64fd7554c968abf7fcf8b7ff2a2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:50:57.154892 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899ae88-f74a-4ab5-ac5f-a13f86d2c4f4 service placement] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:50:57.168946 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899ae88-f74a-4ab5-ac5f-a13f86d2c4f4 service placement] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:50:57.242370 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b94e66f-0af0-47c3-b1ab-a07af0988b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:50:57.243019 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94e66f-0af0-47c3-b1ab-a07af0988b2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:50:57.243319 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94e66f-0af0-47c3-b1ab-a07af0988b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:50:57.243588 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94e66f-0af0-47c3-b1ab-a07af0988b2f admin admin] PATH_INFO: `/v3/projects/4b28e068c53f4d1eb2c62a6559615c35` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:50:57.244798 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94e66f-0af0-47c3-b1ab-a07af0988b2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b28e068c53f4d1eb2c62a6559615c35)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:50:57.246719 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b94e66f-0af0-47c3-b1ab-a07af0988b2f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:50:57.303074 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0b94e66f-0af0-47c3-b1ab-a07af0988b2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b28e068c53f4d1eb2c62a6559615c35', 'request_id': 'req-0b94e66f-0af0-47c3-b1ab-a07af0988b2f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:50:57.309609 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0b94e66f-0af0-47c3-b1ab-a07af0988b2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b28e068c53f4d1eb2c62a6559615c35', 'request_id': 'req-0b94e66f-0af0-47c3-b1ab-a07af0988b2f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:50:57.317124 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0b94e66f-0af0-47c3-b1ab-a07af0988b2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b28e068c53f4d1eb2c62a6559615c35', 'request_id': 'req-0b94e66f-0af0-47c3-b1ab-a07af0988b2f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:50:57.331819 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0b94e66f-0af0-47c3-b1ab-a07af0988b2f admin admin] The token cache is being invalidate because project 4b28e068c53f4d1eb2c62a6559615c35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:50:57.332106 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0b94e66f-0af0-47c3-b1ab-a07af0988b2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:50:57.332757 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0b94e66f-0af0-47c3-b1ab-a07af0988b2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:50:57.334281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1232/2461] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:50:57 2022] DELETE /identity/v3/projects/4b28e068c53f4d1eb2c62a6559615c35 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:50:57.339426 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8556c0-96a7-4e88-a5c8-06478bdc7e5f None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:50:57.339708 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8556c0-96a7-4e88-a5c8-06478bdc7e5f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:50:57.340003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8556c0-96a7-4e88-a5c8-06478bdc7e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:50:57.361387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-be8556c0-96a7-4e88-a5c8-06478bdc7e5f None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:50:57.362947 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-be8556c0-96a7-4e88-a5c8-06478bdc7e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:50:57.421591 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:50:57.439072 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1230/2462] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:50:57.448595 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d4861-79c2-4444-85e8-b0e95b341299 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:50:57.448919 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d4861-79c2-4444-85e8-b0e95b341299 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:50:57.449283 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d4861-79c2-4444-85e8-b0e95b341299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:50:57.477039 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-667d4861-79c2-4444-85e8-b0e95b341299 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:50:57.478250 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-667d4861-79c2-4444-85e8-b0e95b341299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:50:57.487867 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1233/2463] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:50:57.492437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8556c0-96a7-4e88-a5c8-06478bdc7e5f None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:50:57.502959 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8556c0-96a7-4e88-a5c8-06478bdc7e5f None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:50:57.508329 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157de23-5cfc-4942-9093-88e6a69e2c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:50:57.508954 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157de23-5cfc-4942-9093-88e6a69e2c58 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:50:57.509212 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157de23-5cfc-4942-9093-88e6a69e2c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:50:57.509483 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157de23-5cfc-4942-9093-88e6a69e2c58 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:50:57.510130 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157de23-5cfc-4942-9093-88e6a69e2c58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:50:57.510430 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157de23-5cfc-4942-9093-88e6a69e2c58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:50:57.512059 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157de23-5cfc-4942-9093-88e6a69e2c58 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:50:57.524312 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1231/2464] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:50:57.528711 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d4861-79c2-4444-85e8-b0e95b341299 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:50:57.539183 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d4861-79c2-4444-85e8-b0e95b341299 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:50:57.544327 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a8db6-6011-40ed-baee-d393366d2997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:50:57.544928 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a8db6-6011-40ed-baee-d393366d2997 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:50:57.545208 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a8db6-6011-40ed-baee-d393366d2997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:50:57.545466 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a8db6-6011-40ed-baee-d393366d2997 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:50:57.546091 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a8db6-6011-40ed-baee-d393366d2997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:50:57.548120 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a8db6-6011-40ed-baee-d393366d2997 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:50:57.581260 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1234/2465] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:50:57 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:50:57.582445 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157de23-5cfc-4942-9093-88e6a69e2c58 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:50:57.592877 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157de23-5cfc-4942-9093-88e6a69e2c58 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:50:57.650844 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4dd462-3de5-4d4a-8866-14356f6f43b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:50:57.651453 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dd462-3de5-4d4a-8866-14356f6f43b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:50:57.651723 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dd462-3de5-4d4a-8866-14356f6f43b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:50:57.652028 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4dd462-3de5-4d4a-8866-14356f6f43b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:50:57.652654 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4dd462-3de5-4d4a-8866-14356f6f43b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:50:57.654565 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4dd462-3de5-4d4a-8866-14356f6f43b1 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:50:57.676416 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1232/2466] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:50:57 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:50:57.680571 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a8db6-6011-40ed-baee-d393366d2997 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:50:57.691275 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a8db6-6011-40ed-baee-d393366d2997 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:50:57.696934 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd596dd6-1c79-497e-bf80-de188b04a0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:50:57.697535 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd596dd6-1c79-497e-bf80-de188b04a0bf admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:50:57.697803 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd596dd6-1c79-497e-bf80-de188b04a0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:50:57.698063 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd596dd6-1c79-497e-bf80-de188b04a0bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:50:57.703134 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd596dd6-1c79-497e-bf80-de188b04a0bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:50:57.703134 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd596dd6-1c79-497e-bf80-de188b04a0bf admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:50:57.711190 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1235/2467] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:50:57.773447 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4dd462-3de5-4d4a-8866-14356f6f43b1 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:50:57.791122 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4dd462-3de5-4d4a-8866-14356f6f43b1 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:50:57.799156 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91992c5d-4a58-4d91-b14f-29ce2d757e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:50:57.799770 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91992c5d-4a58-4d91-b14f-29ce2d757e7b admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:50:57.800065 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91992c5d-4a58-4d91-b14f-29ce2d757e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:50:57.800332 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91992c5d-4a58-4d91-b14f-29ce2d757e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:50:57.801006 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91992c5d-4a58-4d91-b14f-29ce2d757e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:50:57.802659 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91992c5d-4a58-4d91-b14f-29ce2d757e7b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:50:57.813894 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1233/2468] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:50:57.818449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd596dd6-1c79-497e-bf80-de188b04a0bf admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:50:57.829140 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd596dd6-1c79-497e-bf80-de188b04a0bf admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:50:57.834507 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa490a9e-a418-4f54-a13d-b095844ff07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:50:57.835158 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa490a9e-a418-4f54-a13d-b095844ff07b admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:50:57.835431 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa490a9e-a418-4f54-a13d-b095844ff07b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:50:57.835709 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa490a9e-a418-4f54-a13d-b095844ff07b admin admin] PATH_INFO: `/v3/projects/85a08ed641f044398ed29fffd7b51b4a/users/88cfed14f465443c95ee87c95ef6e1c2/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:50:57.852207 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa490a9e-a418-4f54-a13d-b095844ff07b admin admin] RBAC: Authorizing `identity:create_grant(project_id=85a08ed641f044398ed29fffd7b51b4a, user_id=88cfed14f465443c95ee87c95ef6e1c2, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:50:57.854999 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa490a9e-a418-4f54-a13d-b095844ff07b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:50:57.865303 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:50:57.870470 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1236/2469] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:50:57 2022] PUT /identity/v3/projects/85a08ed641f044398ed29fffd7b51b4a/users/88cfed14f465443c95ee87c95ef6e1c2/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:50:57.880969 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c005c5-e621-44ab-a555-72d86b439e0b None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:50:57.881272 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c005c5-e621-44ab-a555-72d86b439e0b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:50:57.881566 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c005c5-e621-44ab-a555-72d86b439e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:50:57.911236 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-f9c005c5-e621-44ab-a555-72d86b439e0b None None] MFA Rules not processed for user `88cfed14f465443c95ee87c95ef6e1c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:50:57.912538 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f9c005c5-e621-44ab-a555-72d86b439e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:50:57.983698 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1234/2470] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:50:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:50:57.995315 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa490a9e-a418-4f54-a13d-b095844ff07b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:50:57.997280 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-aa490a9e-a418-4f54-a13d-b095844ff07b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:50:58.054762 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa490a9e-a418-4f54-a13d-b095844ff07b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:50:58.058431 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42989b4d-a1bf-401c-a243-848c168d5128 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:50:58.059035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42989b4d-a1bf-401c-a243-848c168d5128 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:50:58.059311 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42989b4d-a1bf-401c-a243-848c168d5128 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:50:58.059577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42989b4d-a1bf-401c-a243-848c168d5128 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:50:58.068106 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42989b4d-a1bf-401c-a243-848c168d5128 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:50:58.069544 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42989b4d-a1bf-401c-a243-848c168d5128 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:50:58.078637 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1237/2471] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:50:57 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:50:58.458656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c005c5-e621-44ab-a555-72d86b439e0b None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:50:58.460731 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f9c005c5-e621-44ab-a555-72d86b439e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:50:58.525746 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:50:58.564987 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c005c5-e621-44ab-a555-72d86b439e0b None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:50:58.571277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cc555-46fe-4dd2-be3d-227add38d0c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:50:58.571985 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cc555-46fe-4dd2-be3d-227add38d0c8 service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:50:58.572265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cc555-46fe-4dd2-be3d-227add38d0c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:50:58.572541 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cc555-46fe-4dd2-be3d-227add38d0c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:50:58.574726 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5e2cc555-46fe-4dd2-be3d-227add38d0c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:50:58.589175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2cc555-46fe-4dd2-be3d-227add38d0c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:50:58.590865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2cc555-46fe-4dd2-be3d-227add38d0c8 service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:50:58.602294 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1235/2472] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:50:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:50:58.864104 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42989b4d-a1bf-401c-a243-848c168d5128 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:50:58.865772 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-42989b4d-a1bf-401c-a243-848c168d5128 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:50:58.884229 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42989b4d-a1bf-401c-a243-848c168d5128 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:50:58.890347 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb82d5e-4d6d-48eb-9216-3da9d0a99bc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:50:58.890958 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb82d5e-4d6d-48eb-9216-3da9d0a99bc7 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:50:58.891233 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb82d5e-4d6d-48eb-9216-3da9d0a99bc7 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:50:58.891508 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb82d5e-4d6d-48eb-9216-3da9d0a99bc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:50:58.893658 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-bbb82d5e-4d6d-48eb-9216-3da9d0a99bc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:50:58.956500 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb82d5e-4d6d-48eb-9216-3da9d0a99bc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:50:58.958097 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb82d5e-4d6d-48eb-9216-3da9d0a99bc7 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:50:58.967428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1238/2473] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:50:58 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:51:08.546043 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cc555-46fe-4dd2-be3d-227add38d0c8 service nova] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:51:08.612438 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2cc555-46fe-4dd2-be3d-227add38d0c8 service nova] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:51:08.617811 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07d639-1080-4852-82c3-8b7c40dce6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:51:08.618459 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07d639-1080-4852-82c3-8b7c40dce6cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:08.618736 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07d639-1080-4852-82c3-8b7c40dce6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:08.619036 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07d639-1080-4852-82c3-8b7c40dce6cc admin admin] PATH_INFO: `/v3/users/88cfed14f465443c95ee87c95ef6e1c2` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:08.620182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c07d639-1080-4852-82c3-8b7c40dce6cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=88cfed14f465443c95ee87c95ef6e1c2)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:51:08.622085 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c07d639-1080-4852-82c3-8b7c40dce6cc admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:51:08.679656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-0c07d639-1080-4852-82c3-8b7c40dce6cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88cfed14f465443c95ee87c95ef6e1c2'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:51:08.689894 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-0c07d639-1080-4852-82c3-8b7c40dce6cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88cfed14f465443c95ee87c95ef6e1c2'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:51:08.713758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-0c07d639-1080-4852-82c3-8b7c40dce6cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88cfed14f465443c95ee87c95ef6e1c2'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:51:08.714860 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-0c07d639-1080-4852-82c3-8b7c40dce6cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88cfed14f465443c95ee87c95ef6e1c2'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:51:08.725292 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-0c07d639-1080-4852-82c3-8b7c40dce6cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88cfed14f465443c95ee87c95ef6e1c2'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:51:08.731818 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1236/2474] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:51:08 2022] DELETE /identity/v3/users/88cfed14f465443c95ee87c95ef6e1c2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:51:08.736629 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caafea5-ad9e-46ae-9134-e1d1573de126 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:08.737109 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caafea5-ad9e-46ae-9134-e1d1573de126 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:08.737192 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caafea5-ad9e-46ae-9134-e1d1573de126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:08.756360 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-6caafea5-ad9e-46ae-9134-e1d1573de126 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:51:08.757575 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6caafea5-ad9e-46ae-9134-e1d1573de126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:51:08.834685 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1239/2475] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:51:08.845762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07d639-1080-4852-82c3-8b7c40dce6cc admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:51:08.847328 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0c07d639-1080-4852-82c3-8b7c40dce6cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:51:08.907788 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:51:08.912925 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07d639-1080-4852-82c3-8b7c40dce6cc admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:51:08.921556 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5137b4cb-2550-493b-a11b-eda43882623d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:51:08.922600 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137b4cb-2550-493b-a11b-eda43882623d service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:08.922875 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137b4cb-2550-493b-a11b-eda43882623d service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:08.923144 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5137b4cb-2550-493b-a11b-eda43882623d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:08.932787 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5137b4cb-2550-493b-a11b-eda43882623d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:51:08.934227 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5137b4cb-2550-493b-a11b-eda43882623d service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:51:08.944114 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1237/2476] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:51:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:51:09.214001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caafea5-ad9e-46ae-9134-e1d1573de126 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:51:09.215641 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6caafea5-ad9e-46ae-9134-e1d1573de126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:51:09.230876 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caafea5-ad9e-46ae-9134-e1d1573de126 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:51:09.236444 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe913a-c462-49b4-9310-3b30b6974cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:51:09.237156 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe913a-c462-49b4-9310-3b30b6974cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:09.237424 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe913a-c462-49b4-9310-3b30b6974cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:09.237698 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe913a-c462-49b4-9310-3b30b6974cff admin admin] PATH_INFO: `/v3/projects/85a08ed641f044398ed29fffd7b51b4a` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:09.238865 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe913a-c462-49b4-9310-3b30b6974cff admin admin] RBAC: Authorizing `identity:delete_project(project_id=85a08ed641f044398ed29fffd7b51b4a)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:51:09.240991 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe913a-c462-49b4-9310-3b30b6974cff admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:51:09.293200 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:51:09.304265 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5cfe913a-c462-49b4-9310-3b30b6974cff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85a08ed641f044398ed29fffd7b51b4a', 'request_id': 'req-5cfe913a-c462-49b4-9310-3b30b6974cff'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:51:09.310756 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5cfe913a-c462-49b4-9310-3b30b6974cff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85a08ed641f044398ed29fffd7b51b4a', 'request_id': 'req-5cfe913a-c462-49b4-9310-3b30b6974cff'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:51:09.317760 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5cfe913a-c462-49b4-9310-3b30b6974cff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85a08ed641f044398ed29fffd7b51b4a', 'request_id': 'req-5cfe913a-c462-49b4-9310-3b30b6974cff'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:51:09.334244 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5cfe913a-c462-49b4-9310-3b30b6974cff admin admin] The token cache is being invalidate because project 85a08ed641f044398ed29fffd7b51b4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:51:09.334801 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5cfe913a-c462-49b4-9310-3b30b6974cff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:51:09.335835 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5cfe913a-c462-49b4-9310-3b30b6974cff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:51:09.337497 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1240/2477] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:51:09 2022] DELETE /identity/v3/projects/85a08ed641f044398ed29fffd7b51b4a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:51:09.343127 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f3c81-8910-456f-b9b5-5eb1b8b8780a None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:09.343423 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f3c81-8910-456f-b9b5-5eb1b8b8780a None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:09.343689 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625f3c81-8910-456f-b9b5-5eb1b8b8780a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:09.366178 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-625f3c81-8910-456f-b9b5-5eb1b8b8780a None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:51:09.367409 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-625f3c81-8910-456f-b9b5-5eb1b8b8780a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:51:09.443771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1238/2478] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:51:09.445659 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d9aa2-16c5-4260-858f-d192056df51c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:09.445974 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d9aa2-16c5-4260-858f-d192056df51c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:09.446318 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d9aa2-16c5-4260-858f-d192056df51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:09.468918 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-051d9aa2-16c5-4260-858f-d192056df51c None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:51:09.470144 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-051d9aa2-16c5-4260-858f-d192056df51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:51:09.478495 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1241/2479] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:51:09.482953 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f3c81-8910-456f-b9b5-5eb1b8b8780a None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:51:09.493267 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625f3c81-8910-456f-b9b5-5eb1b8b8780a None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:51:09.498590 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78249bb-e621-4959-9b8b-0ac8ed2e93c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:51:09.499193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78249bb-e621-4959-9b8b-0ac8ed2e93c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:09.499463 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78249bb-e621-4959-9b8b-0ac8ed2e93c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:09.499778 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78249bb-e621-4959-9b8b-0ac8ed2e93c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:09.500432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78249bb-e621-4959-9b8b-0ac8ed2e93c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:51:09.500728 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78249bb-e621-4959-9b8b-0ac8ed2e93c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:51:09.502444 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78249bb-e621-4959-9b8b-0ac8ed2e93c4 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:51:09.515491 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1239/2480] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:51:09.520420 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d9aa2-16c5-4260-858f-d192056df51c None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:51:09.529961 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d9aa2-16c5-4260-858f-d192056df51c None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:51:09.535623 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d41a26-0db2-4511-ba6c-3b695ab0bd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:51:09.536310 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d41a26-0db2-4511-ba6c-3b695ab0bd72 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:09.536582 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d41a26-0db2-4511-ba6c-3b695ab0bd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:09.536846 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d41a26-0db2-4511-ba6c-3b695ab0bd72 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:09.537504 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d41a26-0db2-4511-ba6c-3b695ab0bd72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:51:09.539473 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d41a26-0db2-4511-ba6c-3b695ab0bd72 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:51:09.572482 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1242/2481] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:51:09 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:51:09.574004 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78249bb-e621-4959-9b8b-0ac8ed2e93c4 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:51:09.584805 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78249bb-e621-4959-9b8b-0ac8ed2e93c4 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:51:09.646710 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ead86-20fd-49a0-855f-72815764782e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:51:09.647306 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ead86-20fd-49a0-855f-72815764782e admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:09.647569 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ead86-20fd-49a0-855f-72815764782e admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:09.647866 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ead86-20fd-49a0-855f-72815764782e admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:09.648512 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ead86-20fd-49a0-855f-72815764782e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:51:09.650432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ead86-20fd-49a0-855f-72815764782e admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:51:09.672639 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1240/2482] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:51:09 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:51:09.676792 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d41a26-0db2-4511-ba6c-3b695ab0bd72 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:51:09.687275 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d41a26-0db2-4511-ba6c-3b695ab0bd72 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:51:09.692316 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41dba33-0104-4ca6-b206-9354684101fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:51:09.693003 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dba33-0104-4ca6-b206-9354684101fb admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:09.693958 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dba33-0104-4ca6-b206-9354684101fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:09.693958 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dba33-0104-4ca6-b206-9354684101fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:09.694412 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41dba33-0104-4ca6-b206-9354684101fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:51:09.696071 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41dba33-0104-4ca6-b206-9354684101fb admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:51:09.713845 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1243/2483] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:51:09.718589 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ead86-20fd-49a0-855f-72815764782e admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:51:09.729022 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ead86-20fd-49a0-855f-72815764782e admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:51:09.734465 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2951c-f405-4aea-8d8a-6a9f0e1fde52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:51:09.735097 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2951c-f405-4aea-8d8a-6a9f0e1fde52 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:09.735355 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2951c-f405-4aea-8d8a-6a9f0e1fde52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:09.735624 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2951c-f405-4aea-8d8a-6a9f0e1fde52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:09.736362 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e2951c-f405-4aea-8d8a-6a9f0e1fde52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:51:09.738035 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e2951c-f405-4aea-8d8a-6a9f0e1fde52 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:51:09.742993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7d279-7788-465b-8740-667f0fd758c1 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:09.743456 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7d279-7788-465b-8740-667f0fd758c1 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:09.743546 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7d279-7788-465b-8740-667f0fd758c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:09.750782 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1241/2484] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:51:09.754947 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2951c-f405-4aea-8d8a-6a9f0e1fde52 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:51:09.764970 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2951c-f405-4aea-8d8a-6a9f0e1fde52 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:51:09.765747 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-22b7d279-7788-465b-8740-667f0fd758c1 None None] MFA Rules not processed for user `1aebaf488289488387d0b9efa7818285`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:51:09.766948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-22b7d279-7788-465b-8740-667f0fd758c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:51:09.769586 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626585c-b122-44ba-9b5c-b33bd3473dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:51:09.770234 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626585c-b122-44ba-9b5c-b33bd3473dd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:09.770511 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626585c-b122-44ba-9b5c-b33bd3473dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:09.770943 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626585c-b122-44ba-9b5c-b33bd3473dd5 admin admin] PATH_INFO: `/v3/projects/37dc6cb86ab3460a9ef7eddbcbae953d/users/0b6bc601f9f74d55b7c1a0033cf7c06c/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:09.787396 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626585c-b122-44ba-9b5c-b33bd3473dd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37dc6cb86ab3460a9ef7eddbcbae953d, user_id=0b6bc601f9f74d55b7c1a0033cf7c06c, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:51:09.790057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626585c-b122-44ba-9b5c-b33bd3473dd5 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:51:09.803858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1242/2485] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:51:09 2022] PUT /identity/v3/projects/37dc6cb86ab3460a9ef7eddbcbae953d/users/0b6bc601f9f74d55b7c1a0033cf7c06c/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:51:09.808901 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad040d5c-87d7-4c87-8812-b38955170bf4 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:09.809427 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad040d5c-87d7-4c87-8812-b38955170bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:09.809909 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad040d5c-87d7-4c87-8812-b38955170bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:09.824601 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1244/2486] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:51:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:51:09.828696 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-ad040d5c-87d7-4c87-8812-b38955170bf4 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:51:09.830049 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ad040d5c-87d7-4c87-8812-b38955170bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:51:09.860106 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:51:09.895910 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1243/2487] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:51:09.905805 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7d279-7788-465b-8740-667f0fd758c1 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:51:09.907479 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-22b7d279-7788-465b-8740-667f0fd758c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:51:09.968763 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7d279-7788-465b-8740-667f0fd758c1 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:51:10.018732 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:51:10.026061 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc3e2c-aa80-4690-a9d2-dc784c16a9b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:51:10.026698 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc3e2c-aa80-4690-a9d2-dc784c16a9b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:10.027012 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc3e2c-aa80-4690-a9d2-dc784c16a9b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:10.027291 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc3e2c-aa80-4690-a9d2-dc784c16a9b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:10.038334 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc3e2c-aa80-4690-a9d2-dc784c16a9b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:51:10.039867 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc3e2c-aa80-4690-a9d2-dc784c16a9b4 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:51:10.050103 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1245/2488] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:51:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:51:15.686129 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462d4d3-5cf1-47a5-97a3-feedd49b86bc None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:15.687043 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462d4d3-5cf1-47a5-97a3-feedd49b86bc None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:15.687525 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9462d4d3-5cf1-47a5-97a3-feedd49b86bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:15.744004 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-9462d4d3-5cf1-47a5-97a3-feedd49b86bc None None] MFA Rules not processed for user `0b6bc601f9f74d55b7c1a0033cf7c06c`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:51:15.746767 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-9462d4d3-5cf1-47a5-97a3-feedd49b86bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:51:15.814566 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1244/2489] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:51:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:51:15.819272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc3e2c-aa80-4690-a9d2-dc784c16a9b4 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:51:15.833982 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc3e2c-aa80-4690-a9d2-dc784c16a9b4 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:51:15.839286 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9af9c-db4f-42fa-8ecc-4816bc95f4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:51:15.840158 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9af9c-db4f-42fa-8ecc-4816bc95f4c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:15.840525 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9af9c-db4f-42fa-8ecc-4816bc95f4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:15.840887 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9af9c-db4f-42fa-8ecc-4816bc95f4c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:15.841784 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9af9c-db4f-42fa-8ecc-4816bc95f4c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:51:15.843874 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9af9c-db4f-42fa-8ecc-4816bc95f4c4 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:51:15.875119 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1246/2490] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:51:15 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:51:15.879225 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462d4d3-5cf1-47a5-97a3-feedd49b86bc None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:51:15.890418 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9462d4d3-5cf1-47a5-97a3-feedd49b86bc None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:51:15.954892 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3d66b-b7a2-4636-8b4e-4ecafc9d9bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:51:15.955502 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3d66b-b7a2-4636-8b4e-4ecafc9d9bcb admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:15.955787 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3d66b-b7a2-4636-8b4e-4ecafc9d9bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:15.956107 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3d66b-b7a2-4636-8b4e-4ecafc9d9bcb admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:15.956737 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f3d66b-b7a2-4636-8b4e-4ecafc9d9bcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:51:15.958712 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f3d66b-b7a2-4636-8b4e-4ecafc9d9bcb admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:51:15.985475 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1245/2491] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:51:15 2022] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:51:15.986937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9af9c-db4f-42fa-8ecc-4816bc95f4c4 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:51:15.998280 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9af9c-db4f-42fa-8ecc-4816bc95f4c4 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:51:16.004008 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3492d-b53e-47cc-8524-99dc35a8f8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:51:16.004725 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3492d-b53e-47cc-8524-99dc35a8f8bb admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:16.005066 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3492d-b53e-47cc-8524-99dc35a8f8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:16.005865 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3492d-b53e-47cc-8524-99dc35a8f8bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:16.006116 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3492d-b53e-47cc-8524-99dc35a8f8bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:51:16.007881 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3492d-b53e-47cc-8524-99dc35a8f8bb admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:51:16.018668 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1247/2492] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:51:16.023192 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3d66b-b7a2-4636-8b4e-4ecafc9d9bcb admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:51:16.034544 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3d66b-b7a2-4636-8b4e-4ecafc9d9bcb admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:51:16.041010 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07cdfd6-940c-49f1-b84e-ef575323e3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:51:16.041705 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cdfd6-940c-49f1-b84e-ef575323e3c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:16.041980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cdfd6-940c-49f1-b84e-ef575323e3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:16.042251 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cdfd6-940c-49f1-b84e-ef575323e3c5 admin admin] PATH_INFO: `/v3/projects/8a0f97f755b741a29360772e2c99f844/users/803a55d48c1f4b5ca335af4d5c984386/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:16.064525 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07cdfd6-940c-49f1-b84e-ef575323e3c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a0f97f755b741a29360772e2c99f844, user_id=803a55d48c1f4b5ca335af4d5c984386, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:51:16.067217 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07cdfd6-940c-49f1-b84e-ef575323e3c5 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:51:16.083893 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1246/2493] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:51:16 2022] PUT /identity/v3/projects/8a0f97f755b741a29360772e2c99f844/users/803a55d48c1f4b5ca335af4d5c984386/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:51:16.088198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3492d-b53e-47cc-8524-99dc35a8f8bb admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:51:16.099773 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3492d-b53e-47cc-8524-99dc35a8f8bb admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:51:16.163082 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25daf08-1dca-4f91-808b-b56245ccba62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:51:16.163712 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25daf08-1dca-4f91-808b-b56245ccba62 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:16.164016 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25daf08-1dca-4f91-808b-b56245ccba62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:16.164283 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25daf08-1dca-4f91-808b-b56245ccba62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:16.164929 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25daf08-1dca-4f91-808b-b56245ccba62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:51:16.166581 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25daf08-1dca-4f91-808b-b56245ccba62 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:51:16.177877 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1248/2494] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:51:16.182475 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07cdfd6-940c-49f1-b84e-ef575323e3c5 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:51:16.193185 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07cdfd6-940c-49f1-b84e-ef575323e3c5 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:51:16.198346 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183186b3-43fb-4fe2-b15a-90b0d460af45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:51:16.199025 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183186b3-43fb-4fe2-b15a-90b0d460af45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:16.199295 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183186b3-43fb-4fe2-b15a-90b0d460af45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:16.199553 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183186b3-43fb-4fe2-b15a-90b0d460af45 admin admin] PATH_INFO: `/v3/projects/8a0f97f755b741a29360772e2c99f844/users/803a55d48c1f4b5ca335af4d5c984386/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:16.201610 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183186b3-43fb-4fe2-b15a-90b0d460af45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a0f97f755b741a29360772e2c99f844, user_id=803a55d48c1f4b5ca335af4d5c984386, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:51:16.204455 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183186b3-43fb-4fe2-b15a-90b0d460af45 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:51:16.216616 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1247/2495] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:51:16 2022] PUT /identity/v3/projects/8a0f97f755b741a29360772e2c99f844/users/803a55d48c1f4b5ca335af4d5c984386/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:51:21.282088 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfc498-07c1-46ff-a89a-9c1f7c34126e None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:21.282569 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfc498-07c1-46ff-a89a-9c1f7c34126e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:21.283250 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfc498-07c1-46ff-a89a-9c1f7c34126e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:21.317446 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c4dfc498-07c1-46ff-a89a-9c1f7c34126e None None] MFA Rules not processed for user `803a55d48c1f4b5ca335af4d5c984386`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:51:21.318653 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c4dfc498-07c1-46ff-a89a-9c1f7c34126e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:51:21.405782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1249/2496] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:51:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:51:21.416691 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183186b3-43fb-4fe2-b15a-90b0d460af45 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:51:21.421818 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-183186b3-43fb-4fe2-b15a-90b0d460af45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:51:21.446666 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:51:21.500416 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183186b3-43fb-4fe2-b15a-90b0d460af45 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:51:21.504093 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420c500-6904-419a-970a-709d81fc38f7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '766ad3d6be374fc482a7c0bf6a1e56ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:51:21.504821 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420c500-6904-419a-970a-709d81fc38f7 service glance] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:21.505163 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420c500-6904-419a-970a-709d81fc38f7 service glance] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:21.505485 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420c500-6904-419a-970a-709d81fc38f7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:21.563381 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5420c500-6904-419a-970a-709d81fc38f7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:51:21.564899 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5420c500-6904-419a-970a-709d81fc38f7 service glance] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:51:21.573541 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1248/2497] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:51:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:51:21.711648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c9618-eea8-48fe-88be-52a64a0cf17d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:21.712015 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c9618-eea8-48fe-88be-52a64a0cf17d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:21.712361 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c9618-eea8-48fe-88be-52a64a0cf17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:21.733245 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-6d9c9618-eea8-48fe-88be-52a64a0cf17d None None] MFA Rules not processed for user `5bdaf32400b94aa291ad43a3131e1d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:51:21.734452 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6d9c9618-eea8-48fe-88be-52a64a0cf17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:51:21.772621 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:51:21.796968 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1250/2498] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Sep 26 05:51:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:51:21.855492 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420c500-6904-419a-970a-709d81fc38f7 service glance] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:51:21.857027 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5420c500-6904-419a-970a-709d81fc38f7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:51:21.937895 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420c500-6904-419a-970a-709d81fc38f7 service glance] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:51:21.942835 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e9b0b-0fc8-4bc9-9304-02a0e86413ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '830cd52ac42548b2ade17b5215aefd28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:51:21.943446 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e9b0b-0fc8-4bc9-9304-02a0e86413ad service swift] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:21.943722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e9b0b-0fc8-4bc9-9304-02a0e86413ad service swift] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:21.944014 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e9b0b-0fc8-4bc9-9304-02a0e86413ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:21.953531 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e9b0b-0fc8-4bc9-9304-02a0e86413ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:51:21.954662 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e9b0b-0fc8-4bc9-9304-02a0e86413ad service swift] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:51:21.963304 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1249/2499] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 26 05:51:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 05:51:31.453478 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a3e17-8ceb-45fd-8ca6-3c2cba1c6206 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:31.454101 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a3e17-8ceb-45fd-8ca6-3c2cba1c6206 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:31.454101 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a3e17-8ceb-45fd-8ca6-3c2cba1c6206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:31.473940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-285a3e17-8ceb-45fd-8ca6-3c2cba1c6206 None None] MFA Rules not processed for user `0b6bc601f9f74d55b7c1a0033cf7c06c`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:51:31.475155 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-285a3e17-8ceb-45fd-8ca6-3c2cba1c6206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:51:31.482924 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1251/2500] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:51:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:51:31.793911 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e9b0b-0fc8-4bc9-9304-02a0e86413ad service swift] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:51:31.853878 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e9b0b-0fc8-4bc9-9304-02a0e86413ad service swift] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:51:31.857881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b2a5c-0ade-485c-b785-0d557aa453fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:51:31.858485 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b2a5c-0ade-485c-b785-0d557aa453fa service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:31.858758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b2a5c-0ade-485c-b785-0d557aa453fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:31.859017 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b2a5c-0ade-485c-b785-0d557aa453fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:31.860949 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b91b2a5c-0ade-485c-b785-0d557aa453fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:51:31.871381 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b2a5c-0ade-485c-b785-0d557aa453fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:51:31.872889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b2a5c-0ade-485c-b785-0d557aa453fa service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:51:31.881322 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1250/2501] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:51:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:51:34.186283 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492eefd-e700-4f69-871a-5526a3aa3341 None None] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:34.187290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492eefd-e700-4f69-871a-5526a3aa3341 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:34.188034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3492eefd-e700-4f69-871a-5526a3aa3341 None None] PATH_INFO: `/` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:34.191067 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1252/2502] 10.222.0.66 () {54 vars in 921 bytes} [Mon Sep 26 05:51:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:51:34.198830 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6deda5-b46b-4c1a-80b1-318e5ff6ad7e None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:34.199419 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6deda5-b46b-4c1a-80b1-318e5ff6ad7e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:34.199832 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6deda5-b46b-4c1a-80b1-318e5ff6ad7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:34.215842 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:51:34.246121 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-ba6deda5-b46b-4c1a-80b1-318e5ff6ad7e None None] MFA Rules not processed for user `26b3d51ac6ca41cf9e535e751ac94675`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:51:34.248714 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ba6deda5-b46b-4c1a-80b1-318e5ff6ad7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:51:34.260804 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1251/2503] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Sep 26 05:51:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:51:34.277380 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492eefd-e700-4f69-871a-5526a3aa3341 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:51:34.280468 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3492eefd-e700-4f69-871a-5526a3aa3341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:51:34.310438 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3492eefd-e700-4f69-871a-5526a3aa3341 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:51:34.319971 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd85fc-83b3-4a29-908b-f13f8c2c47f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:51:34.321516 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd85fc-83b3-4a29-908b-f13f8c2c47f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:34.322251 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd85fc-83b3-4a29-908b-f13f8c2c47f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:34.322996 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd85fc-83b3-4a29-908b-f13f8c2c47f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:34.338485 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd85fc-83b3-4a29-908b-f13f8c2c47f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:51:34.341927 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd85fc-83b3-4a29-908b-f13f8c2c47f3 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:51:34.358513 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1253/2504] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:51:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:51:34.476431 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d2490-2598-4d1c-ad71-6d6f5bc3182b None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:34.476804 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d2490-2598-4d1c-ad71-6d6f5bc3182b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:34.476965 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d2490-2598-4d1c-ad71-6d6f5bc3182b None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:34.478601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1252/2505] 10.222.0.66 () {54 vars in 921 bytes} [Mon Sep 26 05:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:51:34.485646 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c462a0e-ae2b-425b-9aac-a3b772c1cc5a None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:34.486092 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c462a0e-ae2b-425b-9aac-a3b772c1cc5a None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:34.486548 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c462a0e-ae2b-425b-9aac-a3b772c1cc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:34.511675 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-9c462a0e-ae2b-425b-9aac-a3b772c1cc5a None None] MFA Rules not processed for user `c559a36836be411b9afd076f4c9a0655`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:51:34.513079 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9c462a0e-ae2b-425b-9aac-a3b772c1cc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:51:34.591552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6b4c6-f4ca-467d-9ccd-216caaf71ee6 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:34.592085 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6b4c6-f4ca-467d-9ccd-216caaf71ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:34.592456 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6b4c6-f4ca-467d-9ccd-216caaf71ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:34.616788 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1254/2506] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Sep 26 05:51:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:51:34.630029 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-48b6b4c6-f4ca-467d-9ccd-216caaf71ee6 None None] MFA Rules not processed for user `5bdaf32400b94aa291ad43a3131e1d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:51:34.630334 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c462a0e-ae2b-425b-9aac-a3b772c1cc5a None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:51:34.632460 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-48b6b4c6-f4ca-467d-9ccd-216caaf71ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:51:34.640071 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c462a0e-ae2b-425b-9aac-a3b772c1cc5a None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:51:34.646100 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1253/2507] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Sep 26 05:51:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:51:34.646329 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60bafb7-95e3-44c6-bb24-50143dcef3ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:51:34.646329 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bafb7-95e3-44c6-bb24-50143dcef3ac service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:34.646519 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bafb7-95e3-44c6-bb24-50143dcef3ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:34.646837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60bafb7-95e3-44c6-bb24-50143dcef3ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:34.661824 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60bafb7-95e3-44c6-bb24-50143dcef3ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:51:34.663576 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60bafb7-95e3-44c6-bb24-50143dcef3ac service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:51:34.664784 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6b4c6-f4ca-467d-9ccd-216caaf71ee6 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:51:34.677158 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1255/2508] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:51:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:51:34.682155 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6b4c6-f4ca-467d-9ccd-216caaf71ee6 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:51:34.690923 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5ab49-f816-4588-b1ad-afddb06c385c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '830cd52ac42548b2ade17b5215aefd28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:51:34.691580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5ab49-f816-4588-b1ad-afddb06c385c service swift] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:51:34.691902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5ab49-f816-4588-b1ad-afddb06c385c service swift] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:51:34.692169 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d5ab49-f816-4588-b1ad-afddb06c385c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:51:34.704445 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5ab49-f816-4588-b1ad-afddb06c385c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:51:34.711684 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d5ab49-f816-4588-b1ad-afddb06c385c service swift] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:51:34.724382 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1254/2509] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 26 05:51:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 05:51:44.672541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=54 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:51:44.720804 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=11 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:06.986571 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60bafb7-95e3-44c6-bb24-50143dcef3ac service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:06.996740 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60bafb7-95e3-44c6-bb24-50143dcef3ac service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:07.000776 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5483f-765c-447e-b572-2d28430fb729 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:07.001443 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5483f-765c-447e-b572-2d28430fb729 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:07.001716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5483f-765c-447e-b572-2d28430fb729 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:07.001978 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5483f-765c-447e-b572-2d28430fb729 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:07.013442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f5483f-765c-447e-b572-2d28430fb729 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:07.015233 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f5483f-765c-447e-b572-2d28430fb729 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:07.026936 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1256/2510] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:52:06 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:52:08.997475 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5ab49-f816-4588-b1ad-afddb06c385c service swift] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:08.999355 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-03d5ab49-f816-4588-b1ad-afddb06c385c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:09.026012 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d5ab49-f816-4588-b1ad-afddb06c385c service swift] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:09.034025 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545001e-51a7-4ced-a99e-80599cf718b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:09.034380 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545001e-51a7-4ced-a99e-80599cf718b3 service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:09.034699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545001e-51a7-4ced-a99e-80599cf718b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:09.035061 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545001e-51a7-4ced-a99e-80599cf718b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:09.037668 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-9545001e-51a7-4ced-a99e-80599cf718b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:09.106734 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9545001e-51a7-4ced-a99e-80599cf718b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:09.108953 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9545001e-51a7-4ced-a99e-80599cf718b3 service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:09.121439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1255/2511] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:52:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:52:17.021631 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=6 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:17.210675 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5483f-765c-447e-b572-2d28430fb729 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:17.223710 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5483f-765c-447e-b572-2d28430fb729 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:17.227777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c5b93-3eb9-4ac9-a86a-8ae3edb07419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:17.228397 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c5b93-3eb9-4ac9-a86a-8ae3edb07419 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:17.228672 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c5b93-3eb9-4ac9-a86a-8ae3edb07419 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:17.229039 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c5b93-3eb9-4ac9-a86a-8ae3edb07419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:17.231203 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-741c5b93-3eb9-4ac9-a86a-8ae3edb07419 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:17.298929 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c5b93-3eb9-4ac9-a86a-8ae3edb07419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:17.300413 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c5b93-3eb9-4ac9-a86a-8ae3edb07419 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:17.311664 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1257/2512] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:52:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:52:19.116093 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=28 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:20.622177 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545001e-51a7-4ced-a99e-80599cf718b3 service nova] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:20.623554 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-9545001e-51a7-4ced-a99e-80599cf718b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:20.677120 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c5b93-3eb9-4ac9-a86a-8ae3edb07419 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:20.679479 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-741c5b93-3eb9-4ac9-a86a-8ae3edb07419 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:20.765696 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c5b93-3eb9-4ac9-a86a-8ae3edb07419 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:20.770197 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14223e6-0547-4006-b346-e94e272448a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:20.770827 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14223e6-0547-4006-b346-e94e272448a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:20.771097 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14223e6-0547-4006-b346-e94e272448a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:20.771363 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14223e6-0547-4006-b346-e94e272448a1 admin admin] PATH_INFO: `/v3/users/5224b2ba12d54146855fe3a993dc0915` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:20.772509 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14223e6-0547-4006-b346-e94e272448a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5224b2ba12d54146855fe3a993dc0915)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:20.774433 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14223e6-0547-4006-b346-e94e272448a1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:20.789708 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545001e-51a7-4ced-a99e-80599cf718b3 service nova] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:20.796538 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280bf62-1dd9-4f18-942e-c0bf021dcf01 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895edcfb20484b188a3877c9de8b59c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:20.797636 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280bf62-1dd9-4f18-942e-c0bf021dcf01 service placement] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:20.797893 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280bf62-1dd9-4f18-942e-c0bf021dcf01 service placement] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:20.798242 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280bf62-1dd9-4f18-942e-c0bf021dcf01 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:20.800743 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5280bf62-1dd9-4f18-942e-c0bf021dcf01 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:20.813205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280bf62-1dd9-4f18-942e-c0bf021dcf01 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:20.814867 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280bf62-1dd9-4f18-942e-c0bf021dcf01 service placement] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:20.830250 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e14223e6-0547-4006-b346-e94e272448a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5224b2ba12d54146855fe3a993dc0915'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:20.835559 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1256/2513] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:52:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:52:20.840078 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e14223e6-0547-4006-b346-e94e272448a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5224b2ba12d54146855fe3a993dc0915'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:20.841301 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e14223e6-0547-4006-b346-e94e272448a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5224b2ba12d54146855fe3a993dc0915'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:20.856514 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e14223e6-0547-4006-b346-e94e272448a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5224b2ba12d54146855fe3a993dc0915'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:20.864530 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e14223e6-0547-4006-b346-e94e272448a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5224b2ba12d54146855fe3a993dc0915'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:20.872614 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1258/2514] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:52:20 2022] DELETE /identity/v3/users/5224b2ba12d54146855fe3a993dc0915 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:52:21.095437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280bf62-1dd9-4f18-942e-c0bf021dcf01 service placement] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:21.108430 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280bf62-1dd9-4f18-942e-c0bf021dcf01 service placement] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:21.176145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f605bc9-2357-4b1c-878e-71990ae978be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:21.176799 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f605bc9-2357-4b1c-878e-71990ae978be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:21.177073 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f605bc9-2357-4b1c-878e-71990ae978be admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:21.177338 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f605bc9-2357-4b1c-878e-71990ae978be admin admin] PATH_INFO: `/v3/projects/1046a4541e884c7b869d8f4830e58a6c` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:21.178544 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f605bc9-2357-4b1c-878e-71990ae978be admin admin] RBAC: Authorizing `identity:delete_project(project_id=1046a4541e884c7b869d8f4830e58a6c)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:21.180600 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f605bc9-2357-4b1c-878e-71990ae978be admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:21.207770 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:21.235238 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-5f605bc9-2357-4b1c-878e-71990ae978be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1046a4541e884c7b869d8f4830e58a6c', 'request_id': 'req-5f605bc9-2357-4b1c-878e-71990ae978be'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:21.249332 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-5f605bc9-2357-4b1c-878e-71990ae978be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1046a4541e884c7b869d8f4830e58a6c', 'request_id': 'req-5f605bc9-2357-4b1c-878e-71990ae978be'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:21.256251 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-5f605bc9-2357-4b1c-878e-71990ae978be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1046a4541e884c7b869d8f4830e58a6c', 'request_id': 'req-5f605bc9-2357-4b1c-878e-71990ae978be'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:21.268691 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-5f605bc9-2357-4b1c-878e-71990ae978be admin admin] The token cache is being invalidate because project 1046a4541e884c7b869d8f4830e58a6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:52:21.268691 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-5f605bc9-2357-4b1c-878e-71990ae978be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:21.269818 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-5f605bc9-2357-4b1c-878e-71990ae978be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:21.271181 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1257/2515] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:52:21 2022] DELETE /identity/v3/projects/1046a4541e884c7b869d8f4830e58a6c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:52:21.282150 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280b006-cd6b-4202-b37e-cb76c5df9b20 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:21.282430 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280b006-cd6b-4202-b37e-cb76c5df9b20 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:21.282699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280b006-cd6b-4202-b37e-cb76c5df9b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:21.288871 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:21.350246 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-9280b006-cd6b-4202-b37e-cb76c5df9b20 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:52:21.351461 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9280b006-cd6b-4202-b37e-cb76c5df9b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:21.417349 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1259/2516] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:52:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:52:21.426072 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff920387-e098-4258-8965-bb65dde35010 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:21.426365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff920387-e098-4258-8965-bb65dde35010 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:21.426654 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff920387-e098-4258-8965-bb65dde35010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:21.447619 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-ff920387-e098-4258-8965-bb65dde35010 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:52:21.448902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ff920387-e098-4258-8965-bb65dde35010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:21.457915 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1258/2517] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:52:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:52:21.463529 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280b006-cd6b-4202-b37e-cb76c5df9b20 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:21.474042 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280b006-cd6b-4202-b37e-cb76c5df9b20 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:21.479552 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb41383-6705-4ab3-ba11-104d7aed3abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:21.480199 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb41383-6705-4ab3-ba11-104d7aed3abe admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:21.480469 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb41383-6705-4ab3-ba11-104d7aed3abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:21.480734 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb41383-6705-4ab3-ba11-104d7aed3abe admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:21.481383 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb41383-6705-4ab3-ba11-104d7aed3abe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:52:21.481772 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb41383-6705-4ab3-ba11-104d7aed3abe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:21.483299 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb41383-6705-4ab3-ba11-104d7aed3abe admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:21.497936 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1260/2518] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:52:21.502538 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff920387-e098-4258-8965-bb65dde35010 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:21.513166 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff920387-e098-4258-8965-bb65dde35010 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:21.518768 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9994b-3d2f-4ec7-9fbf-cbe6ba86bbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:21.519327 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9994b-3d2f-4ec7-9fbf-cbe6ba86bbd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:21.519596 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9994b-3d2f-4ec7-9fbf-cbe6ba86bbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:21.519890 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9994b-3d2f-4ec7-9fbf-cbe6ba86bbd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:21.520538 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9994b-3d2f-4ec7-9fbf-cbe6ba86bbd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:21.522471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9994b-3d2f-4ec7-9fbf-cbe6ba86bbd7 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:21.556053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1259/2519] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:52:21 2022] POST /identity/v3/projects => generated 363 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:52:21.560815 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb41383-6705-4ab3-ba11-104d7aed3abe admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:21.574059 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb41383-6705-4ab3-ba11-104d7aed3abe admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:21.657961 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa44c9-94f5-4f71-aa28-189211f62de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:21.658660 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa44c9-94f5-4f71-aa28-189211f62de1 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:21.658973 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa44c9-94f5-4f71-aa28-189211f62de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:21.659457 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa44c9-94f5-4f71-aa28-189211f62de1 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:21.660267 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa44c9-94f5-4f71-aa28-189211f62de1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:21.662636 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa44c9-94f5-4f71-aa28-189211f62de1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:21.693520 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1261/2520] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:52:21 2022] POST /identity/v3/users => generated 282 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:52:21.697795 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9994b-3d2f-4ec7-9fbf-cbe6ba86bbd7 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:21.711349 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9994b-3d2f-4ec7-9fbf-cbe6ba86bbd7 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:21.719489 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee750df-26a4-4827-aa8d-599d8e1681eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:21.720578 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee750df-26a4-4827-aa8d-599d8e1681eb admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:21.720866 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee750df-26a4-4827-aa8d-599d8e1681eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:21.721826 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee750df-26a4-4827-aa8d-599d8e1681eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:21.723072 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee750df-26a4-4827-aa8d-599d8e1681eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:21.725388 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee750df-26a4-4827-aa8d-599d8e1681eb admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:21.737182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1260/2521] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:52:21.742683 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa44c9-94f5-4f71-aa28-189211f62de1 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:21.753820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa44c9-94f5-4f71-aa28-189211f62de1 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:21.759080 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e56361-7ec0-487e-9549-7fb5787c6c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:21.759761 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e56361-7ec0-487e-9549-7fb5787c6c8f admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:21.760033 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e56361-7ec0-487e-9549-7fb5787c6c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:21.760305 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e56361-7ec0-487e-9549-7fb5787c6c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:21.761035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e56361-7ec0-487e-9549-7fb5787c6c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:21.762767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e56361-7ec0-487e-9549-7fb5787c6c8f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:21.777873 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1262/2522] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:52:21.785274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee750df-26a4-4827-aa8d-599d8e1681eb admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:21.801266 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee750df-26a4-4827-aa8d-599d8e1681eb admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:21.806875 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f65798-ece7-4926-bbfe-96487dca0fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:21.807553 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f65798-ece7-4926-bbfe-96487dca0fc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:21.807868 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f65798-ece7-4926-bbfe-96487dca0fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:21.808134 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f65798-ece7-4926-bbfe-96487dca0fc6 admin admin] PATH_INFO: `/v3/projects/49bc67987bac47a2a574353d3dc90fcc/users/fffacdc191244e3e87476d1b25f97f3d/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:21.824638 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f65798-ece7-4926-bbfe-96487dca0fc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49bc67987bac47a2a574353d3dc90fcc, user_id=fffacdc191244e3e87476d1b25f97f3d, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:21.827339 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f65798-ece7-4926-bbfe-96487dca0fc6 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:21.843110 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1261/2523] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:52:21 2022] PUT /identity/v3/projects/49bc67987bac47a2a574353d3dc90fcc/users/fffacdc191244e3e87476d1b25f97f3d/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:52:21.854016 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41a4e6-b0f8-4b4c-aef9-c93713a69b90 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:21.854292 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41a4e6-b0f8-4b4c-aef9-c93713a69b90 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:21.854581 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41a4e6-b0f8-4b4c-aef9-c93713a69b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:21.884450 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-4b41a4e6-b0f8-4b4c-aef9-c93713a69b90 None None] MFA Rules not processed for user `fffacdc191244e3e87476d1b25f97f3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:52:21.885681 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4b41a4e6-b0f8-4b4c-aef9-c93713a69b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:21.916401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:21.955466 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1263/2524] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:52:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:52:21.960369 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f65798-ece7-4926-bbfe-96487dca0fc6 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:22.027341 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f65798-ece7-4926-bbfe-96487dca0fc6 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:22.035635 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27e09a-3e7b-4f93-a0cd-3f0fcffbb883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:22.036606 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27e09a-3e7b-4f93-a0cd-3f0fcffbb883 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:22.037070 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27e09a-3e7b-4f93-a0cd-3f0fcffbb883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:22.037553 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27e09a-3e7b-4f93-a0cd-3f0fcffbb883 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:22.038719 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f27e09a-3e7b-4f93-a0cd-3f0fcffbb883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:22.042467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f27e09a-3e7b-4f93-a0cd-3f0fcffbb883 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:22.084296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1262/2525] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:52:21 2022] POST /identity/v3/projects => generated 365 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:52:22.088592 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41a4e6-b0f8-4b4c-aef9-c93713a69b90 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:22.100718 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41a4e6-b0f8-4b4c-aef9-c93713a69b90 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:22.168744 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c55fa-d27c-4a41-bcd2-2e899f7b5a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:22.169368 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c55fa-d27c-4a41-bcd2-2e899f7b5a47 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:22.169641 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c55fa-d27c-4a41-bcd2-2e899f7b5a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:22.169908 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c55fa-d27c-4a41-bcd2-2e899f7b5a47 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:22.170558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c55fa-d27c-4a41-bcd2-2e899f7b5a47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:22.172584 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c55fa-d27c-4a41-bcd2-2e899f7b5a47 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:22.196142 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1264/2526] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:52:22 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:52:22.200467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27e09a-3e7b-4f93-a0cd-3f0fcffbb883 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:22.211952 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27e09a-3e7b-4f93-a0cd-3f0fcffbb883 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:22.217475 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304536f7-085b-4afb-bdcf-6448867b1967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:22.218103 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304536f7-085b-4afb-bdcf-6448867b1967 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:22.218374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304536f7-085b-4afb-bdcf-6448867b1967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:22.218636 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304536f7-085b-4afb-bdcf-6448867b1967 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:22.219281 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304536f7-085b-4afb-bdcf-6448867b1967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:22.220922 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304536f7-085b-4afb-bdcf-6448867b1967 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:22.236024 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1263/2527] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:52:22.240706 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c55fa-d27c-4a41-bcd2-2e899f7b5a47 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:22.251619 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c55fa-d27c-4a41-bcd2-2e899f7b5a47 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:22.259328 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a781e7f-d5ef-4394-9124-330c3d66f587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:22.260511 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a781e7f-d5ef-4394-9124-330c3d66f587 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:22.260982 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a781e7f-d5ef-4394-9124-330c3d66f587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:22.261499 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a781e7f-d5ef-4394-9124-330c3d66f587 admin admin] PATH_INFO: `/v3/projects/be3c72a1ab2348a690cb62e5ee3f4ad3/users/43c3aba16621474ab963b9df9bf278b3/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:22.286418 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a781e7f-d5ef-4394-9124-330c3d66f587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be3c72a1ab2348a690cb62e5ee3f4ad3, user_id=43c3aba16621474ab963b9df9bf278b3, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:22.290795 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a781e7f-d5ef-4394-9124-330c3d66f587 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:22.308059 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1265/2528] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:52:22 2022] PUT /identity/v3/projects/be3c72a1ab2348a690cb62e5ee3f4ad3/users/43c3aba16621474ab963b9df9bf278b3/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:52:22.312407 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304536f7-085b-4afb-bdcf-6448867b1967 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:22.323496 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304536f7-085b-4afb-bdcf-6448867b1967 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:22.344012 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:22.398161 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37893a-0a68-4297-9b8b-7342e8fa201f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:22.398927 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37893a-0a68-4297-9b8b-7342e8fa201f admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:22.399221 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37893a-0a68-4297-9b8b-7342e8fa201f admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:22.399474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37893a-0a68-4297-9b8b-7342e8fa201f admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:22.400490 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37893a-0a68-4297-9b8b-7342e8fa201f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:22.402713 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37893a-0a68-4297-9b8b-7342e8fa201f admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:22.415607 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1264/2529] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:52:22.420244 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a781e7f-d5ef-4394-9124-330c3d66f587 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:22.431895 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a781e7f-d5ef-4394-9124-330c3d66f587 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:22.436850 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df9e16-aefb-435c-b044-c06a8768d5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:22.437529 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df9e16-aefb-435c-b044-c06a8768d5f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:22.437806 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df9e16-aefb-435c-b044-c06a8768d5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:22.438079 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df9e16-aefb-435c-b044-c06a8768d5f3 admin admin] PATH_INFO: `/v3/projects/be3c72a1ab2348a690cb62e5ee3f4ad3/users/43c3aba16621474ab963b9df9bf278b3/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:22.440170 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df9e16-aefb-435c-b044-c06a8768d5f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be3c72a1ab2348a690cb62e5ee3f4ad3, user_id=43c3aba16621474ab963b9df9bf278b3, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:22.443083 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df9e16-aefb-435c-b044-c06a8768d5f3 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:22.456199 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1266/2530] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:52:22 2022] PUT /identity/v3/projects/be3c72a1ab2348a690cb62e5ee3f4ad3/users/43c3aba16621474ab963b9df9bf278b3/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:52:22.469861 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b44bc-c74e-49e7-a17b-1d3fbdb91893 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:22.470357 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b44bc-c74e-49e7-a17b-1d3fbdb91893 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:22.470850 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b44bc-c74e-49e7-a17b-1d3fbdb91893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:22.512673 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-982b44bc-c74e-49e7-a17b-1d3fbdb91893 None None] MFA Rules not processed for user `43c3aba16621474ab963b9df9bf278b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:52:22.513962 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-982b44bc-c74e-49e7-a17b-1d3fbdb91893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:22.593947 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1265/2531] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:52:22 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:52:22.606187 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df9e16-aefb-435c-b044-c06a8768d5f3 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:22.608007 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-66df9e16-aefb-435c-b044-c06a8768d5f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:22.675309 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df9e16-aefb-435c-b044-c06a8768d5f3 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:22.680330 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a69f3-f8a3-48aa-99f4-477df12e67fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:22.681022 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a69f3-f8a3-48aa-99f4-477df12e67fd service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:22.681369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a69f3-f8a3-48aa-99f4-477df12e67fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:22.681687 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a69f3-f8a3-48aa-99f4-477df12e67fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:22.693220 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a69f3-f8a3-48aa-99f4-477df12e67fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:22.694886 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a69f3-f8a3-48aa-99f4-477df12e67fd service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:22.707180 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1267/2532] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:52:22 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:52:22.792852 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b44bc-c74e-49e7-a17b-1d3fbdb91893 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:22.804181 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b44bc-c74e-49e7-a17b-1d3fbdb91893 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:22.807921 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335518b-5946-4c9a-ac62-3dfed41c0b48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:22.808552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335518b-5946-4c9a-ac62-3dfed41c0b48 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:22.808810 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335518b-5946-4c9a-ac62-3dfed41c0b48 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:22.809075 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335518b-5946-4c9a-ac62-3dfed41c0b48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:22.872240 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335518b-5946-4c9a-ac62-3dfed41c0b48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:22.873631 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335518b-5946-4c9a-ac62-3dfed41c0b48 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:22.884398 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1266/2533] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:52:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:52:30.271554 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a69f3-f8a3-48aa-99f4-477df12e67fd service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:30.306892 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:30.347603 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a69f3-f8a3-48aa-99f4-477df12e67fd service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:30.352497 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6d11a-744e-4050-bcd1-849f0dba6543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:30.353121 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6d11a-744e-4050-bcd1-849f0dba6543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:30.353395 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6d11a-744e-4050-bcd1-849f0dba6543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:30.353656 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6d11a-744e-4050-bcd1-849f0dba6543 admin admin] PATH_INFO: `/v3/users/fffacdc191244e3e87476d1b25f97f3d` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:30.354794 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6d11a-744e-4050-bcd1-849f0dba6543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fffacdc191244e3e87476d1b25f97f3d)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:30.356772 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee6d11a-744e-4050-bcd1-849f0dba6543 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:30.411951 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-dee6d11a-744e-4050-bcd1-849f0dba6543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fffacdc191244e3e87476d1b25f97f3d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:30.422222 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-dee6d11a-744e-4050-bcd1-849f0dba6543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fffacdc191244e3e87476d1b25f97f3d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:30.423224 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-dee6d11a-744e-4050-bcd1-849f0dba6543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fffacdc191244e3e87476d1b25f97f3d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:30.444574 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-dee6d11a-744e-4050-bcd1-849f0dba6543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fffacdc191244e3e87476d1b25f97f3d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:30.455722 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-dee6d11a-744e-4050-bcd1-849f0dba6543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fffacdc191244e3e87476d1b25f97f3d'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:30.462765 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1268/2534] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:52:30 2022] DELETE /identity/v3/users/fffacdc191244e3e87476d1b25f97f3d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:52:30.467533 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839885ae-34ab-4e1f-bdf1-d78472d10073 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:30.468131 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839885ae-34ab-4e1f-bdf1-d78472d10073 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:30.468131 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839885ae-34ab-4e1f-bdf1-d78472d10073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:30.489536 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-839885ae-34ab-4e1f-bdf1-d78472d10073 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:52:30.490845 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-839885ae-34ab-4e1f-bdf1-d78472d10073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:30.533377 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:30.561594 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1267/2535] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:52:30.571860 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6d11a-744e-4050-bcd1-849f0dba6543 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:30.573370 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-dee6d11a-744e-4050-bcd1-849f0dba6543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:30.642344 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6d11a-744e-4050-bcd1-849f0dba6543 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:30.646163 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a48cb-52c2-46e7-96d4-74abfc28abf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:30.646799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a48cb-52c2-46e7-96d4-74abfc28abf4 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:30.647071 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a48cb-52c2-46e7-96d4-74abfc28abf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:30.647443 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a48cb-52c2-46e7-96d4-74abfc28abf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:30.658339 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a48cb-52c2-46e7-96d4-74abfc28abf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:30.659919 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a48cb-52c2-46e7-96d4-74abfc28abf4 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:30.670640 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1269/2536] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:52:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:52:31.010227 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839885ae-34ab-4e1f-bdf1-d78472d10073 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:31.011101 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-839885ae-34ab-4e1f-bdf1-d78472d10073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:31.025584 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839885ae-34ab-4e1f-bdf1-d78472d10073 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:31.032219 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c1b79-15cc-4327-99f3-f36f956c74f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:31.036951 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c1b79-15cc-4327-99f3-f36f956c74f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:31.037437 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c1b79-15cc-4327-99f3-f36f956c74f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:31.037934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c1b79-15cc-4327-99f3-f36f956c74f9 admin admin] PATH_INFO: `/v3/projects/49bc67987bac47a2a574353d3dc90fcc` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:31.039800 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c1b79-15cc-4327-99f3-f36f956c74f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49bc67987bac47a2a574353d3dc90fcc)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:31.041890 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956c1b79-15cc-4327-99f3-f36f956c74f9 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:31.119019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-956c1b79-15cc-4327-99f3-f36f956c74f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49bc67987bac47a2a574353d3dc90fcc', 'request_id': 'req-956c1b79-15cc-4327-99f3-f36f956c74f9'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:31.128704 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-956c1b79-15cc-4327-99f3-f36f956c74f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49bc67987bac47a2a574353d3dc90fcc', 'request_id': 'req-956c1b79-15cc-4327-99f3-f36f956c74f9'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:31.135792 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-956c1b79-15cc-4327-99f3-f36f956c74f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49bc67987bac47a2a574353d3dc90fcc', 'request_id': 'req-956c1b79-15cc-4327-99f3-f36f956c74f9'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:31.148519 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-956c1b79-15cc-4327-99f3-f36f956c74f9 admin admin] The token cache is being invalidate because project 49bc67987bac47a2a574353d3dc90fcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:52:31.148870 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-956c1b79-15cc-4327-99f3-f36f956c74f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:31.149727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-956c1b79-15cc-4327-99f3-f36f956c74f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:31.151778 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1268/2537] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:52:31 2022] DELETE /identity/v3/projects/49bc67987bac47a2a574353d3dc90fcc => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:52:31.157595 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a48cb-52c2-46e7-96d4-74abfc28abf4 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:31.168079 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a48cb-52c2-46e7-96d4-74abfc28abf4 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:31.247467 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:31.263768 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135984f-1e67-45d0-b98e-d54a8fa5d708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:31.264578 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135984f-1e67-45d0-b98e-d54a8fa5d708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:31.264856 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135984f-1e67-45d0-b98e-d54a8fa5d708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:31.265120 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135984f-1e67-45d0-b98e-d54a8fa5d708 admin admin] PATH_INFO: `/v3/users/43c3aba16621474ab963b9df9bf278b3` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:31.266299 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135984f-1e67-45d0-b98e-d54a8fa5d708 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43c3aba16621474ab963b9df9bf278b3)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:31.268417 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135984f-1e67-45d0-b98e-d54a8fa5d708 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:31.335053 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0135984f-1e67-45d0-b98e-d54a8fa5d708 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43c3aba16621474ab963b9df9bf278b3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:31.344973 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0135984f-1e67-45d0-b98e-d54a8fa5d708 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43c3aba16621474ab963b9df9bf278b3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:31.345602 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0135984f-1e67-45d0-b98e-d54a8fa5d708 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43c3aba16621474ab963b9df9bf278b3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:31.361215 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0135984f-1e67-45d0-b98e-d54a8fa5d708 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43c3aba16621474ab963b9df9bf278b3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:31.369083 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0135984f-1e67-45d0-b98e-d54a8fa5d708 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43c3aba16621474ab963b9df9bf278b3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:31.376702 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1270/2538] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:52:31 2022] DELETE /identity/v3/users/43c3aba16621474ab963b9df9bf278b3 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:52:31.698973 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c1b79-15cc-4327-99f3-f36f956c74f9 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:31.700818 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-956c1b79-15cc-4327-99f3-f36f956c74f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:31.723721 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956c1b79-15cc-4327-99f3-f36f956c74f9 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:31.789483 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01be34-4342-45f5-9feb-8bc4ad607f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:31.790160 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01be34-4342-45f5-9feb-8bc4ad607f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:31.790416 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01be34-4342-45f5-9feb-8bc4ad607f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:31.790690 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01be34-4342-45f5-9feb-8bc4ad607f08 admin admin] PATH_INFO: `/v3/projects/be3c72a1ab2348a690cb62e5ee3f4ad3` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:31.791892 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01be34-4342-45f5-9feb-8bc4ad607f08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be3c72a1ab2348a690cb62e5ee3f4ad3)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:31.793894 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01be34-4342-45f5-9feb-8bc4ad607f08 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:31.846867 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cd01be34-4342-45f5-9feb-8bc4ad607f08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be3c72a1ab2348a690cb62e5ee3f4ad3', 'request_id': 'req-cd01be34-4342-45f5-9feb-8bc4ad607f08'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:31.857502 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cd01be34-4342-45f5-9feb-8bc4ad607f08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be3c72a1ab2348a690cb62e5ee3f4ad3', 'request_id': 'req-cd01be34-4342-45f5-9feb-8bc4ad607f08'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:31.864021 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cd01be34-4342-45f5-9feb-8bc4ad607f08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be3c72a1ab2348a690cb62e5ee3f4ad3', 'request_id': 'req-cd01be34-4342-45f5-9feb-8bc4ad607f08'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:31.866059 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:31.880530 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cd01be34-4342-45f5-9feb-8bc4ad607f08 admin admin] The token cache is being invalidate because project be3c72a1ab2348a690cb62e5ee3f4ad3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:52:31.880987 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cd01be34-4342-45f5-9feb-8bc4ad607f08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:31.881950 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cd01be34-4342-45f5-9feb-8bc4ad607f08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:31.883459 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1269/2539] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:52:31 2022] DELETE /identity/v3/projects/be3c72a1ab2348a690cb62e5ee3f4ad3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:52:31.888646 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cb76c-0841-4e87-a3fa-c285f92357d7 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:31.888922 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cb76c-0841-4e87-a3fa-c285f92357d7 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:31.889191 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cb76c-0841-4e87-a3fa-c285f92357d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:31.913085 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-cc9cb76c-0841-4e87-a3fa-c285f92357d7 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:52:31.914347 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-cc9cb76c-0841-4e87-a3fa-c285f92357d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:31.981466 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1271/2540] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:52:31.989909 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec312d-8b68-41ee-9858-043a171e6bec None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:31.990331 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec312d-8b68-41ee-9858-043a171e6bec None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:31.990687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec312d-8b68-41ee-9858-043a171e6bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:32.013789 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-cbec312d-8b68-41ee-9858-043a171e6bec None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:52:32.015017 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-cbec312d-8b68-41ee-9858-043a171e6bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:32.023519 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1270/2541] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:52:32.028287 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cb76c-0841-4e87-a3fa-c285f92357d7 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:32.039534 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cb76c-0841-4e87-a3fa-c285f92357d7 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:32.047411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826badd-f7bd-481b-91f8-3d17e6e119da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:32.048364 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826badd-f7bd-481b-91f8-3d17e6e119da admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:32.048852 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826badd-f7bd-481b-91f8-3d17e6e119da admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:32.049204 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826badd-f7bd-481b-91f8-3d17e6e119da admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:32.049899 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826badd-f7bd-481b-91f8-3d17e6e119da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:52:32.050334 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826badd-f7bd-481b-91f8-3d17e6e119da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:32.053023 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826badd-f7bd-481b-91f8-3d17e6e119da admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:32.071923 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1272/2542] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:52:32.077083 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec312d-8b68-41ee-9858-043a171e6bec None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:32.087557 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec312d-8b68-41ee-9858-043a171e6bec None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:32.092868 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21619c73-d978-4a8d-bd28-291d9969a6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:32.093488 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21619c73-d978-4a8d-bd28-291d9969a6e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:32.093762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21619c73-d978-4a8d-bd28-291d9969a6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:32.094021 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21619c73-d978-4a8d-bd28-291d9969a6e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:32.094683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21619c73-d978-4a8d-bd28-291d9969a6e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:32.096649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21619c73-d978-4a8d-bd28-291d9969a6e2 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:32.126898 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1271/2543] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:52:32 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:52:32.132034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826badd-f7bd-481b-91f8-3d17e6e119da admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:32.144285 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826badd-f7bd-481b-91f8-3d17e6e119da admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:32.200950 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:32.213339 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a928c17-c44e-41be-8a31-bdb382925a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:32.214175 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a928c17-c44e-41be-8a31-bdb382925a1d admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:32.214544 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a928c17-c44e-41be-8a31-bdb382925a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:32.214902 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a928c17-c44e-41be-8a31-bdb382925a1d admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:32.215645 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a928c17-c44e-41be-8a31-bdb382925a1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:32.217754 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a928c17-c44e-41be-8a31-bdb382925a1d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:32.241242 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1273/2544] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:52:32 2022] POST /identity/v3/users => generated 294 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:52:32.245913 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21619c73-d978-4a8d-bd28-291d9969a6e2 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:32.257222 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21619c73-d978-4a8d-bd28-291d9969a6e2 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:32.262707 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6a33d-559f-45e0-bf67-ef2d7eb1d439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:32.263334 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6a33d-559f-45e0-bf67-ef2d7eb1d439 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:32.263606 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6a33d-559f-45e0-bf67-ef2d7eb1d439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:32.263902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6a33d-559f-45e0-bf67-ef2d7eb1d439 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:32.264552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6a33d-559f-45e0-bf67-ef2d7eb1d439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:32.266179 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6a33d-559f-45e0-bf67-ef2d7eb1d439 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:32.277468 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1272/2545] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:52:32.283122 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a928c17-c44e-41be-8a31-bdb382925a1d admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:32.297285 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a928c17-c44e-41be-8a31-bdb382925a1d admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:32.302442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c351961-e5e2-4438-944b-5c9d690362d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:32.303073 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c351961-e5e2-4438-944b-5c9d690362d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:32.303328 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c351961-e5e2-4438-944b-5c9d690362d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:32.303595 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c351961-e5e2-4438-944b-5c9d690362d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:32.304283 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c351961-e5e2-4438-944b-5c9d690362d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:32.305913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c351961-e5e2-4438-944b-5c9d690362d9 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:32.317929 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1274/2546] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:52:32.322407 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6a33d-559f-45e0-bf67-ef2d7eb1d439 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:32.333533 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6a33d-559f-45e0-bf67-ef2d7eb1d439 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:32.339427 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeab8e6-12a6-49ff-a0ea-00ab572fef78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:32.340144 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeab8e6-12a6-49ff-a0ea-00ab572fef78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:32.340413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeab8e6-12a6-49ff-a0ea-00ab572fef78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:32.340678 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeab8e6-12a6-49ff-a0ea-00ab572fef78 admin admin] PATH_INFO: `/v3/projects/a8c74358778747799b496c1178cc2fd6/users/2530065c66cc4252b48f0b48a8903aed/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:32.359646 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeab8e6-12a6-49ff-a0ea-00ab572fef78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8c74358778747799b496c1178cc2fd6, user_id=2530065c66cc4252b48f0b48a8903aed, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:32.362388 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeab8e6-12a6-49ff-a0ea-00ab572fef78 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:32.390097 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1273/2547] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:52:32 2022] PUT /identity/v3/projects/a8c74358778747799b496c1178cc2fd6/users/2530065c66cc4252b48f0b48a8903aed/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:52:32.403194 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34df6c-8d75-46c5-a0c0-d0227eafa957 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:32.403868 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34df6c-8d75-46c5-a0c0-d0227eafa957 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:32.403868 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34df6c-8d75-46c5-a0c0-d0227eafa957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:32.437300 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-8a34df6c-8d75-46c5-a0c0-d0227eafa957 None None] MFA Rules not processed for user `2530065c66cc4252b48f0b48a8903aed`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:52:32.438531 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8a34df6c-8d75-46c5-a0c0-d0227eafa957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:32.518362 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1275/2548] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:52:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:52:32.523293 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeab8e6-12a6-49ff-a0ea-00ab572fef78 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:32.602849 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeab8e6-12a6-49ff-a0ea-00ab572fef78 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:32.610841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a85ffb-d7a7-4c7b-ae5e-45ae978ac560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:32.611942 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a85ffb-d7a7-4c7b-ae5e-45ae978ac560 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:32.612440 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a85ffb-d7a7-4c7b-ae5e-45ae978ac560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:32.613125 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a85ffb-d7a7-4c7b-ae5e-45ae978ac560 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:32.614289 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a85ffb-d7a7-4c7b-ae5e-45ae978ac560 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:32.618016 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a85ffb-d7a7-4c7b-ae5e-45ae978ac560 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:32.654887 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1274/2549] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:52:32 2022] POST /identity/v3/projects => generated 385 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:52:32.659379 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34df6c-8d75-46c5-a0c0-d0227eafa957 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:32.671078 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34df6c-8d75-46c5-a0c0-d0227eafa957 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:32.753697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52d574-4ee1-4477-9a21-74e30e69a6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:32.754228 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52d574-4ee1-4477-9a21-74e30e69a6c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:32.754491 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52d574-4ee1-4477-9a21-74e30e69a6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:32.754763 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52d574-4ee1-4477-9a21-74e30e69a6c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:32.755403 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52d574-4ee1-4477-9a21-74e30e69a6c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:32.757394 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52d574-4ee1-4477-9a21-74e30e69a6c8 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:32.781268 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1276/2550] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:52:32 2022] POST /identity/v3/users => generated 299 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:52:32.785568 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a85ffb-d7a7-4c7b-ae5e-45ae978ac560 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:32.798408 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a85ffb-d7a7-4c7b-ae5e-45ae978ac560 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:32.804314 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79a336-11c7-4fd1-a3fc-65b896dc7195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:32.805145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79a336-11c7-4fd1-a3fc-65b896dc7195 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:32.805520 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79a336-11c7-4fd1-a3fc-65b896dc7195 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:32.805918 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79a336-11c7-4fd1-a3fc-65b896dc7195 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:32.806908 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79a336-11c7-4fd1-a3fc-65b896dc7195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:32.808920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79a336-11c7-4fd1-a3fc-65b896dc7195 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:32.830180 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1275/2551] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:52:32.835520 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52d574-4ee1-4477-9a21-74e30e69a6c8 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:32.848564 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52d574-4ee1-4477-9a21-74e30e69a6c8 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:32.855762 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576faad-fcb2-4b49-859d-2d5b1086167d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:32.856453 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576faad-fcb2-4b49-859d-2d5b1086167d admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:32.856725 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576faad-fcb2-4b49-859d-2d5b1086167d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:32.856990 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576faad-fcb2-4b49-859d-2d5b1086167d admin admin] PATH_INFO: `/v3/projects/1dee4c94bffa43148e2dacfe370117f9/users/61635427cf674351970142ecbcedda03/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:32.877785 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576faad-fcb2-4b49-859d-2d5b1086167d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dee4c94bffa43148e2dacfe370117f9, user_id=61635427cf674351970142ecbcedda03, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:32.880634 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576faad-fcb2-4b49-859d-2d5b1086167d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:32.897578 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1277/2552] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:52:32 2022] PUT /identity/v3/projects/1dee4c94bffa43148e2dacfe370117f9/users/61635427cf674351970142ecbcedda03/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:52:32.902113 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79a336-11c7-4fd1-a3fc-65b896dc7195 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:32.914055 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79a336-11c7-4fd1-a3fc-65b896dc7195 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:32.975682 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b305ac-a1bb-4690-b6e6-9649baf09ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:32.976327 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b305ac-a1bb-4690-b6e6-9649baf09ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:32.976600 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b305ac-a1bb-4690-b6e6-9649baf09ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:32.976867 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b305ac-a1bb-4690-b6e6-9649baf09ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:32.977503 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b305ac-a1bb-4690-b6e6-9649baf09ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:32.979093 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b305ac-a1bb-4690-b6e6-9649baf09ae6 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:32.989548 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1276/2553] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:52:32.993915 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576faad-fcb2-4b49-859d-2d5b1086167d admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:33.005389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576faad-fcb2-4b49-859d-2d5b1086167d admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:33.010173 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0d03c-ba00-4e83-84a3-5f24d5f98c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:33.010848 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0d03c-ba00-4e83-84a3-5f24d5f98c72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:33.011109 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0d03c-ba00-4e83-84a3-5f24d5f98c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:33.011388 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0d03c-ba00-4e83-84a3-5f24d5f98c72 admin admin] PATH_INFO: `/v3/projects/1dee4c94bffa43148e2dacfe370117f9/users/61635427cf674351970142ecbcedda03/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:33.013397 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0d03c-ba00-4e83-84a3-5f24d5f98c72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dee4c94bffa43148e2dacfe370117f9, user_id=61635427cf674351970142ecbcedda03, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:33.016111 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0d03c-ba00-4e83-84a3-5f24d5f98c72 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:33.028034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1278/2554] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:52:32 2022] PUT /identity/v3/projects/1dee4c94bffa43148e2dacfe370117f9/users/61635427cf674351970142ecbcedda03/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:52:33.038716 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0d832-ad30-4be4-9332-96b5bf26e088 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:33.039019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0d832-ad30-4be4-9332-96b5bf26e088 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:33.039290 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0d832-ad30-4be4-9332-96b5bf26e088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:33.046914 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:33.084835 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-d9f0d832-ad30-4be4-9332-96b5bf26e088 None None] MFA Rules not processed for user `61635427cf674351970142ecbcedda03`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:52:33.086968 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d9f0d832-ad30-4be4-9332-96b5bf26e088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:33.213087 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1277/2555] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:52:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:52:33.221930 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0d03c-ba00-4e83-84a3-5f24d5f98c72 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:33.224179 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f8f0d03c-ba00-4e83-84a3-5f24d5f98c72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:33.241283 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:33.317144 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0d03c-ba00-4e83-84a3-5f24d5f98c72 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:33.322220 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68508549-64db-4b9d-9f35-487ea21e13cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:33.323408 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68508549-64db-4b9d-9f35-487ea21e13cf service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:33.323960 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68508549-64db-4b9d-9f35-487ea21e13cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:33.324467 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68508549-64db-4b9d-9f35-487ea21e13cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:33.340840 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68508549-64db-4b9d-9f35-487ea21e13cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:33.343756 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68508549-64db-4b9d-9f35-487ea21e13cf service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:33.362670 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1279/2556] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:52:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:52:33.514179 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0d832-ad30-4be4-9332-96b5bf26e088 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:33.589307 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0d832-ad30-4be4-9332-96b5bf26e088 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:33.594170 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf0c29-c934-4431-ba41-6ad82cf55453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:33.594852 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf0c29-c934-4431-ba41-6ad82cf55453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:33.595092 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf0c29-c934-4431-ba41-6ad82cf55453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:33.595353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf0c29-c934-4431-ba41-6ad82cf55453 admin admin] PATH_INFO: `/v3/users/2530065c66cc4252b48f0b48a8903aed` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:33.596563 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccf0c29-c934-4431-ba41-6ad82cf55453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2530065c66cc4252b48f0b48a8903aed)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:33.598634 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccf0c29-c934-4431-ba41-6ad82cf55453 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:33.653821 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cccf0c29-c934-4431-ba41-6ad82cf55453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2530065c66cc4252b48f0b48a8903aed'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:33.662514 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cccf0c29-c934-4431-ba41-6ad82cf55453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2530065c66cc4252b48f0b48a8903aed'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:33.679819 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cccf0c29-c934-4431-ba41-6ad82cf55453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2530065c66cc4252b48f0b48a8903aed'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:33.680614 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cccf0c29-c934-4431-ba41-6ad82cf55453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2530065c66cc4252b48f0b48a8903aed'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:33.688373 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cccf0c29-c934-4431-ba41-6ad82cf55453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2530065c66cc4252b48f0b48a8903aed'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:33.698192 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1278/2557] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:52:33 2022] DELETE /identity/v3/users/2530065c66cc4252b48f0b48a8903aed => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:52:33.700270 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2de90b-f350-4d9e-ab5a-9ca63c7c08ee None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:33.700773 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2de90b-f350-4d9e-ab5a-9ca63c7c08ee None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:33.701311 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2de90b-f350-4d9e-ab5a-9ca63c7c08ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:33.722745 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-9b2de90b-f350-4d9e-ab5a-9ca63c7c08ee None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:52:33.724038 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9b2de90b-f350-4d9e-ab5a-9ca63c7c08ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:33.786940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1280/2558] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:52:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:52:33.797876 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf0c29-c934-4431-ba41-6ad82cf55453 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:33.799615 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-cccf0c29-c934-4431-ba41-6ad82cf55453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:33.811014 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:33.863491 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf0c29-c934-4431-ba41-6ad82cf55453 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:33.867271 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927e336-5ca1-49c3-a494-4706d1d4bfbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:33.867957 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927e336-5ca1-49c3-a494-4706d1d4bfbb service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:33.868385 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927e336-5ca1-49c3-a494-4706d1d4bfbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:33.868857 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927e336-5ca1-49c3-a494-4706d1d4bfbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:33.879704 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927e336-5ca1-49c3-a494-4706d1d4bfbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:33.881165 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927e336-5ca1-49c3-a494-4706d1d4bfbb service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:33.891771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1279/2559] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:52:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:52:34.194180 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2de90b-f350-4d9e-ab5a-9ca63c7c08ee None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:34.196529 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9b2de90b-f350-4d9e-ab5a-9ca63c7c08ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:34.216519 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2de90b-f350-4d9e-ab5a-9ca63c7c08ee None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:34.222681 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7381d-4e00-4222-94ed-4af3dcc18820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:34.225505 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7381d-4e00-4222-94ed-4af3dcc18820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:34.225505 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7381d-4e00-4222-94ed-4af3dcc18820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:34.225505 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7381d-4e00-4222-94ed-4af3dcc18820 admin admin] PATH_INFO: `/v3/projects/a8c74358778747799b496c1178cc2fd6` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:34.225505 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7381d-4e00-4222-94ed-4af3dcc18820 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8c74358778747799b496c1178cc2fd6)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:34.227108 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7381d-4e00-4222-94ed-4af3dcc18820 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:34.286171 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5bb7381d-4e00-4222-94ed-4af3dcc18820 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8c74358778747799b496c1178cc2fd6', 'request_id': 'req-5bb7381d-4e00-4222-94ed-4af3dcc18820'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:34.294627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5bb7381d-4e00-4222-94ed-4af3dcc18820 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8c74358778747799b496c1178cc2fd6', 'request_id': 'req-5bb7381d-4e00-4222-94ed-4af3dcc18820'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:34.302723 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5bb7381d-4e00-4222-94ed-4af3dcc18820 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8c74358778747799b496c1178cc2fd6', 'request_id': 'req-5bb7381d-4e00-4222-94ed-4af3dcc18820'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:34.324800 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5bb7381d-4e00-4222-94ed-4af3dcc18820 admin admin] The token cache is being invalidate because project a8c74358778747799b496c1178cc2fd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:52:34.325254 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5bb7381d-4e00-4222-94ed-4af3dcc18820 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:34.326098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-5bb7381d-4e00-4222-94ed-4af3dcc18820 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:34.327714 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1281/2560] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:52:34 2022] DELETE /identity/v3/projects/a8c74358778747799b496c1178cc2fd6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:52:34.332373 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927e336-5ca1-49c3-a494-4706d1d4bfbb service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:34.349360 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927e336-5ca1-49c3-a494-4706d1d4bfbb service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:34.428383 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44368c82-30a2-44cd-a6f7-41ddba505063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:34.429254 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44368c82-30a2-44cd-a6f7-41ddba505063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:34.429552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44368c82-30a2-44cd-a6f7-41ddba505063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:34.429817 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44368c82-30a2-44cd-a6f7-41ddba505063 admin admin] PATH_INFO: `/v3/users/61635427cf674351970142ecbcedda03` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:34.431155 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44368c82-30a2-44cd-a6f7-41ddba505063 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61635427cf674351970142ecbcedda03)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:34.433199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44368c82-30a2-44cd-a6f7-41ddba505063 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:34.489654 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-44368c82-30a2-44cd-a6f7-41ddba505063 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61635427cf674351970142ecbcedda03'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:34.498493 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-44368c82-30a2-44cd-a6f7-41ddba505063 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61635427cf674351970142ecbcedda03'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:34.512734 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-44368c82-30a2-44cd-a6f7-41ddba505063 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61635427cf674351970142ecbcedda03'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:34.513484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-44368c82-30a2-44cd-a6f7-41ddba505063 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61635427cf674351970142ecbcedda03'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:34.522772 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-44368c82-30a2-44cd-a6f7-41ddba505063 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61635427cf674351970142ecbcedda03'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:34.530465 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1280/2561] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:52:34 2022] DELETE /identity/v3/users/61635427cf674351970142ecbcedda03 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:52:34.853106 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7381d-4e00-4222-94ed-4af3dcc18820 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:34.855051 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-5bb7381d-4e00-4222-94ed-4af3dcc18820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:34.871996 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7381d-4e00-4222-94ed-4af3dcc18820 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:34.920421 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:34.952568 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da3293-a46e-465a-9f2a-d82660fae64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:34.953141 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da3293-a46e-465a-9f2a-d82660fae64e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:34.953414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da3293-a46e-465a-9f2a-d82660fae64e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:34.953680 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da3293-a46e-465a-9f2a-d82660fae64e admin admin] PATH_INFO: `/v3/projects/1dee4c94bffa43148e2dacfe370117f9` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:34.954898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da3293-a46e-465a-9f2a-d82660fae64e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dee4c94bffa43148e2dacfe370117f9)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:34.957342 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da3293-a46e-465a-9f2a-d82660fae64e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:35.010467 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-56da3293-a46e-465a-9f2a-d82660fae64e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dee4c94bffa43148e2dacfe370117f9', 'request_id': 'req-56da3293-a46e-465a-9f2a-d82660fae64e'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:35.016897 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-56da3293-a46e-465a-9f2a-d82660fae64e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dee4c94bffa43148e2dacfe370117f9', 'request_id': 'req-56da3293-a46e-465a-9f2a-d82660fae64e'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:35.023603 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-56da3293-a46e-465a-9f2a-d82660fae64e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dee4c94bffa43148e2dacfe370117f9', 'request_id': 'req-56da3293-a46e-465a-9f2a-d82660fae64e'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:35.040069 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-56da3293-a46e-465a-9f2a-d82660fae64e admin admin] The token cache is being invalidate because project 1dee4c94bffa43148e2dacfe370117f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:52:35.040450 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-56da3293-a46e-465a-9f2a-d82660fae64e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:35.041213 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-56da3293-a46e-465a-9f2a-d82660fae64e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:35.042821 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1282/2562] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:52:34 2022] DELETE /identity/v3/projects/1dee4c94bffa43148e2dacfe370117f9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:52:35.049132 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50577499-e968-4ece-ac3f-b4563705f3f1 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:35.049664 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50577499-e968-4ece-ac3f-b4563705f3f1 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:35.049839 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50577499-e968-4ece-ac3f-b4563705f3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:35.073541 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-50577499-e968-4ece-ac3f-b4563705f3f1 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:52:35.074775 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-50577499-e968-4ece-ac3f-b4563705f3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:35.100847 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:35.145091 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1281/2563] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:52:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:52:35.153596 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc36c4-77d8-43f9-a82b-48d43117eb5e None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:35.153926 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc36c4-77d8-43f9-a82b-48d43117eb5e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:35.154110 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc36c4-77d8-43f9-a82b-48d43117eb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:35.181238 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-acbc36c4-77d8-43f9-a82b-48d43117eb5e None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:52:35.182479 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-acbc36c4-77d8-43f9-a82b-48d43117eb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:35.190996 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1283/2564] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:52:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:52:35.195574 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50577499-e968-4ece-ac3f-b4563705f3f1 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:35.206294 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50577499-e968-4ece-ac3f-b4563705f3f1 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:35.211143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4166f-4518-4931-8a98-771db3a7d078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:35.211786 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4166f-4518-4931-8a98-771db3a7d078 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:35.212062 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4166f-4518-4931-8a98-771db3a7d078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:35.212325 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e4166f-4518-4931-8a98-771db3a7d078 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:35.212977 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4166f-4518-4931-8a98-771db3a7d078 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:52:35.213272 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4166f-4518-4931-8a98-771db3a7d078 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:35.214873 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e4166f-4518-4931-8a98-771db3a7d078 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:35.227765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1282/2565] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:52:35.232254 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc36c4-77d8-43f9-a82b-48d43117eb5e None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:35.250278 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc36c4-77d8-43f9-a82b-48d43117eb5e None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:35.255522 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad19dee-40eb-4d95-9e67-0f29a6ab2d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:35.256180 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad19dee-40eb-4d95-9e67-0f29a6ab2d12 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:35.256455 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad19dee-40eb-4d95-9e67-0f29a6ab2d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:35.256716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad19dee-40eb-4d95-9e67-0f29a6ab2d12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:35.257363 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad19dee-40eb-4d95-9e67-0f29a6ab2d12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:35.259314 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad19dee-40eb-4d95-9e67-0f29a6ab2d12 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:35.289143 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1284/2566] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:52:35 2022] POST /identity/v3/projects => generated 407 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:52:35.293690 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4166f-4518-4931-8a98-771db3a7d078 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:35.305609 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e4166f-4518-4931-8a98-771db3a7d078 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:35.367920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c281d0-1cef-4117-8c84-751a1ffd2bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:35.368570 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c281d0-1cef-4117-8c84-751a1ffd2bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:35.368845 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c281d0-1cef-4117-8c84-751a1ffd2bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:35.369110 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c281d0-1cef-4117-8c84-751a1ffd2bf7 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:35.369757 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c281d0-1cef-4117-8c84-751a1ffd2bf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:35.371683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c281d0-1cef-4117-8c84-751a1ffd2bf7 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:35.394932 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1283/2567] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:52:35 2022] POST /identity/v3/users => generated 304 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:52:35.400684 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad19dee-40eb-4d95-9e67-0f29a6ab2d12 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:35.417879 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad19dee-40eb-4d95-9e67-0f29a6ab2d12 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:35.422866 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e2fd3-8ff7-474b-af35-da1a4640003b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:35.423476 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e2fd3-8ff7-474b-af35-da1a4640003b admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:35.423804 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e2fd3-8ff7-474b-af35-da1a4640003b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:35.424076 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e2fd3-8ff7-474b-af35-da1a4640003b admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:35.424717 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e2fd3-8ff7-474b-af35-da1a4640003b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:35.426423 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e2fd3-8ff7-474b-af35-da1a4640003b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:35.438033 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1285/2568] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:52:35.442387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c281d0-1cef-4117-8c84-751a1ffd2bf7 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:35.453166 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c281d0-1cef-4117-8c84-751a1ffd2bf7 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:35.458528 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2d45d-5c77-447e-b1f8-eba1795ec22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:35.459075 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2d45d-5c77-447e-b1f8-eba1795ec22e admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:35.459344 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2d45d-5c77-447e-b1f8-eba1795ec22e admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:35.459719 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2d45d-5c77-447e-b1f8-eba1795ec22e admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:35.461541 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2d45d-5c77-447e-b1f8-eba1795ec22e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:35.461968 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2d45d-5c77-447e-b1f8-eba1795ec22e admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:35.473815 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1284/2569] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:52:35.478580 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e2fd3-8ff7-474b-af35-da1a4640003b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:35.489652 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e2fd3-8ff7-474b-af35-da1a4640003b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:35.494663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebbf44-420e-4331-a340-edd5c517b3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:35.495335 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebbf44-420e-4331-a340-edd5c517b3f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:35.495611 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebbf44-420e-4331-a340-edd5c517b3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:35.495913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebbf44-420e-4331-a340-edd5c517b3f9 admin admin] PATH_INFO: `/v3/projects/fcda7a38608a4c408080136ea510d9aa/users/d7c8ecd857234ead849a8d954ae481a9/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:35.513213 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebbf44-420e-4331-a340-edd5c517b3f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcda7a38608a4c408080136ea510d9aa, user_id=d7c8ecd857234ead849a8d954ae481a9, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:35.515886 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebbf44-420e-4331-a340-edd5c517b3f9 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:35.534714 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1286/2570] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:52:35 2022] PUT /identity/v3/projects/fcda7a38608a4c408080136ea510d9aa/users/d7c8ecd857234ead849a8d954ae481a9/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:52:35.546640 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30ceba-da54-4d6a-8641-beca610c80cc None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:35.546916 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30ceba-da54-4d6a-8641-beca610c80cc None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:35.547177 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30ceba-da54-4d6a-8641-beca610c80cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:35.579186 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-aa30ceba-da54-4d6a-8641-beca610c80cc None None] MFA Rules not processed for user `d7c8ecd857234ead849a8d954ae481a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:52:35.580448 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-aa30ceba-da54-4d6a-8641-beca610c80cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:35.648871 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1285/2571] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:52:35 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:52:35.653817 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebbf44-420e-4331-a340-edd5c517b3f9 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:35.721080 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebbf44-420e-4331-a340-edd5c517b3f9 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:35.726490 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2b711-9b26-4ea2-89ed-6002bdc26f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:35.727095 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2b711-9b26-4ea2-89ed-6002bdc26f92 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:35.727370 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2b711-9b26-4ea2-89ed-6002bdc26f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:35.727638 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2b711-9b26-4ea2-89ed-6002bdc26f92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:35.728295 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe2b711-9b26-4ea2-89ed-6002bdc26f92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:35.730209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe2b711-9b26-4ea2-89ed-6002bdc26f92 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:35.745660 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:35.765650 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1287/2572] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:52:35 2022] POST /identity/v3/projects => generated 409 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:52:35.769986 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30ceba-da54-4d6a-8641-beca610c80cc None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:35.782707 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30ceba-da54-4d6a-8641-beca610c80cc None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:35.808092 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:35.850718 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a85c0-b02a-42dd-bf71-b10730526b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:35.851330 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a85c0-b02a-42dd-bf71-b10730526b11 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:35.851601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a85c0-b02a-42dd-bf71-b10730526b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:35.851900 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a85c0-b02a-42dd-bf71-b10730526b11 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:35.852747 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a85c0-b02a-42dd-bf71-b10730526b11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:35.854669 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a85c0-b02a-42dd-bf71-b10730526b11 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:35.878295 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1286/2573] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:52:35 2022] POST /identity/v3/users => generated 311 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:52:35.883218 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2b711-9b26-4ea2-89ed-6002bdc26f92 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:35.902607 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2b711-9b26-4ea2-89ed-6002bdc26f92 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:35.911391 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48427c-7944-4050-a186-0f9074e1e695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:35.912242 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48427c-7944-4050-a186-0f9074e1e695 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:35.912512 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48427c-7944-4050-a186-0f9074e1e695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:35.912779 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48427c-7944-4050-a186-0f9074e1e695 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:35.913429 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48427c-7944-4050-a186-0f9074e1e695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:35.915082 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48427c-7944-4050-a186-0f9074e1e695 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:35.927001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1288/2574] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:52:35.931867 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a85c0-b02a-42dd-bf71-b10730526b11 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:35.943967 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a85c0-b02a-42dd-bf71-b10730526b11 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:35.949063 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04996548-998f-4eb6-b3cf-0848e50a4475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:35.949767 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04996548-998f-4eb6-b3cf-0848e50a4475 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:35.950043 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04996548-998f-4eb6-b3cf-0848e50a4475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:35.950319 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04996548-998f-4eb6-b3cf-0848e50a4475 admin admin] PATH_INFO: `/v3/projects/a59738ee77ee4d7caf2d2bc80068ff0a/users/81ea2053838a4aa1b1d0b95cfce3a909/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:35.967453 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04996548-998f-4eb6-b3cf-0848e50a4475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a59738ee77ee4d7caf2d2bc80068ff0a, user_id=81ea2053838a4aa1b1d0b95cfce3a909, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:35.970254 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04996548-998f-4eb6-b3cf-0848e50a4475 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:35.987017 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1287/2575] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:52:35 2022] PUT /identity/v3/projects/a59738ee77ee4d7caf2d2bc80068ff0a/users/81ea2053838a4aa1b1d0b95cfce3a909/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:52:35.991283 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48427c-7944-4050-a186-0f9074e1e695 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:36.002543 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48427c-7944-4050-a186-0f9074e1e695 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:36.063432 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338aecc8-5852-4008-afda-b61441adef02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:36.064088 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338aecc8-5852-4008-afda-b61441adef02 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:36.064366 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338aecc8-5852-4008-afda-b61441adef02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:36.064632 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338aecc8-5852-4008-afda-b61441adef02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:36.065270 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338aecc8-5852-4008-afda-b61441adef02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:36.066975 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338aecc8-5852-4008-afda-b61441adef02 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:36.078137 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1289/2576] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:52:36.084408 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04996548-998f-4eb6-b3cf-0848e50a4475 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:36.096482 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04996548-998f-4eb6-b3cf-0848e50a4475 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:36.101612 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3e72c-6daf-4f10-854f-81494087d046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:36.102293 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3e72c-6daf-4f10-854f-81494087d046 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:36.102829 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3e72c-6daf-4f10-854f-81494087d046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:36.103100 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3e72c-6daf-4f10-854f-81494087d046 admin admin] PATH_INFO: `/v3/projects/a59738ee77ee4d7caf2d2bc80068ff0a/users/81ea2053838a4aa1b1d0b95cfce3a909/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:36.105099 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3e72c-6daf-4f10-854f-81494087d046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a59738ee77ee4d7caf2d2bc80068ff0a, user_id=81ea2053838a4aa1b1d0b95cfce3a909, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:36.108131 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3e72c-6daf-4f10-854f-81494087d046 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:36.120296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1288/2577] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:52:36 2022] PUT /identity/v3/projects/a59738ee77ee4d7caf2d2bc80068ff0a/users/81ea2053838a4aa1b1d0b95cfce3a909/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:52:36.140404 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bb3ec-27e8-412c-b489-c269a9d9b363 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:36.140404 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bb3ec-27e8-412c-b489-c269a9d9b363 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:36.140949 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252bb3ec-27e8-412c-b489-c269a9d9b363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:36.175831 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-252bb3ec-27e8-412c-b489-c269a9d9b363 None None] MFA Rules not processed for user `81ea2053838a4aa1b1d0b95cfce3a909`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:52:36.177113 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-252bb3ec-27e8-412c-b489-c269a9d9b363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:36.263172 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1290/2578] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:52:36 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:52:36.275040 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3e72c-6daf-4f10-854f-81494087d046 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:36.276992 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-cda3e72c-6daf-4f10-854f-81494087d046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:36.344185 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3e72c-6daf-4f10-854f-81494087d046 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:36.348561 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193c5ad-d604-4097-ad3f-e89227cea8d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:36.349234 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193c5ad-d604-4097-ad3f-e89227cea8d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:36.349508 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193c5ad-d604-4097-ad3f-e89227cea8d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:36.349806 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d193c5ad-d604-4097-ad3f-e89227cea8d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:36.360393 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193c5ad-d604-4097-ad3f-e89227cea8d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:36.361866 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d193c5ad-d604-4097-ad3f-e89227cea8d1 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:36.373239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1289/2579] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:52:36 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:52:36.563171 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bb3ec-27e8-412c-b489-c269a9d9b363 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:36.574729 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252bb3ec-27e8-412c-b489-c269a9d9b363 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:36.580948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf6383-1897-4bcc-b5f8-ff01c42a0830 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:36.581991 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf6383-1897-4bcc-b5f8-ff01c42a0830 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:36.582452 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf6383-1897-4bcc-b5f8-ff01c42a0830 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:36.582938 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf6383-1897-4bcc-b5f8-ff01c42a0830 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:36.676925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf6383-1897-4bcc-b5f8-ff01c42a0830 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:36.678618 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf6383-1897-4bcc-b5f8-ff01c42a0830 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:36.684163 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:36.690113 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1291/2580] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:52:36 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:52:42.187655 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193c5ad-d604-4097-ad3f-e89227cea8d1 service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:42.252657 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d193c5ad-d604-4097-ad3f-e89227cea8d1 service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:42.257824 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f9f54-826c-47fa-947e-02db4774d53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:42.258456 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f9f54-826c-47fa-947e-02db4774d53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:42.258730 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f9f54-826c-47fa-947e-02db4774d53e admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:42.258998 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f9f54-826c-47fa-947e-02db4774d53e admin admin] PATH_INFO: `/v3/users/d7c8ecd857234ead849a8d954ae481a9` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:42.260521 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f9f54-826c-47fa-947e-02db4774d53e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7c8ecd857234ead849a8d954ae481a9)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:42.262704 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0f9f54-826c-47fa-947e-02db4774d53e admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:42.297323 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:42.327816 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1b0f9f54-826c-47fa-947e-02db4774d53e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7c8ecd857234ead849a8d954ae481a9'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:42.336176 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1b0f9f54-826c-47fa-947e-02db4774d53e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7c8ecd857234ead849a8d954ae481a9'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:42.348554 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1b0f9f54-826c-47fa-947e-02db4774d53e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7c8ecd857234ead849a8d954ae481a9'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:42.349180 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1b0f9f54-826c-47fa-947e-02db4774d53e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7c8ecd857234ead849a8d954ae481a9'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:42.356140 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-1b0f9f54-826c-47fa-947e-02db4774d53e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7c8ecd857234ead849a8d954ae481a9'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:42.361912 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1290/2581] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:52:42 2022] DELETE /identity/v3/users/d7c8ecd857234ead849a8d954ae481a9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:52:42.366615 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a934634-70c0-4fda-9bfa-b6adc48c0fd6 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:42.367157 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a934634-70c0-4fda-9bfa-b6adc48c0fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:42.367157 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a934634-70c0-4fda-9bfa-b6adc48c0fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:42.387903 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-0a934634-70c0-4fda-9bfa-b6adc48c0fd6 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:52:42.389119 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0a934634-70c0-4fda-9bfa-b6adc48c0fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:42.452685 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1292/2582] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:52:42.462821 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f9f54-826c-47fa-947e-02db4774d53e admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:42.464302 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1b0f9f54-826c-47fa-947e-02db4774d53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:42.547767 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f9f54-826c-47fa-947e-02db4774d53e admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:42.551456 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcc561-8794-487b-a70e-4681e21005d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:42.552087 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcc561-8794-487b-a70e-4681e21005d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:42.552366 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcc561-8794-487b-a70e-4681e21005d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:42.552626 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fcc561-8794-487b-a70e-4681e21005d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:42.561617 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fcc561-8794-487b-a70e-4681e21005d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:42.563075 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fcc561-8794-487b-a70e-4681e21005d1 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:42.572538 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1291/2583] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:52:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:52:42.872753 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a934634-70c0-4fda-9bfa-b6adc48c0fd6 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:42.874208 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0a934634-70c0-4fda-9bfa-b6adc48c0fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:42.889147 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a934634-70c0-4fda-9bfa-b6adc48c0fd6 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:42.895275 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e2a60-82c4-4ca8-8bd0-4ad53f27414c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:42.896359 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e2a60-82c4-4ca8-8bd0-4ad53f27414c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:42.896750 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e2a60-82c4-4ca8-8bd0-4ad53f27414c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:42.897624 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e2a60-82c4-4ca8-8bd0-4ad53f27414c admin admin] PATH_INFO: `/v3/projects/fcda7a38608a4c408080136ea510d9aa` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:42.898389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e2a60-82c4-4ca8-8bd0-4ad53f27414c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcda7a38608a4c408080136ea510d9aa)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:42.900793 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e2a60-82c4-4ca8-8bd0-4ad53f27414c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:42.950173 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2a0e2a60-82c4-4ca8-8bd0-4ad53f27414c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcda7a38608a4c408080136ea510d9aa', 'request_id': 'req-2a0e2a60-82c4-4ca8-8bd0-4ad53f27414c'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:42.955922 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2a0e2a60-82c4-4ca8-8bd0-4ad53f27414c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcda7a38608a4c408080136ea510d9aa', 'request_id': 'req-2a0e2a60-82c4-4ca8-8bd0-4ad53f27414c'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:42.963047 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2a0e2a60-82c4-4ca8-8bd0-4ad53f27414c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcda7a38608a4c408080136ea510d9aa', 'request_id': 'req-2a0e2a60-82c4-4ca8-8bd0-4ad53f27414c'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:42.978106 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2a0e2a60-82c4-4ca8-8bd0-4ad53f27414c admin admin] The token cache is being invalidate because project fcda7a38608a4c408080136ea510d9aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:52:42.978422 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2a0e2a60-82c4-4ca8-8bd0-4ad53f27414c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:42.979043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2a0e2a60-82c4-4ca8-8bd0-4ad53f27414c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:42.980583 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1293/2584] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:52:42 2022] DELETE /identity/v3/projects/fcda7a38608a4c408080136ea510d9aa => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:52:42.984688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcc561-8794-487b-a70e-4681e21005d1 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:42.996475 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fcc561-8794-487b-a70e-4681e21005d1 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:43.063456 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b256c8a-1e6b-4567-8313-c27dad0e214c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:43.064111 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b256c8a-1e6b-4567-8313-c27dad0e214c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:43.064385 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b256c8a-1e6b-4567-8313-c27dad0e214c admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:43.064650 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b256c8a-1e6b-4567-8313-c27dad0e214c admin admin] PATH_INFO: `/v3/users/81ea2053838a4aa1b1d0b95cfce3a909` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:43.065879 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b256c8a-1e6b-4567-8313-c27dad0e214c admin admin] RBAC: Authorizing `identity:delete_user(user_id=81ea2053838a4aa1b1d0b95cfce3a909)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:43.067855 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b256c8a-1e6b-4567-8313-c27dad0e214c admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:43.092886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:43.124295 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8b256c8a-1e6b-4567-8313-c27dad0e214c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81ea2053838a4aa1b1d0b95cfce3a909'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:43.133132 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8b256c8a-1e6b-4567-8313-c27dad0e214c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81ea2053838a4aa1b1d0b95cfce3a909'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:43.146401 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8b256c8a-1e6b-4567-8313-c27dad0e214c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81ea2053838a4aa1b1d0b95cfce3a909'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:43.147106 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8b256c8a-1e6b-4567-8313-c27dad0e214c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81ea2053838a4aa1b1d0b95cfce3a909'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:43.155275 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8b256c8a-1e6b-4567-8313-c27dad0e214c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81ea2053838a4aa1b1d0b95cfce3a909'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:43.161917 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1292/2585] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:52:42 2022] DELETE /identity/v3/users/81ea2053838a4aa1b1d0b95cfce3a909 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:52:43.459891 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e2a60-82c4-4ca8-8bd0-4ad53f27414c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:43.461495 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-2a0e2a60-82c4-4ca8-8bd0-4ad53f27414c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:43.475597 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e2a60-82c4-4ca8-8bd0-4ad53f27414c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:43.540950 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefffda-7128-40a6-aae8-0f0ebc2dd910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:43.541605 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefffda-7128-40a6-aae8-0f0ebc2dd910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:43.541901 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefffda-7128-40a6-aae8-0f0ebc2dd910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:43.542192 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefffda-7128-40a6-aae8-0f0ebc2dd910 admin admin] PATH_INFO: `/v3/projects/a59738ee77ee4d7caf2d2bc80068ff0a` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:43.543370 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aefffda-7128-40a6-aae8-0f0ebc2dd910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a59738ee77ee4d7caf2d2bc80068ff0a)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:43.545321 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aefffda-7128-40a6-aae8-0f0ebc2dd910 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:43.577886 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:43.597427 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6aefffda-7128-40a6-aae8-0f0ebc2dd910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a59738ee77ee4d7caf2d2bc80068ff0a', 'request_id': 'req-6aefffda-7128-40a6-aae8-0f0ebc2dd910'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:43.603076 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6aefffda-7128-40a6-aae8-0f0ebc2dd910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a59738ee77ee4d7caf2d2bc80068ff0a', 'request_id': 'req-6aefffda-7128-40a6-aae8-0f0ebc2dd910'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:43.609810 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6aefffda-7128-40a6-aae8-0f0ebc2dd910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a59738ee77ee4d7caf2d2bc80068ff0a', 'request_id': 'req-6aefffda-7128-40a6-aae8-0f0ebc2dd910'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:43.624802 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6aefffda-7128-40a6-aae8-0f0ebc2dd910 admin admin] The token cache is being invalidate because project a59738ee77ee4d7caf2d2bc80068ff0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:52:43.625086 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6aefffda-7128-40a6-aae8-0f0ebc2dd910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:43.625730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6aefffda-7128-40a6-aae8-0f0ebc2dd910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:43.627251 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1294/2586] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:52:43 2022] DELETE /identity/v3/projects/a59738ee77ee4d7caf2d2bc80068ff0a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:52:43.633173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b62bf-ae19-4b2c-8b7b-351db34959aa None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:43.633769 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b62bf-ae19-4b2c-8b7b-351db34959aa None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:43.633769 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b62bf-ae19-4b2c-8b7b-351db34959aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:43.654943 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-617b62bf-ae19-4b2c-8b7b-351db34959aa None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:52:43.656339 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-617b62bf-ae19-4b2c-8b7b-351db34959aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:43.721209 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1293/2587] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:52:43.729546 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6773e-41dd-46c0-843b-138e5f68345d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:43.729824 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6773e-41dd-46c0-843b-138e5f68345d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:43.730091 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6773e-41dd-46c0-843b-138e5f68345d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:43.751576 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-40f6773e-41dd-46c0-843b-138e5f68345d None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:52:43.752845 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-40f6773e-41dd-46c0-843b-138e5f68345d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:43.761988 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1295/2588] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:52:43.766896 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b62bf-ae19-4b2c-8b7b-351db34959aa None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:43.777597 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b62bf-ae19-4b2c-8b7b-351db34959aa None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:43.783376 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431ff62-e1fc-41ea-b326-c3c842b2c2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:43.784021 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431ff62-e1fc-41ea-b326-c3c842b2c2bf admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:43.784295 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431ff62-e1fc-41ea-b326-c3c842b2c2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:43.784551 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431ff62-e1fc-41ea-b326-c3c842b2c2bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:43.785182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431ff62-e1fc-41ea-b326-c3c842b2c2bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:52:43.785476 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431ff62-e1fc-41ea-b326-c3c842b2c2bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:43.787239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431ff62-e1fc-41ea-b326-c3c842b2c2bf admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:43.800382 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1294/2589] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:52:43.807313 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6773e-41dd-46c0-843b-138e5f68345d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:43.817950 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6773e-41dd-46c0-843b-138e5f68345d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:43.824100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f2882-6eef-4f99-8147-49d084ac74a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:43.824736 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f2882-6eef-4f99-8147-49d084ac74a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:43.825070 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f2882-6eef-4f99-8147-49d084ac74a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:43.825237 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f2882-6eef-4f99-8147-49d084ac74a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:43.825886 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f2882-6eef-4f99-8147-49d084ac74a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:43.827863 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7f2882-6eef-4f99-8147-49d084ac74a1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:43.861108 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1296/2590] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:52:43 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:52:43.866662 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431ff62-e1fc-41ea-b326-c3c842b2c2bf admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:43.876977 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431ff62-e1fc-41ea-b326-c3c842b2c2bf admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:43.937488 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83d7a2-654f-44b8-b64b-e37068f8b5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:43.938069 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83d7a2-654f-44b8-b64b-e37068f8b5e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:43.938368 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83d7a2-654f-44b8-b64b-e37068f8b5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:43.938637 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83d7a2-654f-44b8-b64b-e37068f8b5e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:43.939270 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83d7a2-654f-44b8-b64b-e37068f8b5e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:43.941256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b83d7a2-654f-44b8-b64b-e37068f8b5e2 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:43.967710 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1295/2591] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:52:43 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:52:43.972342 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f2882-6eef-4f99-8147-49d084ac74a1 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:43.983015 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f2882-6eef-4f99-8147-49d084ac74a1 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:43.990168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed35d6-749a-4677-a81a-801a1e6b1e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:43.990774 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed35d6-749a-4677-a81a-801a1e6b1e2f admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:43.991049 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed35d6-749a-4677-a81a-801a1e6b1e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:43.991316 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed35d6-749a-4677-a81a-801a1e6b1e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:43.992002 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed35d6-749a-4677-a81a-801a1e6b1e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:43.993609 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed35d6-749a-4677-a81a-801a1e6b1e2f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:44.005629 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1297/2592] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:52:44.010275 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83d7a2-654f-44b8-b64b-e37068f8b5e2 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:44.021387 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83d7a2-654f-44b8-b64b-e37068f8b5e2 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:44.026921 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88a36f-b079-47a5-beb2-b6f992313f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:44.027641 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88a36f-b079-47a5-beb2-b6f992313f88 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:44.027948 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88a36f-b079-47a5-beb2-b6f992313f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:44.028220 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88a36f-b079-47a5-beb2-b6f992313f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:44.029214 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e88a36f-b079-47a5-beb2-b6f992313f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:44.030865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e88a36f-b079-47a5-beb2-b6f992313f88 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:44.043076 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1296/2593] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:52:44.047579 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed35d6-749a-4677-a81a-801a1e6b1e2f admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:44.058251 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed35d6-749a-4677-a81a-801a1e6b1e2f admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:44.063148 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7634ed-b17a-4372-801b-23b31c913d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:44.063996 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7634ed-b17a-4372-801b-23b31c913d77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:44.064259 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7634ed-b17a-4372-801b-23b31c913d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:44.064529 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7634ed-b17a-4372-801b-23b31c913d77 admin admin] PATH_INFO: `/v3/projects/b2c8a276246e4302bad1e5952d832f7d/users/3c5da3b482fb464e9d23aea05093319b/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:44.079461 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7634ed-b17a-4372-801b-23b31c913d77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2c8a276246e4302bad1e5952d832f7d, user_id=3c5da3b482fb464e9d23aea05093319b, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:44.082231 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7634ed-b17a-4372-801b-23b31c913d77 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:44.096872 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1298/2594] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:52:44 2022] PUT /identity/v3/projects/b2c8a276246e4302bad1e5952d832f7d/users/3c5da3b482fb464e9d23aea05093319b/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:52:44.107170 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd7e85-9782-4e01-8c55-8a4114b45ced None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:44.107453 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd7e85-9782-4e01-8c55-8a4114b45ced None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:44.107832 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd7e85-9782-4e01-8c55-8a4114b45ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:44.121691 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:44.139865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-adcd7e85-9782-4e01-8c55-8a4114b45ced None None] MFA Rules not processed for user `3c5da3b482fb464e9d23aea05093319b`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:52:44.141211 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-adcd7e85-9782-4e01-8c55-8a4114b45ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:44.210527 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1297/2595] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:52:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:52:44.215963 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7634ed-b17a-4372-801b-23b31c913d77 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:44.291357 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7634ed-b17a-4372-801b-23b31c913d77 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:44.296662 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1656b-eccc-491c-89ee-62f652f21015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:44.297276 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1656b-eccc-491c-89ee-62f652f21015 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:44.297550 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1656b-eccc-491c-89ee-62f652f21015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:44.297845 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1656b-eccc-491c-89ee-62f652f21015 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:44.298446 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1656b-eccc-491c-89ee-62f652f21015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:44.300500 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1656b-eccc-491c-89ee-62f652f21015 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:44.330318 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1299/2596] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:52:44 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:52:44.336390 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd7e85-9782-4e01-8c55-8a4114b45ced None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:44.352935 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd7e85-9782-4e01-8c55-8a4114b45ced None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:44.419945 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7e553-2179-49f4-87f0-1aec98ca1bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:44.420824 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7e553-2179-49f4-87f0-1aec98ca1bac admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:44.421099 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7e553-2179-49f4-87f0-1aec98ca1bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:44.421373 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7e553-2179-49f4-87f0-1aec98ca1bac admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:44.421991 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7e553-2179-49f4-87f0-1aec98ca1bac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:44.423958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7e553-2179-49f4-87f0-1aec98ca1bac admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:44.447229 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1298/2597] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:52:44 2022] POST /identity/v3/users => generated 299 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:52:44.451554 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1656b-eccc-491c-89ee-62f652f21015 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:44.462389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1656b-eccc-491c-89ee-62f652f21015 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:44.467588 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21ad45-f3cb-4723-b2af-83da5718f667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:44.468319 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21ad45-f3cb-4723-b2af-83da5718f667 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:44.468598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21ad45-f3cb-4723-b2af-83da5718f667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:44.468864 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21ad45-f3cb-4723-b2af-83da5718f667 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:44.469541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21ad45-f3cb-4723-b2af-83da5718f667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:44.471129 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21ad45-f3cb-4723-b2af-83da5718f667 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:44.482269 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1300/2598] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:52:44.486848 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7e553-2179-49f4-87f0-1aec98ca1bac admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:44.498039 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7e553-2179-49f4-87f0-1aec98ca1bac admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:44.503547 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57316ce2-50ef-4bd6-abc3-b7e8c4877566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:44.504241 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57316ce2-50ef-4bd6-abc3-b7e8c4877566 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:44.504521 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57316ce2-50ef-4bd6-abc3-b7e8c4877566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:44.504789 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57316ce2-50ef-4bd6-abc3-b7e8c4877566 admin admin] PATH_INFO: `/v3/projects/775880141b584870a9ecfd95c235c635/users/ab41e50ed6a848388fe5450baaea6c12/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:44.521027 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57316ce2-50ef-4bd6-abc3-b7e8c4877566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=775880141b584870a9ecfd95c235c635, user_id=ab41e50ed6a848388fe5450baaea6c12, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:44.523684 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57316ce2-50ef-4bd6-abc3-b7e8c4877566 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:44.538291 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1299/2599] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:52:44 2022] PUT /identity/v3/projects/775880141b584870a9ecfd95c235c635/users/ab41e50ed6a848388fe5450baaea6c12/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:52:44.543154 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21ad45-f3cb-4723-b2af-83da5718f667 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:44.556249 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21ad45-f3cb-4723-b2af-83da5718f667 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:44.580829 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:44.628061 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d634a-1526-4037-ae76-8437565092bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:44.628687 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d634a-1526-4037-ae76-8437565092bd admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:44.628955 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d634a-1526-4037-ae76-8437565092bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:44.629220 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d634a-1526-4037-ae76-8437565092bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:44.629961 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d634a-1526-4037-ae76-8437565092bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:44.631689 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d634a-1526-4037-ae76-8437565092bd admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:44.642469 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1301/2600] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:52:44.646928 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57316ce2-50ef-4bd6-abc3-b7e8c4877566 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:44.658377 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57316ce2-50ef-4bd6-abc3-b7e8c4877566 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:44.663719 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaed484-cdd2-4478-9d9e-27b4eb4ddec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:44.664420 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaed484-cdd2-4478-9d9e-27b4eb4ddec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:44.664696 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaed484-cdd2-4478-9d9e-27b4eb4ddec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:44.664965 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaed484-cdd2-4478-9d9e-27b4eb4ddec9 admin admin] PATH_INFO: `/v3/projects/775880141b584870a9ecfd95c235c635/users/ab41e50ed6a848388fe5450baaea6c12/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:44.666940 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaed484-cdd2-4478-9d9e-27b4eb4ddec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=775880141b584870a9ecfd95c235c635, user_id=ab41e50ed6a848388fe5450baaea6c12, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:44.669644 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaed484-cdd2-4478-9d9e-27b4eb4ddec9 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:44.679995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1300/2601] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:52:44 2022] PUT /identity/v3/projects/775880141b584870a9ecfd95c235c635/users/ab41e50ed6a848388fe5450baaea6c12/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:52:44.690384 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59c5e9-ab2a-4645-9814-99099ff42594 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:44.690655 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59c5e9-ab2a-4645-9814-99099ff42594 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:44.690954 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59c5e9-ab2a-4645-9814-99099ff42594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:44.721464 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-8c59c5e9-ab2a-4645-9814-99099ff42594 None None] MFA Rules not processed for user `ab41e50ed6a848388fe5450baaea6c12`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:52:44.722740 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8c59c5e9-ab2a-4645-9814-99099ff42594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:44.799363 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1302/2602] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:52:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:52:44.811052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaed484-cdd2-4478-9d9e-27b4eb4ddec9 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:44.813936 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-adaed484-cdd2-4478-9d9e-27b4eb4ddec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:44.876111 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:44.903672 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaed484-cdd2-4478-9d9e-27b4eb4ddec9 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:44.907843 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56234db0-8d98-4d03-9c60-b1d9f570ffd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:44.908454 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56234db0-8d98-4d03-9c60-b1d9f570ffd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:44.908732 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56234db0-8d98-4d03-9c60-b1d9f570ffd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:44.909000 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56234db0-8d98-4d03-9c60-b1d9f570ffd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:44.971188 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56234db0-8d98-4d03-9c60-b1d9f570ffd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:44.972641 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56234db0-8d98-4d03-9c60-b1d9f570ffd2 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:44.982122 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1301/2603] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:52:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:52:49.433021 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59c5e9-ab2a-4645-9814-99099ff42594 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:49.448496 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59c5e9-ab2a-4645-9814-99099ff42594 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:49.455044 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fb9ed-5f09-4cb0-a853-c1f0db710547 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:49.455959 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fb9ed-5f09-4cb0-a853-c1f0db710547 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:49.456349 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fb9ed-5f09-4cb0-a853-c1f0db710547 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:49.456731 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fb9ed-5f09-4cb0-a853-c1f0db710547 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:49.467265 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19fb9ed-5f09-4cb0-a853-c1f0db710547 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:49.468736 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19fb9ed-5f09-4cb0-a853-c1f0db710547 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:49.478052 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1303/2604] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:52:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:52:54.463191 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56234db0-8d98-4d03-9c60-b1d9f570ffd2 service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:54.665878 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56234db0-8d98-4d03-9c60-b1d9f570ffd2 service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:54.670702 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcd4a8-9c46-4c07-b97e-1754261c33a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:54.671369 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcd4a8-9c46-4c07-b97e-1754261c33a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:54.671640 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcd4a8-9c46-4c07-b97e-1754261c33a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:54.671936 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcd4a8-9c46-4c07-b97e-1754261c33a2 admin admin] PATH_INFO: `/v3/users/3c5da3b482fb464e9d23aea05093319b` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:54.673041 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbcd4a8-9c46-4c07-b97e-1754261c33a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c5da3b482fb464e9d23aea05093319b)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:54.674985 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbcd4a8-9c46-4c07-b97e-1754261c33a2 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:54.746796 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-efbcd4a8-9c46-4c07-b97e-1754261c33a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c5da3b482fb464e9d23aea05093319b'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:54.757632 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-efbcd4a8-9c46-4c07-b97e-1754261c33a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c5da3b482fb464e9d23aea05093319b'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:54.775798 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-efbcd4a8-9c46-4c07-b97e-1754261c33a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c5da3b482fb464e9d23aea05093319b'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:54.776885 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-efbcd4a8-9c46-4c07-b97e-1754261c33a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c5da3b482fb464e9d23aea05093319b'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:54.790885 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-efbcd4a8-9c46-4c07-b97e-1754261c33a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c5da3b482fb464e9d23aea05093319b'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:54.803823 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1302/2605] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:52:54 2022] DELETE /identity/v3/users/3c5da3b482fb464e9d23aea05093319b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:52:54.809562 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e3063-0c66-4487-b418-519d30a845ff None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:54.810524 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e3063-0c66-4487-b418-519d30a845ff None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:54.810524 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e3063-0c66-4487-b418-519d30a845ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:54.843078 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b00e3063-0c66-4487-b418-519d30a845ff None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:52:54.844473 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b00e3063-0c66-4487-b418-519d30a845ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:54.912170 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1304/2606] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:52:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:52:54.922283 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcd4a8-9c46-4c07-b97e-1754261c33a2 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:54.923728 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-efbcd4a8-9c46-4c07-b97e-1754261c33a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:54.929680 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:54.985366 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e3063-0c66-4487-b418-519d30a845ff None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:54.986782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b00e3063-0c66-4487-b418-519d30a845ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:55.006272 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcd4a8-9c46-4c07-b97e-1754261c33a2 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:55.016427 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853c306-e64b-49f6-9249-c741435fd659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:55.017161 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853c306-e64b-49f6-9249-c741435fd659 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:55.017538 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853c306-e64b-49f6-9249-c741435fd659 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:55.017968 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c853c306-e64b-49f6-9249-c741435fd659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:55.029824 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853c306-e64b-49f6-9249-c741435fd659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:55.030506 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:55.031444 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c853c306-e64b-49f6-9249-c741435fd659 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:55.041856 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1303/2607] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:52:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:52:55.071559 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e3063-0c66-4487-b418-519d30a845ff None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:55.078356 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c29088-4807-4120-8b8e-619ceec4aca0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895edcfb20484b188a3877c9de8b59c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:55.078356 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c29088-4807-4120-8b8e-619ceec4aca0 service placement] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:55.078356 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c29088-4807-4120-8b8e-619ceec4aca0 service placement] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:55.078356 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c29088-4807-4120-8b8e-619ceec4aca0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:55.080680 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e6c29088-4807-4120-8b8e-619ceec4aca0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:55.093989 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c29088-4807-4120-8b8e-619ceec4aca0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:55.095694 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c29088-4807-4120-8b8e-619ceec4aca0 service placement] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:55.107401 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1305/2608] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:52:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:52:55.398229 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853c306-e64b-49f6-9249-c741435fd659 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:55.400232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c853c306-e64b-49f6-9249-c741435fd659 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:55.420686 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c853c306-e64b-49f6-9249-c741435fd659 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:55.427955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe4166-d79a-4aca-9b41-cd125e9c8f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:55.430828 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe4166-d79a-4aca-9b41-cd125e9c8f01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:55.431339 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe4166-d79a-4aca-9b41-cd125e9c8f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:55.431878 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe4166-d79a-4aca-9b41-cd125e9c8f01 admin admin] PATH_INFO: `/v3/projects/b2c8a276246e4302bad1e5952d832f7d` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:55.434217 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe4166-d79a-4aca-9b41-cd125e9c8f01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2c8a276246e4302bad1e5952d832f7d)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:55.438548 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe4166-d79a-4aca-9b41-cd125e9c8f01 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:55.499422 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a1fe4166-d79a-4aca-9b41-cd125e9c8f01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2c8a276246e4302bad1e5952d832f7d', 'request_id': 'req-a1fe4166-d79a-4aca-9b41-cd125e9c8f01'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:55.508028 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a1fe4166-d79a-4aca-9b41-cd125e9c8f01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2c8a276246e4302bad1e5952d832f7d', 'request_id': 'req-a1fe4166-d79a-4aca-9b41-cd125e9c8f01'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:55.517347 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a1fe4166-d79a-4aca-9b41-cd125e9c8f01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2c8a276246e4302bad1e5952d832f7d', 'request_id': 'req-a1fe4166-d79a-4aca-9b41-cd125e9c8f01'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:55.537792 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a1fe4166-d79a-4aca-9b41-cd125e9c8f01 admin admin] The token cache is being invalidate because project b2c8a276246e4302bad1e5952d832f7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:52:55.538287 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a1fe4166-d79a-4aca-9b41-cd125e9c8f01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:55.539056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a1fe4166-d79a-4aca-9b41-cd125e9c8f01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:55.540763 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1304/2609] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:52:55 2022] DELETE /identity/v3/projects/b2c8a276246e4302bad1e5952d832f7d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:52:55.544851 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c29088-4807-4120-8b8e-619ceec4aca0 service placement] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:55.556474 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c29088-4807-4120-8b8e-619ceec4aca0 service placement] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:55.631955 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083a6d9-1712-4c61-b087-8cfbfdb68c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:55.632989 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083a6d9-1712-4c61-b087-8cfbfdb68c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:55.633564 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083a6d9-1712-4c61-b087-8cfbfdb68c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:55.634172 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083a6d9-1712-4c61-b087-8cfbfdb68c7c admin admin] PATH_INFO: `/v3/users/ab41e50ed6a848388fe5450baaea6c12` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:55.635427 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083a6d9-1712-4c61-b087-8cfbfdb68c7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab41e50ed6a848388fe5450baaea6c12)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:55.637460 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083a6d9-1712-4c61-b087-8cfbfdb68c7c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:55.690939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7083a6d9-1712-4c61-b087-8cfbfdb68c7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab41e50ed6a848388fe5450baaea6c12'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:55.699423 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7083a6d9-1712-4c61-b087-8cfbfdb68c7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab41e50ed6a848388fe5450baaea6c12'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:55.700265 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7083a6d9-1712-4c61-b087-8cfbfdb68c7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab41e50ed6a848388fe5450baaea6c12'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:55.717567 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7083a6d9-1712-4c61-b087-8cfbfdb68c7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab41e50ed6a848388fe5450baaea6c12'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:55.725657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-7083a6d9-1712-4c61-b087-8cfbfdb68c7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab41e50ed6a848388fe5450baaea6c12'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:55.732430 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1306/2610] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:52:55 2022] DELETE /identity/v3/users/ab41e50ed6a848388fe5450baaea6c12 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:52:56.060071 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe4166-d79a-4aca-9b41-cd125e9c8f01 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:52:56.061610 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a1fe4166-d79a-4aca-9b41-cd125e9c8f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:56.077125 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe4166-d79a-4aca-9b41-cd125e9c8f01 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:52:56.138294 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf71e1d6-0ae5-4f04-8a95-8c005f6981b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:52:56.138907 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71e1d6-0ae5-4f04-8a95-8c005f6981b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:56.139310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71e1d6-0ae5-4f04-8a95-8c005f6981b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:56.139704 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf71e1d6-0ae5-4f04-8a95-8c005f6981b7 admin admin] PATH_INFO: `/v3/projects/775880141b584870a9ecfd95c235c635` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:56.141619 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf71e1d6-0ae5-4f04-8a95-8c005f6981b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=775880141b584870a9ecfd95c235c635)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:52:56.144136 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf71e1d6-0ae5-4f04-8a95-8c005f6981b7 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:52:56.184299 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:56.199113 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cf71e1d6-0ae5-4f04-8a95-8c005f6981b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '775880141b584870a9ecfd95c235c635', 'request_id': 'req-cf71e1d6-0ae5-4f04-8a95-8c005f6981b7'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:56.208328 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cf71e1d6-0ae5-4f04-8a95-8c005f6981b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '775880141b584870a9ecfd95c235c635', 'request_id': 'req-cf71e1d6-0ae5-4f04-8a95-8c005f6981b7'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:56.215013 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cf71e1d6-0ae5-4f04-8a95-8c005f6981b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '775880141b584870a9ecfd95c235c635', 'request_id': 'req-cf71e1d6-0ae5-4f04-8a95-8c005f6981b7'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:56.227360 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cf71e1d6-0ae5-4f04-8a95-8c005f6981b7 admin admin] The token cache is being invalidate because project 775880141b584870a9ecfd95c235c635 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:52:56.227779 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cf71e1d6-0ae5-4f04-8a95-8c005f6981b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:56.228614 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-cf71e1d6-0ae5-4f04-8a95-8c005f6981b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:52:56.230231 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1305/2611] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:52:56 2022] DELETE /identity/v3/projects/775880141b584870a9ecfd95c235c635 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:52:58.679288 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300929d-266f-462d-b2b9-03cbbe533f92 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:52:58.680057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300929d-266f-462d-b2b9-03cbbe533f92 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:52:58.680057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300929d-266f-462d-b2b9-03cbbe533f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:52:58.701031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-b300929d-266f-462d-b2b9-03cbbe533f92 None None] MFA Rules not processed for user `9b19bf41fdb74cc4a8e0e048f86bf3c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:52:58.702441 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b300929d-266f-462d-b2b9-03cbbe533f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:52:58.756131 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:52:58.781133 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1307/2612] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:52:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:53:06.223907 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=13,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:53:08.773104 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=6 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:53:27.208870 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51da7b-db84-49dc-bd12-b2c47d516486 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:53:27.209569 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51da7b-db84-49dc-bd12-b2c47d516486 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:53:27.209569 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51da7b-db84-49dc-bd12-b2c47d516486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:53:27.249594 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-bc51da7b-db84-49dc-bd12-b2c47d516486 None None] MFA Rules not processed for user `5bdaf32400b94aa291ad43a3131e1d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:53:27.250731 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-bc51da7b-db84-49dc-bd12-b2c47d516486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:53:27.319534 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1306/2613] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Sep 26 05:53:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:53:27.361630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300929d-266f-462d-b2b9-03cbbe533f92 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:53:27.363326 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b300929d-266f-462d-b2b9-03cbbe533f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:53:27.448351 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300929d-266f-462d-b2b9-03cbbe533f92 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:53:27.455721 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822c012-317e-4817-ac7a-afc9d9211d22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '830cd52ac42548b2ade17b5215aefd28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:53:27.456365 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822c012-317e-4817-ac7a-afc9d9211d22 service swift] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:53:27.456637 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822c012-317e-4817-ac7a-afc9d9211d22 service swift] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:53:27.456932 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822c012-317e-4817-ac7a-afc9d9211d22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:53:27.466669 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0822c012-317e-4817-ac7a-afc9d9211d22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:53:27.468345 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0822c012-317e-4817-ac7a-afc9d9211d22 service swift] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:53:27.477860 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1308/2614] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 26 05:53:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 05:53:37.315071 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=32 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:53:37.474241 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=32 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:53:46.176417 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672ff8e-88c8-42a8-a39c-a4c1a77207c9 None None] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:53:46.177148 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672ff8e-88c8-42a8-a39c-a4c1a77207c9 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:53:46.177148 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672ff8e-88c8-42a8-a39c-a4c1a77207c9 None None] PATH_INFO: `/` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:53:46.178590 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1307/2615] 10.222.0.66 () {54 vars in 921 bytes} [Mon Sep 26 05:53:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 26 05:53:46.184629 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa772d-f0fe-4116-bea0-254e37dbbe79 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:53:46.185217 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa772d-f0fe-4116-bea0-254e37dbbe79 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:53:46.185217 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa772d-f0fe-4116-bea0-254e37dbbe79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:53:46.219586 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-7dfa772d-f0fe-4116-bea0-254e37dbbe79 None None] MFA Rules not processed for user `c559a36836be411b9afd076f4c9a0655`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:53:46.220961 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7dfa772d-f0fe-4116-bea0-254e37dbbe79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:53:46.331888 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1309/2616] 10.222.0.66 () {58 vars in 1018 bytes} [Mon Sep 26 05:53:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:53:46.344884 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672ff8e-88c8-42a8-a39c-a4c1a77207c9 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:53:46.346735 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2672ff8e-88c8-42a8-a39c-a4c1a77207c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:53:46.433980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672ff8e-88c8-42a8-a39c-a4c1a77207c9 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:53:46.438110 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048549b-ce36-4008-8b8f-eaf66d5bbc77 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '766ad3d6be374fc482a7c0bf6a1e56ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:53:46.438720 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048549b-ce36-4008-8b8f-eaf66d5bbc77 service glance] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:53:46.438991 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048549b-ce36-4008-8b8f-eaf66d5bbc77 service glance] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:53:46.439253 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048549b-ce36-4008-8b8f-eaf66d5bbc77 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:53:46.449985 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048549b-ce36-4008-8b8f-eaf66d5bbc77 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:53:46.451468 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048549b-ce36-4008-8b8f-eaf66d5bbc77 service glance] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:53:46.462179 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1308/2617] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:53:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:53:48.525624 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e2b9c-0270-4675-9607-76ea91100ddc None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:53:48.526150 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e2b9c-0270-4675-9607-76ea91100ddc None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:53:48.526328 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e2b9c-0270-4675-9607-76ea91100ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:53:48.549482 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-3a9e2b9c-0270-4675-9607-76ea91100ddc None None] MFA Rules not processed for user `5bdaf32400b94aa291ad43a3131e1d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:53:48.550700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3a9e2b9c-0270-4675-9607-76ea91100ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:53:48.558525 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1310/2618] 10.222.0.66 () {58 vars in 1009 bytes} [Mon Sep 26 05:53:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:53:48.571485 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048549b-ce36-4008-8b8f-eaf66d5bbc77 service glance] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:53:48.585110 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048549b-ce36-4008-8b8f-eaf66d5bbc77 service glance] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:53:48.593857 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3011319-059c-4714-8411-83c1308b49d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '830cd52ac42548b2ade17b5215aefd28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:53:48.594602 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3011319-059c-4714-8411-83c1308b49d6 service swift] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:53:48.594940 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3011319-059c-4714-8411-83c1308b49d6 service swift] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:53:48.595206 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3011319-059c-4714-8411-83c1308b49d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:53:48.605903 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3011319-059c-4714-8411-83c1308b49d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:53:48.607483 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3011319-059c-4714-8411-83c1308b49d6 service swift] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:53:48.616980 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1309/2619] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 26 05:53:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 05:53:58.543381 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=43 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:53:58.613091 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=32 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:54:12.900072 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28a1ea-014b-4e34-8ec0-4c2283544232 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:54:12.901052 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28a1ea-014b-4e34-8ec0-4c2283544232 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:54:12.901052 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28a1ea-014b-4e34-8ec0-4c2283544232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:54:12.929920 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-8e28a1ea-014b-4e34-8ec0-4c2283544232 None None] MFA Rules not processed for user `5bdaf32400b94aa291ad43a3131e1d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:54:12.931292 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8e28a1ea-014b-4e34-8ec0-4c2283544232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:54:12.943534 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1311/2620] 10.222.0.66 () {58 vars in 967 bytes} [Mon Sep 26 05:54:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:54:12.956673 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3011319-059c-4714-8411-83c1308b49d6 service swift] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:54:12.985688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3011319-059c-4714-8411-83c1308b49d6 service swift] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:54:12.992496 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165ad98-c869-4162-bf15-acace5915c29 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '830cd52ac42548b2ade17b5215aefd28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:54:12.993311 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165ad98-c869-4162-bf15-acace5915c29 service swift] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:54:12.993701 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165ad98-c869-4162-bf15-acace5915c29 service swift] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:54:12.994074 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165ad98-c869-4162-bf15-acace5915c29 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:54:13.003877 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165ad98-c869-4162-bf15-acace5915c29 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:54:13.005441 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2165ad98-c869-4162-bf15-acace5915c29 service swift] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:54:13.017744 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1310/2621] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 26 05:54:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 05:54:14.210227 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28a1ea-014b-4e34-8ec0-4c2283544232 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:54:14.213637 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8e28a1ea-014b-4e34-8ec0-4c2283544232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:54:14.292736 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28a1ea-014b-4e34-8ec0-4c2283544232 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:54:14.297588 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774d81e-ef7a-42a0-aa9e-e44c712287c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:54:14.298463 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774d81e-ef7a-42a0-aa9e-e44c712287c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:54:14.298736 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774d81e-ef7a-42a0-aa9e-e44c712287c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:54:14.299007 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774d81e-ef7a-42a0-aa9e-e44c712287c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:54:14.301055 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4774d81e-ef7a-42a0-aa9e-e44c712287c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:54:14.375191 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774d81e-ef7a-42a0-aa9e-e44c712287c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:54:14.376765 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774d81e-ef7a-42a0-aa9e-e44c712287c8 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:54:14.389349 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1312/2622] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:54:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:54:21.913599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165ad98-c869-4162-bf15-acace5915c29 service swift] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:54:21.915435 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2165ad98-c869-4162-bf15-acace5915c29 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:54:21.930883 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165ad98-c869-4162-bf15-acace5915c29 service swift] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:54:21.938850 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6325a-6368-4114-b314-ba89c4cae88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:54:21.939504 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6325a-6368-4114-b314-ba89c4cae88d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:54:21.939778 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6325a-6368-4114-b314-ba89c4cae88d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:54:21.940071 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6325a-6368-4114-b314-ba89c4cae88d admin admin] PATH_INFO: `/v3/users/7b570ef0cd6140bd87089a3eb6be2561` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:54:21.941289 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6325a-6368-4114-b314-ba89c4cae88d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b570ef0cd6140bd87089a3eb6be2561)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:54:21.943207 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6325a-6368-4114-b314-ba89c4cae88d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:54:21.991722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-18f6325a-6368-4114-b314-ba89c4cae88d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b570ef0cd6140bd87089a3eb6be2561'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:54:21.999857 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-18f6325a-6368-4114-b314-ba89c4cae88d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b570ef0cd6140bd87089a3eb6be2561'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:54:22.012077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-18f6325a-6368-4114-b314-ba89c4cae88d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b570ef0cd6140bd87089a3eb6be2561'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:54:22.012922 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-18f6325a-6368-4114-b314-ba89c4cae88d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b570ef0cd6140bd87089a3eb6be2561'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:54:22.020853 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-18f6325a-6368-4114-b314-ba89c4cae88d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b570ef0cd6140bd87089a3eb6be2561'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:54:22.027003 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1311/2623] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:54:21 2022] DELETE /identity/v3/users/7b570ef0cd6140bd87089a3eb6be2561 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:54:22.221411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774d81e-ef7a-42a0-aa9e-e44c712287c8 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:54:22.235502 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774d81e-ef7a-42a0-aa9e-e44c712287c8 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:54:22.295020 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d70de-fe0a-439f-b4cb-f1668092454a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:54:22.295977 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d70de-fe0a-439f-b4cb-f1668092454a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:54:22.296250 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d70de-fe0a-439f-b4cb-f1668092454a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:54:22.296520 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d70de-fe0a-439f-b4cb-f1668092454a admin admin] PATH_INFO: `/v3/projects/b72a95ef293143b29d3086905a0633aa` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:54:22.297700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d70de-fe0a-439f-b4cb-f1668092454a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b72a95ef293143b29d3086905a0633aa)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:54:22.299597 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d70de-fe0a-439f-b4cb-f1668092454a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:54:22.353347 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:54:22.355944 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9f6d70de-fe0a-439f-b4cb-f1668092454a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b72a95ef293143b29d3086905a0633aa', 'request_id': 'req-9f6d70de-fe0a-439f-b4cb-f1668092454a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:54:22.365594 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9f6d70de-fe0a-439f-b4cb-f1668092454a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b72a95ef293143b29d3086905a0633aa', 'request_id': 'req-9f6d70de-fe0a-439f-b4cb-f1668092454a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:54:22.373334 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9f6d70de-fe0a-439f-b4cb-f1668092454a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b72a95ef293143b29d3086905a0633aa', 'request_id': 'req-9f6d70de-fe0a-439f-b4cb-f1668092454a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:54:22.388754 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9f6d70de-fe0a-439f-b4cb-f1668092454a admin admin] The token cache is being invalidate because project b72a95ef293143b29d3086905a0633aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:54:22.389036 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9f6d70de-fe0a-439f-b4cb-f1668092454a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:54:22.389733 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-9f6d70de-fe0a-439f-b4cb-f1668092454a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:54:22.391305 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1313/2624] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:54:22 2022] DELETE /identity/v3/projects/b72a95ef293143b29d3086905a0633aa => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:54:22.395531 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6325a-6368-4114-b314-ba89c4cae88d admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:54:22.404264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-18f6325a-6368-4114-b314-ba89c4cae88d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:54:22.412085 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6325a-6368-4114-b314-ba89c4cae88d admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:54:22.473463 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ccc3e8-2d51-4ada-9cdc-561fc34699e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:54:22.474096 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ccc3e8-2d51-4ada-9cdc-561fc34699e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:54:22.474367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ccc3e8-2d51-4ada-9cdc-561fc34699e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:54:22.474631 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ccc3e8-2d51-4ada-9cdc-561fc34699e4 admin admin] PATH_INFO: `/v3/users/ba0d5e9440ed45859e8ac5079139c97a` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:54:22.476139 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ccc3e8-2d51-4ada-9cdc-561fc34699e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba0d5e9440ed45859e8ac5079139c97a)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:54:22.478122 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ccc3e8-2d51-4ada-9cdc-561fc34699e4 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:54:22.535920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-35ccc3e8-2d51-4ada-9cdc-561fc34699e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba0d5e9440ed45859e8ac5079139c97a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:54:22.550958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-35ccc3e8-2d51-4ada-9cdc-561fc34699e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba0d5e9440ed45859e8ac5079139c97a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:54:22.557362 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:54:22.568518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-35ccc3e8-2d51-4ada-9cdc-561fc34699e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba0d5e9440ed45859e8ac5079139c97a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:54:22.569696 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-35ccc3e8-2d51-4ada-9cdc-561fc34699e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba0d5e9440ed45859e8ac5079139c97a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:54:22.578852 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-35ccc3e8-2d51-4ada-9cdc-561fc34699e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba0d5e9440ed45859e8ac5079139c97a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:54:22.585382 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1312/2625] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:54:22 2022] DELETE /identity/v3/users/ba0d5e9440ed45859e8ac5079139c97a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:54:22.793753 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d70de-fe0a-439f-b4cb-f1668092454a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:54:22.795210 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-9f6d70de-fe0a-439f-b4cb-f1668092454a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:54:22.808451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d70de-fe0a-439f-b4cb-f1668092454a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:54:22.879664 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0c61b-29ad-459e-a109-ab1ce13fd8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:54:22.880744 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0c61b-29ad-459e-a109-ab1ce13fd8e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:54:22.881014 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0c61b-29ad-459e-a109-ab1ce13fd8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:54:22.881302 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0c61b-29ad-459e-a109-ab1ce13fd8e4 admin admin] PATH_INFO: `/v3/projects/90bae8adb5c34c42815410fa0caae5c6` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:54:22.882517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0c61b-29ad-459e-a109-ab1ce13fd8e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90bae8adb5c34c42815410fa0caae5c6)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:54:22.885193 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0c61b-29ad-459e-a109-ab1ce13fd8e4 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:54:22.938451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-15a0c61b-29ad-459e-a109-ab1ce13fd8e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90bae8adb5c34c42815410fa0caae5c6', 'request_id': 'req-15a0c61b-29ad-459e-a109-ab1ce13fd8e4'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:54:22.945314 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-15a0c61b-29ad-459e-a109-ab1ce13fd8e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90bae8adb5c34c42815410fa0caae5c6', 'request_id': 'req-15a0c61b-29ad-459e-a109-ab1ce13fd8e4'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:54:22.952490 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-15a0c61b-29ad-459e-a109-ab1ce13fd8e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90bae8adb5c34c42815410fa0caae5c6', 'request_id': 'req-15a0c61b-29ad-459e-a109-ab1ce13fd8e4'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:54:22.966065 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-15a0c61b-29ad-459e-a109-ab1ce13fd8e4 admin admin] The token cache is being invalidate because project 90bae8adb5c34c42815410fa0caae5c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:54:22.966354 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-15a0c61b-29ad-459e-a109-ab1ce13fd8e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:54:22.967005 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-15a0c61b-29ad-459e-a109-ab1ce13fd8e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:54:22.968582 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1314/2626] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:54:22 2022] DELETE /identity/v3/projects/90bae8adb5c34c42815410fa0caae5c6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:54:32.581414 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=9,keystone:DELETE=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:54:32.962942 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:DELETE=11,keystone:SELECT=58,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:54:44.963467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ccc3e8-2d51-4ada-9cdc-561fc34699e4 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:54:44.965910 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-35ccc3e8-2d51-4ada-9cdc-561fc34699e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:54:45.031403 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ccc3e8-2d51-4ada-9cdc-561fc34699e4 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:54:45.093463 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466997a-3164-4ef0-8bf5-b9e71c939a58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:54:45.094070 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466997a-3164-4ef0-8bf5-b9e71c939a58 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:54:45.094340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466997a-3164-4ef0-8bf5-b9e71c939a58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:54:45.094627 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466997a-3164-4ef0-8bf5-b9e71c939a58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:54:45.100931 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2466997a-3164-4ef0-8bf5-b9e71c939a58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:54:45.177125 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2466997a-3164-4ef0-8bf5-b9e71c939a58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:54:45.178567 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2466997a-3164-4ef0-8bf5-b9e71c939a58 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:54:45.190313 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1313/2627] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:54:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:54:47.886020 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0c61b-29ad-459e-a109-ab1ce13fd8e4 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:54:47.887690 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-15a0c61b-29ad-459e-a109-ab1ce13fd8e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:54:47.901761 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0c61b-29ad-459e-a109-ab1ce13fd8e4 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:54:47.906406 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3d9a7-6a5c-44df-949e-31cce7545a26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:54:47.907023 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3d9a7-6a5c-44df-949e-31cce7545a26 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:54:47.907304 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3d9a7-6a5c-44df-949e-31cce7545a26 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:54:47.907585 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3d9a7-6a5c-44df-949e-31cce7545a26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:54:47.909455 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-fbb3d9a7-6a5c-44df-949e-31cce7545a26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:54:47.924691 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3d9a7-6a5c-44df-949e-31cce7545a26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:54:47.926173 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb3d9a7-6a5c-44df-949e-31cce7545a26 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:54:47.938662 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1315/2628] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:54:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:54:55.185034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=74 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:54:57.933154 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=6 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:54:58.715839 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466997a-3164-4ef0-8bf5-b9e71c939a58 service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:54:58.717436 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2466997a-3164-4ef0-8bf5-b9e71c939a58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:54:58.780085 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466997a-3164-4ef0-8bf5-b9e71c939a58 service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:54:58.784519 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab6581-b9b3-48a5-a67e-74242e7c447e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:54:58.784862 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab6581-b9b3-48a5-a67e-74242e7c447e service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:54:58.785131 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab6581-b9b3-48a5-a67e-74242e7c447e service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:54:58.785391 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab6581-b9b3-48a5-a67e-74242e7c447e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:54:58.787307 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-76ab6581-b9b3-48a5-a67e-74242e7c447e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:54:58.855789 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ab6581-b9b3-48a5-a67e-74242e7c447e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:54:58.857716 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ab6581-b9b3-48a5-a67e-74242e7c447e service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:54:58.868811 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1314/2629] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:54:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:55:02.486781 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3d9a7-6a5c-44df-949e-31cce7545a26 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:02.488612 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-fbb3d9a7-6a5c-44df-949e-31cce7545a26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:02.521246 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3d9a7-6a5c-44df-949e-31cce7545a26 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:02.527288 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3639c31c-25de-4cd4-b443-23472c96a544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:02.528343 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639c31c-25de-4cd4-b443-23472c96a544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:02.528765 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639c31c-25de-4cd4-b443-23472c96a544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:02.529265 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639c31c-25de-4cd4-b443-23472c96a544 admin admin] PATH_INFO: `/v3/users/9b19bf41fdb74cc4a8e0e048f86bf3c8` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:02.545250 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639c31c-25de-4cd4-b443-23472c96a544 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b19bf41fdb74cc4a8e0e048f86bf3c8)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:02.547244 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3639c31c-25de-4cd4-b443-23472c96a544 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:02.598374 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3639c31c-25de-4cd4-b443-23472c96a544 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b19bf41fdb74cc4a8e0e048f86bf3c8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:02.606369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3639c31c-25de-4cd4-b443-23472c96a544 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b19bf41fdb74cc4a8e0e048f86bf3c8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:02.606970 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3639c31c-25de-4cd4-b443-23472c96a544 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b19bf41fdb74cc4a8e0e048f86bf3c8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:02.618902 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3639c31c-25de-4cd4-b443-23472c96a544 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b19bf41fdb74cc4a8e0e048f86bf3c8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:02.625829 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3639c31c-25de-4cd4-b443-23472c96a544 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b19bf41fdb74cc4a8e0e048f86bf3c8'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:02.632233 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1316/2630] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:55:02 2022] DELETE /identity/v3/users/9b19bf41fdb74cc4a8e0e048f86bf3c8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:02.837125 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab6581-b9b3-48a5-a67e-74242e7c447e service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:02.850114 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab6581-b9b3-48a5-a67e-74242e7c447e service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:02.912009 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eefd0d-269d-40ae-9056-3a63007274f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:02.912643 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eefd0d-269d-40ae-9056-3a63007274f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:02.912918 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eefd0d-269d-40ae-9056-3a63007274f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:02.913185 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eefd0d-269d-40ae-9056-3a63007274f1 admin admin] PATH_INFO: `/v3/projects/6cf774a8d43c4eb3b52fc817a7517a28` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:02.923685 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eefd0d-269d-40ae-9056-3a63007274f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cf774a8d43c4eb3b52fc817a7517a28)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:02.925758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eefd0d-269d-40ae-9056-3a63007274f1 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:02.971751 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:02.975965 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d7eefd0d-269d-40ae-9056-3a63007274f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cf774a8d43c4eb3b52fc817a7517a28', 'request_id': 'req-d7eefd0d-269d-40ae-9056-3a63007274f1'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:02.984210 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d7eefd0d-269d-40ae-9056-3a63007274f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cf774a8d43c4eb3b52fc817a7517a28', 'request_id': 'req-d7eefd0d-269d-40ae-9056-3a63007274f1'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:02.990070 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d7eefd0d-269d-40ae-9056-3a63007274f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cf774a8d43c4eb3b52fc817a7517a28', 'request_id': 'req-d7eefd0d-269d-40ae-9056-3a63007274f1'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:03.002703 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d7eefd0d-269d-40ae-9056-3a63007274f1 admin admin] The token cache is being invalidate because project 6cf774a8d43c4eb3b52fc817a7517a28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:55:03.002989 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d7eefd0d-269d-40ae-9056-3a63007274f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:03.003726 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d7eefd0d-269d-40ae-9056-3a63007274f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:03.005628 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1315/2631] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:55:02 2022] DELETE /identity/v3/projects/6cf774a8d43c4eb3b52fc817a7517a28 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:03.010556 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc1795-80f5-4d90-94ce-705967cfc9ec None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:03.010893 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc1795-80f5-4d90-94ce-705967cfc9ec None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:03.011164 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc1795-80f5-4d90-94ce-705967cfc9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:03.035181 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-aadc1795-80f5-4d90-94ce-705967cfc9ec None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:03.036444 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-aadc1795-80f5-4d90-94ce-705967cfc9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:03.108407 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1317/2632] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:03.120974 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a494448-9b22-4a86-ba53-57d10c98f42a None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:03.121267 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a494448-9b22-4a86-ba53-57d10c98f42a None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:03.121588 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a494448-9b22-4a86-ba53-57d10c98f42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:03.146367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-0a494448-9b22-4a86-ba53-57d10c98f42a None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:03.147726 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0a494448-9b22-4a86-ba53-57d10c98f42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:03.158511 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1316/2633] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:03.163634 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc1795-80f5-4d90-94ce-705967cfc9ec None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:03.176237 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc1795-80f5-4d90-94ce-705967cfc9ec None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:03.182632 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46758303-2f45-4e90-8d92-a5f4837a593c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:03.183479 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46758303-2f45-4e90-8d92-a5f4837a593c admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:03.183798 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46758303-2f45-4e90-8d92-a5f4837a593c admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:03.184068 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46758303-2f45-4e90-8d92-a5f4837a593c admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:03.184891 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46758303-2f45-4e90-8d92-a5f4837a593c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:55:03.185267 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46758303-2f45-4e90-8d92-a5f4837a593c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:03.187583 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46758303-2f45-4e90-8d92-a5f4837a593c admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:03.200514 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1318/2634] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:55:03.205353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a494448-9b22-4a86-ba53-57d10c98f42a None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:03.214643 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a494448-9b22-4a86-ba53-57d10c98f42a None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:03.220718 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2adf5-fe2f-4c0a-a237-a0c0ee493f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:03.221328 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2adf5-fe2f-4c0a-a237-a0c0ee493f8f admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:03.221593 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2adf5-fe2f-4c0a-a237-a0c0ee493f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:03.221907 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2adf5-fe2f-4c0a-a237-a0c0ee493f8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:03.222474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2adf5-fe2f-4c0a-a237-a0c0ee493f8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:03.224407 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2adf5-fe2f-4c0a-a237-a0c0ee493f8f admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:03.270147 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1317/2635] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:55:03 2022] POST /identity/v3/projects => generated 363 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:55:03.275353 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46758303-2f45-4e90-8d92-a5f4837a593c admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:03.289741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46758303-2f45-4e90-8d92-a5f4837a593c admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:03.336713 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:03.351218 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a16a3-4324-493f-be45-7a455054c5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:03.351888 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a16a3-4324-493f-be45-7a455054c5dc admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:03.352166 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a16a3-4324-493f-be45-7a455054c5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:03.352438 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a16a3-4324-493f-be45-7a455054c5dc admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:03.353070 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a16a3-4324-493f-be45-7a455054c5dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:03.355017 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a16a3-4324-493f-be45-7a455054c5dc admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:03.379907 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1319/2636] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:55:03 2022] POST /identity/v3/users => generated 282 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:55:03.384617 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2adf5-fe2f-4c0a-a237-a0c0ee493f8f admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:03.399553 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2adf5-fe2f-4c0a-a237-a0c0ee493f8f admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:03.408088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45c1b9-5c0c-4997-9a97-466a465fbcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:03.408822 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45c1b9-5c0c-4997-9a97-466a465fbcf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:03.409191 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45c1b9-5c0c-4997-9a97-466a465fbcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:03.409559 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45c1b9-5c0c-4997-9a97-466a465fbcf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:03.410316 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d45c1b9-5c0c-4997-9a97-466a465fbcf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:03.412130 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d45c1b9-5c0c-4997-9a97-466a465fbcf8 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:03.424034 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1318/2637] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:55:03.428490 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a16a3-4324-493f-be45-7a455054c5dc admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:03.439762 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a16a3-4324-493f-be45-7a455054c5dc admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:03.444568 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c575e2-8fbc-4b67-9ead-32ecbf8dfea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:03.445382 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c575e2-8fbc-4b67-9ead-32ecbf8dfea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:03.445654 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c575e2-8fbc-4b67-9ead-32ecbf8dfea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:03.445920 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c575e2-8fbc-4b67-9ead-32ecbf8dfea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:03.446594 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c575e2-8fbc-4b67-9ead-32ecbf8dfea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:03.448331 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c575e2-8fbc-4b67-9ead-32ecbf8dfea0 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:03.469209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1320/2638] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:55:03.473940 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45c1b9-5c0c-4997-9a97-466a465fbcf8 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:03.484737 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45c1b9-5c0c-4997-9a97-466a465fbcf8 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:03.490484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aeef22-2ccf-4bc1-ab63-8467a3d214d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:03.491180 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aeef22-2ccf-4bc1-ab63-8467a3d214d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:03.491455 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aeef22-2ccf-4bc1-ab63-8467a3d214d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:03.491722 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aeef22-2ccf-4bc1-ab63-8467a3d214d4 admin admin] PATH_INFO: `/v3/projects/355d5c0ca97743babcd5f96a603c841e/users/b11a86eb360344fa8def28400960ab8e/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:03.508051 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aeef22-2ccf-4bc1-ab63-8467a3d214d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=355d5c0ca97743babcd5f96a603c841e, user_id=b11a86eb360344fa8def28400960ab8e, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:03.510688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aeef22-2ccf-4bc1-ab63-8467a3d214d4 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:03.529322 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1319/2639] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:55:03 2022] PUT /identity/v3/projects/355d5c0ca97743babcd5f96a603c841e/users/b11a86eb360344fa8def28400960ab8e/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:03.544815 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db4f63-3b1e-4971-be92-7e1a9e0fe906 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:03.545359 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db4f63-3b1e-4971-be92-7e1a9e0fe906 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:03.545359 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db4f63-3b1e-4971-be92-7e1a9e0fe906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:03.578132 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-d0db4f63-3b1e-4971-be92-7e1a9e0fe906 None None] MFA Rules not processed for user `b11a86eb360344fa8def28400960ab8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:03.579386 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d0db4f63-3b1e-4971-be92-7e1a9e0fe906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:03.654031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1321/2640] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:03.658828 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aeef22-2ccf-4bc1-ab63-8467a3d214d4 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:03.730488 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aeef22-2ccf-4bc1-ab63-8467a3d214d4 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:03.736266 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc899601-d307-422a-9f21-b49af0f1f823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:03.736909 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc899601-d307-422a-9f21-b49af0f1f823 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:03.737264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc899601-d307-422a-9f21-b49af0f1f823 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:03.737675 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc899601-d307-422a-9f21-b49af0f1f823 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:03.738420 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc899601-d307-422a-9f21-b49af0f1f823 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:03.740763 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc899601-d307-422a-9f21-b49af0f1f823 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:03.769621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1320/2641] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:55:03 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:55:03.778404 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db4f63-3b1e-4971-be92-7e1a9e0fe906 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:03.790543 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db4f63-3b1e-4971-be92-7e1a9e0fe906 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:03.847856 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d486212-76f4-4270-bdc7-294258342761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:03.848513 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d486212-76f4-4270-bdc7-294258342761 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:03.848791 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d486212-76f4-4270-bdc7-294258342761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:03.849070 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d486212-76f4-4270-bdc7-294258342761 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:03.849704 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d486212-76f4-4270-bdc7-294258342761 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:03.851622 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d486212-76f4-4270-bdc7-294258342761 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:03.875317 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1322/2642] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:55:03 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:55:03.880089 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc899601-d307-422a-9f21-b49af0f1f823 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:03.890750 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc899601-d307-422a-9f21-b49af0f1f823 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:03.898239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5db1f-c79a-434c-b0e4-536b045dddcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:03.899058 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5db1f-c79a-434c-b0e4-536b045dddcd admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:03.899442 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5db1f-c79a-434c-b0e4-536b045dddcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:03.899888 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5db1f-c79a-434c-b0e4-536b045dddcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:03.900911 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba5db1f-c79a-434c-b0e4-536b045dddcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:03.904043 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba5db1f-c79a-434c-b0e4-536b045dddcd admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:03.917025 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1321/2643] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:55:03.921811 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d486212-76f4-4270-bdc7-294258342761 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:03.932453 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d486212-76f4-4270-bdc7-294258342761 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:03.937414 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbe568-a50f-4334-9445-bab0654dd232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:03.938085 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbe568-a50f-4334-9445-bab0654dd232 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:03.938359 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbe568-a50f-4334-9445-bab0654dd232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:03.938632 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbe568-a50f-4334-9445-bab0654dd232 admin admin] PATH_INFO: `/v3/projects/832bdbb40224429f82a9ccb4ff8fa11c/users/93e633a2371f4749b6d7b6b5bff97707/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:03.954367 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fbe568-a50f-4334-9445-bab0654dd232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=832bdbb40224429f82a9ccb4ff8fa11c, user_id=93e633a2371f4749b6d7b6b5bff97707, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:03.957918 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fbe568-a50f-4334-9445-bab0654dd232 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:03.973435 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1323/2644] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:55:03 2022] PUT /identity/v3/projects/832bdbb40224429f82a9ccb4ff8fa11c/users/93e633a2371f4749b6d7b6b5bff97707/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:55:03.979585 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5db1f-c79a-434c-b0e4-536b045dddcd admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:03.996876 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5db1f-c79a-434c-b0e4-536b045dddcd admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:04.031581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:04.061713 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e982a7-87e6-4138-81c1-037d2a87dbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:04.062340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e982a7-87e6-4138-81c1-037d2a87dbe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:04.062605 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e982a7-87e6-4138-81c1-037d2a87dbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:04.062869 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e982a7-87e6-4138-81c1-037d2a87dbe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:04.063545 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e982a7-87e6-4138-81c1-037d2a87dbe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:04.065442 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e982a7-87e6-4138-81c1-037d2a87dbe2 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:04.076127 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1322/2645] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:55:04.081026 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbe568-a50f-4334-9445-bab0654dd232 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:04.092558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbe568-a50f-4334-9445-bab0654dd232 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:04.098102 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fa084-6e54-46f7-a023-3f0ba2a1a3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:04.098789 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fa084-6e54-46f7-a023-3f0ba2a1a3c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:04.099063 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fa084-6e54-46f7-a023-3f0ba2a1a3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:04.099341 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fa084-6e54-46f7-a023-3f0ba2a1a3c6 admin admin] PATH_INFO: `/v3/projects/832bdbb40224429f82a9ccb4ff8fa11c/users/93e633a2371f4749b6d7b6b5bff97707/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:04.101384 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fa084-6e54-46f7-a023-3f0ba2a1a3c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=832bdbb40224429f82a9ccb4ff8fa11c, user_id=93e633a2371f4749b6d7b6b5bff97707, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:04.104085 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fa084-6e54-46f7-a023-3f0ba2a1a3c6 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:04.115134 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1324/2646] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:55:04 2022] PUT /identity/v3/projects/832bdbb40224429f82a9ccb4ff8fa11c/users/93e633a2371f4749b6d7b6b5bff97707/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:04.127195 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987d310-e8eb-4f84-b2e2-bd3884c352d8 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:04.127571 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987d310-e8eb-4f84-b2e2-bd3884c352d8 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:04.127985 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987d310-e8eb-4f84-b2e2-bd3884c352d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:04.163061 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-3987d310-e8eb-4f84-b2e2-bd3884c352d8 None None] MFA Rules not processed for user `93e633a2371f4749b6d7b6b5bff97707`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:04.164470 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-3987d310-e8eb-4f84-b2e2-bd3884c352d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:04.238854 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1323/2647] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:04.250367 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fa084-6e54-46f7-a023-3f0ba2a1a3c6 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:04.252119 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f17fa084-6e54-46f7-a023-3f0ba2a1a3c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:04.263204 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:04.316389 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fa084-6e54-46f7-a023-3f0ba2a1a3c6 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:04.321074 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d42ad-5eec-46a0-b286-07db36fdb1ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:04.321758 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d42ad-5eec-46a0-b286-07db36fdb1ae service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:04.322027 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d42ad-5eec-46a0-b286-07db36fdb1ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:04.322289 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d42ad-5eec-46a0-b286-07db36fdb1ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:04.332446 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d42ad-5eec-46a0-b286-07db36fdb1ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:04.333916 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d42ad-5eec-46a0-b286-07db36fdb1ae service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:04.346024 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1325/2648] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:55:04 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:55:04.810171 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987d310-e8eb-4f84-b2e2-bd3884c352d8 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:04.874673 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987d310-e8eb-4f84-b2e2-bd3884c352d8 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:04.879317 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2fa93-8277-4162-a6be-65cb5c2948f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:04.879997 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2fa93-8277-4162-a6be-65cb5c2948f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:04.880268 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2fa93-8277-4162-a6be-65cb5c2948f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:04.880853 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2fa93-8277-4162-a6be-65cb5c2948f7 admin admin] PATH_INFO: `/v3/users/b11a86eb360344fa8def28400960ab8e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:04.881621 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2fa93-8277-4162-a6be-65cb5c2948f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b11a86eb360344fa8def28400960ab8e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:04.883522 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2fa93-8277-4162-a6be-65cb5c2948f7 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:04.931938 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-06d2fa93-8277-4162-a6be-65cb5c2948f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b11a86eb360344fa8def28400960ab8e'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:04.939191 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-06d2fa93-8277-4162-a6be-65cb5c2948f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b11a86eb360344fa8def28400960ab8e'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:04.941488 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:04.953838 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-06d2fa93-8277-4162-a6be-65cb5c2948f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b11a86eb360344fa8def28400960ab8e'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:04.954507 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-06d2fa93-8277-4162-a6be-65cb5c2948f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b11a86eb360344fa8def28400960ab8e'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:04.961855 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-06d2fa93-8277-4162-a6be-65cb5c2948f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b11a86eb360344fa8def28400960ab8e'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:04.968490 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1324/2649] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:55:04 2022] DELETE /identity/v3/users/b11a86eb360344fa8def28400960ab8e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:04.974170 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed487e8-f61e-4b53-ae8f-e48c4952dbd7 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:04.974731 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed487e8-f61e-4b53-ae8f-e48c4952dbd7 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:04.974731 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed487e8-f61e-4b53-ae8f-e48c4952dbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:04.994971 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-3ed487e8-f61e-4b53-ae8f-e48c4952dbd7 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:04.996209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3ed487e8-f61e-4b53-ae8f-e48c4952dbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:05.059408 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1326/2650] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:05.070165 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2fa93-8277-4162-a6be-65cb5c2948f7 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:05.072259 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-06d2fa93-8277-4162-a6be-65cb5c2948f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:05.134127 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2fa93-8277-4162-a6be-65cb5c2948f7 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:05.138480 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293aa17-980a-492c-b034-a020403d4d59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:05.139083 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293aa17-980a-492c-b034-a020403d4d59 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:05.139356 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293aa17-980a-492c-b034-a020403d4d59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:05.139620 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293aa17-980a-492c-b034-a020403d4d59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:05.149948 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b293aa17-980a-492c-b034-a020403d4d59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:05.151362 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b293aa17-980a-492c-b034-a020403d4d59 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:05.161859 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1325/2651] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:55:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:55:05.460739 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed487e8-f61e-4b53-ae8f-e48c4952dbd7 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:05.462255 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3ed487e8-f61e-4b53-ae8f-e48c4952dbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:05.478837 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed487e8-f61e-4b53-ae8f-e48c4952dbd7 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:05.484244 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9b85a-5453-4449-b8f5-8ef10ea8d1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:05.485169 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9b85a-5453-4449-b8f5-8ef10ea8d1e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:05.485629 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9b85a-5453-4449-b8f5-8ef10ea8d1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:05.486038 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9b85a-5453-4449-b8f5-8ef10ea8d1e5 admin admin] PATH_INFO: `/v3/projects/355d5c0ca97743babcd5f96a603c841e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:05.487626 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9b85a-5453-4449-b8f5-8ef10ea8d1e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=355d5c0ca97743babcd5f96a603c841e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:05.489854 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9b85a-5453-4449-b8f5-8ef10ea8d1e5 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:05.555522 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f8d9b85a-5453-4449-b8f5-8ef10ea8d1e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '355d5c0ca97743babcd5f96a603c841e', 'request_id': 'req-f8d9b85a-5453-4449-b8f5-8ef10ea8d1e5'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:05.565783 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f8d9b85a-5453-4449-b8f5-8ef10ea8d1e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '355d5c0ca97743babcd5f96a603c841e', 'request_id': 'req-f8d9b85a-5453-4449-b8f5-8ef10ea8d1e5'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:05.572892 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f8d9b85a-5453-4449-b8f5-8ef10ea8d1e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '355d5c0ca97743babcd5f96a603c841e', 'request_id': 'req-f8d9b85a-5453-4449-b8f5-8ef10ea8d1e5'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:05.587597 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f8d9b85a-5453-4449-b8f5-8ef10ea8d1e5 admin admin] The token cache is being invalidate because project 355d5c0ca97743babcd5f96a603c841e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:55:05.587920 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f8d9b85a-5453-4449-b8f5-8ef10ea8d1e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:05.588656 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-f8d9b85a-5453-4449-b8f5-8ef10ea8d1e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:05.590246 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1327/2652] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:55:05 2022] DELETE /identity/v3/projects/355d5c0ca97743babcd5f96a603c841e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:05.594692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293aa17-980a-492c-b034-a020403d4d59 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:05.605358 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293aa17-980a-492c-b034-a020403d4d59 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:05.663449 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bad477-79f7-4b27-b82c-318a48827492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:05.664124 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bad477-79f7-4b27-b82c-318a48827492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:05.664374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bad477-79f7-4b27-b82c-318a48827492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:05.664666 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bad477-79f7-4b27-b82c-318a48827492 admin admin] PATH_INFO: `/v3/users/93e633a2371f4749b6d7b6b5bff97707` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:05.665816 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bad477-79f7-4b27-b82c-318a48827492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93e633a2371f4749b6d7b6b5bff97707)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:05.667720 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bad477-79f7-4b27-b82c-318a48827492 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:05.719492 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-47bad477-79f7-4b27-b82c-318a48827492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93e633a2371f4749b6d7b6b5bff97707'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:05.727571 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-47bad477-79f7-4b27-b82c-318a48827492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93e633a2371f4749b6d7b6b5bff97707'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:05.741585 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-47bad477-79f7-4b27-b82c-318a48827492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93e633a2371f4749b6d7b6b5bff97707'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:05.742377 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-47bad477-79f7-4b27-b82c-318a48827492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93e633a2371f4749b6d7b6b5bff97707'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:05.748339 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:05.750373 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-47bad477-79f7-4b27-b82c-318a48827492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93e633a2371f4749b6d7b6b5bff97707'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:05.758645 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1326/2653] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:55:05 2022] DELETE /identity/v3/users/93e633a2371f4749b6d7b6b5bff97707 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:06.057633 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9b85a-5453-4449-b8f5-8ef10ea8d1e5 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:06.059125 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f8d9b85a-5453-4449-b8f5-8ef10ea8d1e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:06.074086 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9b85a-5453-4449-b8f5-8ef10ea8d1e5 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:06.108887 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:06.134618 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d32db-fb30-43f5-9fdb-ca9e29817f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:06.135254 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d32db-fb30-43f5-9fdb-ca9e29817f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:06.135530 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d32db-fb30-43f5-9fdb-ca9e29817f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:06.135789 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d32db-fb30-43f5-9fdb-ca9e29817f3b admin admin] PATH_INFO: `/v3/projects/832bdbb40224429f82a9ccb4ff8fa11c` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:06.136973 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d32db-fb30-43f5-9fdb-ca9e29817f3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=832bdbb40224429f82a9ccb4ff8fa11c)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:06.138871 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d32db-fb30-43f5-9fdb-ca9e29817f3b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:06.200365 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-033d32db-fb30-43f5-9fdb-ca9e29817f3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '832bdbb40224429f82a9ccb4ff8fa11c', 'request_id': 'req-033d32db-fb30-43f5-9fdb-ca9e29817f3b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:06.206651 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-033d32db-fb30-43f5-9fdb-ca9e29817f3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '832bdbb40224429f82a9ccb4ff8fa11c', 'request_id': 'req-033d32db-fb30-43f5-9fdb-ca9e29817f3b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:06.213680 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-033d32db-fb30-43f5-9fdb-ca9e29817f3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '832bdbb40224429f82a9ccb4ff8fa11c', 'request_id': 'req-033d32db-fb30-43f5-9fdb-ca9e29817f3b'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:06.228899 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-033d32db-fb30-43f5-9fdb-ca9e29817f3b admin admin] The token cache is being invalidate because project 832bdbb40224429f82a9ccb4ff8fa11c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:55:06.229186 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-033d32db-fb30-43f5-9fdb-ca9e29817f3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:06.229846 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-033d32db-fb30-43f5-9fdb-ca9e29817f3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:06.231445 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1328/2654] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:55:06 2022] DELETE /identity/v3/projects/832bdbb40224429f82a9ccb4ff8fa11c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:06.236559 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c147ca-c4a5-4d28-a5ee-b84f325d9369 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:06.237026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c147ca-c4a5-4d28-a5ee-b84f325d9369 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:06.237122 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c147ca-c4a5-4d28-a5ee-b84f325d9369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:06.257631 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-b7c147ca-c4a5-4d28-a5ee-b84f325d9369 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:06.258833 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b7c147ca-c4a5-4d28-a5ee-b84f325d9369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:06.324504 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1327/2655] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:06.332683 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33732f4a-8bdc-46aa-ae4e-edea0693883c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:06.332950 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33732f4a-8bdc-46aa-ae4e-edea0693883c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:06.333225 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33732f4a-8bdc-46aa-ae4e-edea0693883c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:06.355035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-33732f4a-8bdc-46aa-ae4e-edea0693883c None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:06.356290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-33732f4a-8bdc-46aa-ae4e-edea0693883c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:06.366086 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1329/2656] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:06.371366 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c147ca-c4a5-4d28-a5ee-b84f325d9369 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:06.382805 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c147ca-c4a5-4d28-a5ee-b84f325d9369 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:06.387815 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c50c3-b8e2-446c-99d1-46853f6f7ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:06.388423 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c50c3-b8e2-446c-99d1-46853f6f7ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:06.388728 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c50c3-b8e2-446c-99d1-46853f6f7ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:06.388986 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c50c3-b8e2-446c-99d1-46853f6f7ce1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:06.389614 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c50c3-b8e2-446c-99d1-46853f6f7ce1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:55:06.389934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c50c3-b8e2-446c-99d1-46853f6f7ce1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:06.391541 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c50c3-b8e2-446c-99d1-46853f6f7ce1 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:06.405112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1328/2657] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:55:06.410374 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33732f4a-8bdc-46aa-ae4e-edea0693883c None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:06.423993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33732f4a-8bdc-46aa-ae4e-edea0693883c None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:06.432270 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e52800-29c8-493d-b8e6-13e54cfc2c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:06.433149 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e52800-29c8-493d-b8e6-13e54cfc2c98 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:06.433612 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e52800-29c8-493d-b8e6-13e54cfc2c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:06.434219 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e52800-29c8-493d-b8e6-13e54cfc2c98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:06.435015 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e52800-29c8-493d-b8e6-13e54cfc2c98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:06.437148 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e52800-29c8-493d-b8e6-13e54cfc2c98 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:06.473390 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1330/2658] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:55:06 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:55:06.480523 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c50c3-b8e2-446c-99d1-46853f6f7ce1 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:06.491498 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c50c3-b8e2-446c-99d1-46853f6f7ce1 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:06.551638 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bfb376-cc62-494f-8f85-e43160055d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:06.552287 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfb376-cc62-494f-8f85-e43160055d38 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:06.552559 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfb376-cc62-494f-8f85-e43160055d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:06.552823 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfb376-cc62-494f-8f85-e43160055d38 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:06.553451 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bfb376-cc62-494f-8f85-e43160055d38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:06.555334 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bfb376-cc62-494f-8f85-e43160055d38 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:06.578340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1329/2659] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:55:06 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:55:06.582777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e52800-29c8-493d-b8e6-13e54cfc2c98 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:06.593418 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e52800-29c8-493d-b8e6-13e54cfc2c98 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:06.598078 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66ed5b-d622-468a-887a-492a3e8a4498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:06.598681 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66ed5b-d622-468a-887a-492a3e8a4498 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:06.598958 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66ed5b-d622-468a-887a-492a3e8a4498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:06.599230 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66ed5b-d622-468a-887a-492a3e8a4498 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:06.599904 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66ed5b-d622-468a-887a-492a3e8a4498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:06.601511 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66ed5b-d622-468a-887a-492a3e8a4498 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:06.612348 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1331/2660] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:55:06.617541 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bfb376-cc62-494f-8f85-e43160055d38 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:06.628314 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bfb376-cc62-494f-8f85-e43160055d38 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:06.632912 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ae4b4-5661-4a0c-8a24-5d5eaa377ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:06.633511 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ae4b4-5661-4a0c-8a24-5d5eaa377ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:06.633788 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ae4b4-5661-4a0c-8a24-5d5eaa377ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:06.634053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ae4b4-5661-4a0c-8a24-5d5eaa377ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:06.634717 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ae4b4-5661-4a0c-8a24-5d5eaa377ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:06.636342 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6ae4b4-5661-4a0c-8a24-5d5eaa377ec2 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:06.649209 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1330/2661] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:55:06.654402 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66ed5b-d622-468a-887a-492a3e8a4498 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:06.665791 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66ed5b-d622-468a-887a-492a3e8a4498 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:06.672049 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59fa85-033c-4ec7-88de-42a93d3f0de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:06.672907 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59fa85-033c-4ec7-88de-42a93d3f0de0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:06.673218 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59fa85-033c-4ec7-88de-42a93d3f0de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:06.673617 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59fa85-033c-4ec7-88de-42a93d3f0de0 admin admin] PATH_INFO: `/v3/projects/f8c291b890cb4a15ae6bcf3d342ba53f/users/74e927e8a5b445d2ad161294e6d1c22f/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:06.690757 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59fa85-033c-4ec7-88de-42a93d3f0de0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8c291b890cb4a15ae6bcf3d342ba53f, user_id=74e927e8a5b445d2ad161294e6d1c22f, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:06.693478 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59fa85-033c-4ec7-88de-42a93d3f0de0 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:06.709571 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1332/2662] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:55:06 2022] PUT /identity/v3/projects/f8c291b890cb4a15ae6bcf3d342ba53f/users/74e927e8a5b445d2ad161294e6d1c22f/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:06.719965 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640410c-5036-405f-b549-bbfb4295f57f None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:06.720261 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640410c-5036-405f-b549-bbfb4295f57f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:06.720507 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640410c-5036-405f-b549-bbfb4295f57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:06.750799 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-4640410c-5036-405f-b549-bbfb4295f57f None None] MFA Rules not processed for user `74e927e8a5b445d2ad161294e6d1c22f`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:06.752066 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4640410c-5036-405f-b549-bbfb4295f57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:06.805794 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:06.826998 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1331/2663] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:06.839640 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59fa85-033c-4ec7-88de-42a93d3f0de0 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:06.910983 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59fa85-033c-4ec7-88de-42a93d3f0de0 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:06.916773 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a62de-efa9-4712-92e9-fbe61ae26864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:06.917395 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a62de-efa9-4712-92e9-fbe61ae26864 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:06.917663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a62de-efa9-4712-92e9-fbe61ae26864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:06.917928 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a62de-efa9-4712-92e9-fbe61ae26864 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:06.918566 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a62de-efa9-4712-92e9-fbe61ae26864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:06.920569 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a62de-efa9-4712-92e9-fbe61ae26864 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:06.928066 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:06.956458 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1333/2664] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:55:06 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:55:06.960708 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640410c-5036-405f-b549-bbfb4295f57f None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:06.975453 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640410c-5036-405f-b549-bbfb4295f57f None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:07.040162 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fd881-a321-400b-b5bc-e22894038c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:07.040776 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fd881-a321-400b-b5bc-e22894038c94 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:07.041047 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fd881-a321-400b-b5bc-e22894038c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:07.041304 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fd881-a321-400b-b5bc-e22894038c94 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:07.041934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fd881-a321-400b-b5bc-e22894038c94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:07.043895 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fd881-a321-400b-b5bc-e22894038c94 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:07.071264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1332/2665] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:55:06 2022] POST /identity/v3/users => generated 300 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:55:07.075481 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a62de-efa9-4712-92e9-fbe61ae26864 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:07.088680 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a62de-efa9-4712-92e9-fbe61ae26864 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:07.093841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ad30b-1968-4355-8f74-3507bbde495f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:07.094451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ad30b-1968-4355-8f74-3507bbde495f admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:07.094728 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ad30b-1968-4355-8f74-3507bbde495f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:07.094998 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ad30b-1968-4355-8f74-3507bbde495f admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:07.095640 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ad30b-1968-4355-8f74-3507bbde495f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:07.097400 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ad30b-1968-4355-8f74-3507bbde495f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:07.108062 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1334/2666] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:55:07.112538 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fd881-a321-400b-b5bc-e22894038c94 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:07.123688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fd881-a321-400b-b5bc-e22894038c94 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:07.128758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159d647-c74c-48bf-bd80-5d8c1945390e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:07.129413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159d647-c74c-48bf-bd80-5d8c1945390e admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:07.129681 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159d647-c74c-48bf-bd80-5d8c1945390e admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:07.129952 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159d647-c74c-48bf-bd80-5d8c1945390e admin admin] PATH_INFO: `/v3/projects/609092e9d1b5471b81083697355087e1/users/f83058dcdff04081b41c8f58b67bfa6a/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:07.145056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159d647-c74c-48bf-bd80-5d8c1945390e admin admin] RBAC: Authorizing `identity:create_grant(project_id=609092e9d1b5471b81083697355087e1, user_id=f83058dcdff04081b41c8f58b67bfa6a, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:07.147692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159d647-c74c-48bf-bd80-5d8c1945390e admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:07.165891 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1333/2667] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:55:07 2022] PUT /identity/v3/projects/609092e9d1b5471b81083697355087e1/users/f83058dcdff04081b41c8f58b67bfa6a/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:55:07.171117 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ad30b-1968-4355-8f74-3507bbde495f admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:07.182608 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ad30b-1968-4355-8f74-3507bbde495f admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:07.248174 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd18c6f-16ff-4523-91df-bb5e47d7a817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:07.248795 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd18c6f-16ff-4523-91df-bb5e47d7a817 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:07.249068 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd18c6f-16ff-4523-91df-bb5e47d7a817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:07.249334 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd18c6f-16ff-4523-91df-bb5e47d7a817 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:07.249958 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd18c6f-16ff-4523-91df-bb5e47d7a817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:07.251605 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd18c6f-16ff-4523-91df-bb5e47d7a817 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:07.262525 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1335/2668] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:55:07.267307 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159d647-c74c-48bf-bd80-5d8c1945390e admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:07.278692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159d647-c74c-48bf-bd80-5d8c1945390e admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:07.285967 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f91701d-ece9-49f5-b363-f6ea84bd9e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:07.286631 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91701d-ece9-49f5-b363-f6ea84bd9e3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:07.286906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91701d-ece9-49f5-b363-f6ea84bd9e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:07.287175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91701d-ece9-49f5-b363-f6ea84bd9e3e admin admin] PATH_INFO: `/v3/projects/609092e9d1b5471b81083697355087e1/users/f83058dcdff04081b41c8f58b67bfa6a/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:07.289255 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f91701d-ece9-49f5-b363-f6ea84bd9e3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=609092e9d1b5471b81083697355087e1, user_id=f83058dcdff04081b41c8f58b67bfa6a, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:07.292045 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f91701d-ece9-49f5-b363-f6ea84bd9e3e admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:07.302900 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1334/2669] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:55:07 2022] PUT /identity/v3/projects/609092e9d1b5471b81083697355087e1/users/f83058dcdff04081b41c8f58b67bfa6a/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:07.319832 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fba209-4418-4dbf-8958-69ba3c028e49 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:07.320119 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fba209-4418-4dbf-8958-69ba3c028e49 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:07.320371 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fba209-4418-4dbf-8958-69ba3c028e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:07.349476 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-92fba209-4418-4dbf-8958-69ba3c028e49 None None] MFA Rules not processed for user `f83058dcdff04081b41c8f58b67bfa6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:07.350676 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-92fba209-4418-4dbf-8958-69ba3c028e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:07.419779 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1336/2670] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:07 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:07.434076 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f91701d-ece9-49f5-b363-f6ea84bd9e3e admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:07.436812 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-8f91701d-ece9-49f5-b363-f6ea84bd9e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:07.505701 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f91701d-ece9-49f5-b363-f6ea84bd9e3e admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:07.509656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c82710-b420-4a04-bc34-4238185f338e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:07.510290 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c82710-b420-4a04-bc34-4238185f338e service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:07.510557 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c82710-b420-4a04-bc34-4238185f338e service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:07.510822 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c82710-b420-4a04-bc34-4238185f338e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:07.520492 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c82710-b420-4a04-bc34-4238185f338e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:07.521907 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c82710-b420-4a04-bc34-4238185f338e service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:07.532004 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1335/2671] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:55:07 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:55:07.560849 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fba209-4418-4dbf-8958-69ba3c028e49 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:07.622535 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:07.632564 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fba209-4418-4dbf-8958-69ba3c028e49 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:07.637527 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27fed0-8dc8-46c0-999a-3169b2987618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:07.638171 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27fed0-8dc8-46c0-999a-3169b2987618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:07.638442 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27fed0-8dc8-46c0-999a-3169b2987618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:07.638748 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27fed0-8dc8-46c0-999a-3169b2987618 admin admin] PATH_INFO: `/v3/users/74e927e8a5b445d2ad161294e6d1c22f` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:07.639909 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27fed0-8dc8-46c0-999a-3169b2987618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74e927e8a5b445d2ad161294e6d1c22f)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:07.641880 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27fed0-8dc8-46c0-999a-3169b2987618 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:07.694635 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1d27fed0-8dc8-46c0-999a-3169b2987618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74e927e8a5b445d2ad161294e6d1c22f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:07.704677 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1d27fed0-8dc8-46c0-999a-3169b2987618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74e927e8a5b445d2ad161294e6d1c22f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:07.705418 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1d27fed0-8dc8-46c0-999a-3169b2987618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74e927e8a5b445d2ad161294e6d1c22f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:07.719936 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1d27fed0-8dc8-46c0-999a-3169b2987618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74e927e8a5b445d2ad161294e6d1c22f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:07.727283 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1d27fed0-8dc8-46c0-999a-3169b2987618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74e927e8a5b445d2ad161294e6d1c22f'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:07.733858 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1337/2672] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:55:07 2022] DELETE /identity/v3/users/74e927e8a5b445d2ad161294e6d1c22f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:55:07.738558 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f4e04-1e97-4115-b5c8-abad6946fc50 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:07.738910 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f4e04-1e97-4115-b5c8-abad6946fc50 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:07.739182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f4e04-1e97-4115-b5c8-abad6946fc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:07.759217 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-7a9f4e04-1e97-4115-b5c8-abad6946fc50 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:07.760472 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-7a9f4e04-1e97-4115-b5c8-abad6946fc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:07.811588 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:07.833019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1336/2673] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:07.843192 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27fed0-8dc8-46c0-999a-3169b2987618 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:07.845531 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1d27fed0-8dc8-46c0-999a-3169b2987618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:07.905986 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27fed0-8dc8-46c0-999a-3169b2987618 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:07.910084 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64edbbc7-28ce-4ebf-8e32-e8d5fed66c4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:07.910685 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edbbc7-28ce-4ebf-8e32-e8d5fed66c4e service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:07.910971 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edbbc7-28ce-4ebf-8e32-e8d5fed66c4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:07.911229 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edbbc7-28ce-4ebf-8e32-e8d5fed66c4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:07.921873 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64edbbc7-28ce-4ebf-8e32-e8d5fed66c4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:07.923333 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64edbbc7-28ce-4ebf-8e32-e8d5fed66c4e service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:07.934167 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1338/2674] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:55:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:55:08.241277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f4e04-1e97-4115-b5c8-abad6946fc50 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:08.242856 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-7a9f4e04-1e97-4115-b5c8-abad6946fc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:08.257790 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f4e04-1e97-4115-b5c8-abad6946fc50 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:08.263598 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78665ed-d88a-4d86-af38-8a625dd8f6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:08.264279 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78665ed-d88a-4d86-af38-8a625dd8f6a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:08.264547 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78665ed-d88a-4d86-af38-8a625dd8f6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:08.264827 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78665ed-d88a-4d86-af38-8a625dd8f6a9 admin admin] PATH_INFO: `/v3/projects/f8c291b890cb4a15ae6bcf3d342ba53f` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:08.266116 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78665ed-d88a-4d86-af38-8a625dd8f6a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8c291b890cb4a15ae6bcf3d342ba53f)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:08.268294 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78665ed-d88a-4d86-af38-8a625dd8f6a9 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:08.322995 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a78665ed-d88a-4d86-af38-8a625dd8f6a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8c291b890cb4a15ae6bcf3d342ba53f', 'request_id': 'req-a78665ed-d88a-4d86-af38-8a625dd8f6a9'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:08.332048 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a78665ed-d88a-4d86-af38-8a625dd8f6a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8c291b890cb4a15ae6bcf3d342ba53f', 'request_id': 'req-a78665ed-d88a-4d86-af38-8a625dd8f6a9'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:08.338711 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a78665ed-d88a-4d86-af38-8a625dd8f6a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8c291b890cb4a15ae6bcf3d342ba53f', 'request_id': 'req-a78665ed-d88a-4d86-af38-8a625dd8f6a9'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:08.350711 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a78665ed-d88a-4d86-af38-8a625dd8f6a9 admin admin] The token cache is being invalidate because project f8c291b890cb4a15ae6bcf3d342ba53f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:55:08.351001 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a78665ed-d88a-4d86-af38-8a625dd8f6a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:08.351652 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a78665ed-d88a-4d86-af38-8a625dd8f6a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:08.353217 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1337/2675] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:55:08 2022] DELETE /identity/v3/projects/f8c291b890cb4a15ae6bcf3d342ba53f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:08.357614 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64edbbc7-28ce-4ebf-8e32-e8d5fed66c4e service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:08.368860 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64edbbc7-28ce-4ebf-8e32-e8d5fed66c4e service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:08.449556 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed76a3-6d97-4799-858f-099dbecbfec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:08.450231 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed76a3-6d97-4799-858f-099dbecbfec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:08.450509 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed76a3-6d97-4799-858f-099dbecbfec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:08.450786 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed76a3-6d97-4799-858f-099dbecbfec2 admin admin] PATH_INFO: `/v3/users/f83058dcdff04081b41c8f58b67bfa6a` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:08.451990 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed76a3-6d97-4799-858f-099dbecbfec2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f83058dcdff04081b41c8f58b67bfa6a)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:08.453968 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed76a3-6d97-4799-858f-099dbecbfec2 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:08.477822 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:08.506291 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6bed76a3-6d97-4799-858f-099dbecbfec2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f83058dcdff04081b41c8f58b67bfa6a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:08.515558 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6bed76a3-6d97-4799-858f-099dbecbfec2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f83058dcdff04081b41c8f58b67bfa6a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:08.516257 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6bed76a3-6d97-4799-858f-099dbecbfec2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f83058dcdff04081b41c8f58b67bfa6a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:08.531615 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6bed76a3-6d97-4799-858f-099dbecbfec2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f83058dcdff04081b41c8f58b67bfa6a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:08.539635 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6bed76a3-6d97-4799-858f-099dbecbfec2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f83058dcdff04081b41c8f58b67bfa6a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:08.545994 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1339/2676] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:55:08 2022] DELETE /identity/v3/users/f83058dcdff04081b41c8f58b67bfa6a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:08.852366 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78665ed-d88a-4d86-af38-8a625dd8f6a9 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:08.854032 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a78665ed-d88a-4d86-af38-8a625dd8f6a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:08.872654 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78665ed-d88a-4d86-af38-8a625dd8f6a9 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:08.941949 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcf264-424e-418f-9a79-1e231229db40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:08.944078 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcf264-424e-418f-9a79-1e231229db40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:08.944078 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcf264-424e-418f-9a79-1e231229db40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:08.944078 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcf264-424e-418f-9a79-1e231229db40 admin admin] PATH_INFO: `/v3/projects/609092e9d1b5471b81083697355087e1` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:08.944403 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcf264-424e-418f-9a79-1e231229db40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=609092e9d1b5471b81083697355087e1)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:08.946222 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcf264-424e-418f-9a79-1e231229db40 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:09.003123 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-57dcf264-424e-418f-9a79-1e231229db40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '609092e9d1b5471b81083697355087e1', 'request_id': 'req-57dcf264-424e-418f-9a79-1e231229db40'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:09.015053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-57dcf264-424e-418f-9a79-1e231229db40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '609092e9d1b5471b81083697355087e1', 'request_id': 'req-57dcf264-424e-418f-9a79-1e231229db40'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:09.025453 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-57dcf264-424e-418f-9a79-1e231229db40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '609092e9d1b5471b81083697355087e1', 'request_id': 'req-57dcf264-424e-418f-9a79-1e231229db40'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:09.039005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:09.046031 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-57dcf264-424e-418f-9a79-1e231229db40 admin admin] The token cache is being invalidate because project 609092e9d1b5471b81083697355087e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:55:09.046335 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-57dcf264-424e-418f-9a79-1e231229db40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:09.047151 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-57dcf264-424e-418f-9a79-1e231229db40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:09.049004 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1338/2677] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:55:08 2022] DELETE /identity/v3/projects/609092e9d1b5471b81083697355087e1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:09.054225 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53addbc8-0318-44d2-983c-114b1c76034d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:09.054509 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53addbc8-0318-44d2-983c-114b1c76034d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:09.054777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53addbc8-0318-44d2-983c-114b1c76034d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:09.078088 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-53addbc8-0318-44d2-983c-114b1c76034d None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:09.079486 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-53addbc8-0318-44d2-983c-114b1c76034d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:09.146675 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1340/2678] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:09.156645 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211b328-ee74-4bc5-ad88-dd98c88b4427 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:09.156962 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211b328-ee74-4bc5-ad88-dd98c88b4427 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:09.157175 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211b328-ee74-4bc5-ad88-dd98c88b4427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:09.178723 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-b211b328-ee74-4bc5-ad88-dd98c88b4427 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:09.179958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b211b328-ee74-4bc5-ad88-dd98c88b4427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:09.188520 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1339/2679] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:55:09.193496 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53addbc8-0318-44d2-983c-114b1c76034d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:09.204845 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53addbc8-0318-44d2-983c-114b1c76034d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:09.210593 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d59795-fd80-423c-9c91-a723b5aa7a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:09.211214 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d59795-fd80-423c-9c91-a723b5aa7a76 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:09.211489 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d59795-fd80-423c-9c91-a723b5aa7a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:09.211797 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d59795-fd80-423c-9c91-a723b5aa7a76 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:09.212454 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d59795-fd80-423c-9c91-a723b5aa7a76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:55:09.212753 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d59795-fd80-423c-9c91-a723b5aa7a76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:09.214391 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d59795-fd80-423c-9c91-a723b5aa7a76 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:09.228171 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1341/2680] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:55:09.233062 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211b328-ee74-4bc5-ad88-dd98c88b4427 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:09.243923 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211b328-ee74-4bc5-ad88-dd98c88b4427 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:09.249543 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aeef54-6b3c-440c-ac43-2b4981a02277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:09.250154 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aeef54-6b3c-440c-ac43-2b4981a02277 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:09.250424 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aeef54-6b3c-440c-ac43-2b4981a02277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:09.250683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aeef54-6b3c-440c-ac43-2b4981a02277 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:09.251311 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aeef54-6b3c-440c-ac43-2b4981a02277 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:09.253439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aeef54-6b3c-440c-ac43-2b4981a02277 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:09.284658 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1340/2681] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:55:09 2022] POST /identity/v3/projects => generated 393 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:55:09.289139 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d59795-fd80-423c-9c91-a723b5aa7a76 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:09.299962 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d59795-fd80-423c-9c91-a723b5aa7a76 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:09.361947 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ba511-2cdc-4095-944b-4def9fa6f241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:09.362676 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ba511-2cdc-4095-944b-4def9fa6f241 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:09.362807 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ba511-2cdc-4095-944b-4def9fa6f241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:09.363093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ba511-2cdc-4095-944b-4def9fa6f241 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:09.363786 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ba511-2cdc-4095-944b-4def9fa6f241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:09.365786 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70ba511-2cdc-4095-944b-4def9fa6f241 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:09.390984 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1342/2682] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:55:09 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:55:09.395553 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aeef54-6b3c-440c-ac43-2b4981a02277 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:09.406873 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aeef54-6b3c-440c-ac43-2b4981a02277 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:09.412566 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea8b9f-082f-4ca1-8cce-9d9e383c6031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:09.413196 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea8b9f-082f-4ca1-8cce-9d9e383c6031 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:09.413469 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea8b9f-082f-4ca1-8cce-9d9e383c6031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:09.413737 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea8b9f-082f-4ca1-8cce-9d9e383c6031 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:09.414414 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea8b9f-082f-4ca1-8cce-9d9e383c6031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:09.416088 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea8b9f-082f-4ca1-8cce-9d9e383c6031 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:09.427474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1341/2683] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:55:09.432962 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ba511-2cdc-4095-944b-4def9fa6f241 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:09.444448 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ba511-2cdc-4095-944b-4def9fa6f241 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:09.450370 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5bd1c0-093a-450f-a31e-8f6e0adec577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:09.451001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bd1c0-093a-450f-a31e-8f6e0adec577 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:09.451277 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bd1c0-093a-450f-a31e-8f6e0adec577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:09.451539 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5bd1c0-093a-450f-a31e-8f6e0adec577 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:09.452219 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5bd1c0-093a-450f-a31e-8f6e0adec577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:09.453857 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5bd1c0-093a-450f-a31e-8f6e0adec577 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:09.466300 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1343/2684] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:55:09.471062 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea8b9f-082f-4ca1-8cce-9d9e383c6031 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:09.481591 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea8b9f-082f-4ca1-8cce-9d9e383c6031 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:09.486805 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927685c-e113-44c0-9e05-214aaf017693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:09.487538 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927685c-e113-44c0-9e05-214aaf017693 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:09.487876 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927685c-e113-44c0-9e05-214aaf017693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:09.488148 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927685c-e113-44c0-9e05-214aaf017693 admin admin] PATH_INFO: `/v3/projects/292c3eb5534e44c8a48c322f20f6228c/users/f69cd49a14d44ff386ee64ba8ac1fe84/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:09.504915 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927685c-e113-44c0-9e05-214aaf017693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=292c3eb5534e44c8a48c322f20f6228c, user_id=f69cd49a14d44ff386ee64ba8ac1fe84, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:09.507664 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927685c-e113-44c0-9e05-214aaf017693 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:09.523690 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1342/2685] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:55:09 2022] PUT /identity/v3/projects/292c3eb5534e44c8a48c322f20f6228c/users/f69cd49a14d44ff386ee64ba8ac1fe84/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:09.535007 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76e024-3d2b-4a0b-b4e1-610850f432fa None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:09.535211 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76e024-3d2b-4a0b-b4e1-610850f432fa None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:09.535451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76e024-3d2b-4a0b-b4e1-610850f432fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:09.544411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:09.568036 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-8d76e024-3d2b-4a0b-b4e1-610850f432fa None None] MFA Rules not processed for user `f69cd49a14d44ff386ee64ba8ac1fe84`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:09.569257 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8d76e024-3d2b-4a0b-b4e1-610850f432fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:09.640031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1344/2686] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:09 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:09.645009 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927685c-e113-44c0-9e05-214aaf017693 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:09.717846 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927685c-e113-44c0-9e05-214aaf017693 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:09.723152 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf18c5-c2eb-4f1b-b3b1-f892ddd121dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:09.723796 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf18c5-c2eb-4f1b-b3b1-f892ddd121dc admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:09.724090 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf18c5-c2eb-4f1b-b3b1-f892ddd121dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:09.724356 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf18c5-c2eb-4f1b-b3b1-f892ddd121dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:09.725029 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf18c5-c2eb-4f1b-b3b1-f892ddd121dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:09.726945 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf18c5-c2eb-4f1b-b3b1-f892ddd121dc admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:09.758294 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1343/2687] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:55:09 2022] POST /identity/v3/projects => generated 391 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:55:09.762987 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76e024-3d2b-4a0b-b4e1-610850f432fa None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:09.775230 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76e024-3d2b-4a0b-b4e1-610850f432fa None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:09.839529 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cc128-e96d-4e6d-85d4-1fdf05319b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:09.840092 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cc128-e96d-4e6d-85d4-1fdf05319b65 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:09.840393 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cc128-e96d-4e6d-85d4-1fdf05319b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:09.840665 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cc128-e96d-4e6d-85d4-1fdf05319b65 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:09.841303 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361cc128-e96d-4e6d-85d4-1fdf05319b65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:09.843315 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361cc128-e96d-4e6d-85d4-1fdf05319b65 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:09.871081 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1345/2688] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:55:09 2022] POST /identity/v3/users => generated 302 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:55:09.875518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf18c5-c2eb-4f1b-b3b1-f892ddd121dc admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:09.886323 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf18c5-c2eb-4f1b-b3b1-f892ddd121dc admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:09.891143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e202d-d7eb-491d-894f-3a88a51085fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:09.891773 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e202d-d7eb-491d-894f-3a88a51085fd admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:09.892046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e202d-d7eb-491d-894f-3a88a51085fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:09.892313 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e202d-d7eb-491d-894f-3a88a51085fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:09.892959 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e202d-d7eb-491d-894f-3a88a51085fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:09.894591 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e202d-d7eb-491d-894f-3a88a51085fd admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:09.906043 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1344/2689] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:55:09.910635 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cc128-e96d-4e6d-85d4-1fdf05319b65 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:09.921524 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cc128-e96d-4e6d-85d4-1fdf05319b65 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:09.926284 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cdb7de-4c0a-45a5-a9a5-8415c976b60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:09.926955 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdb7de-4c0a-45a5-a9a5-8415c976b60e admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:09.927261 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdb7de-4c0a-45a5-a9a5-8415c976b60e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:09.927497 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdb7de-4c0a-45a5-a9a5-8415c976b60e admin admin] PATH_INFO: `/v3/projects/3990452e68a345ba8dc499ffe2b43f50/users/ab63d736f124406b80d1d6a29c975e8d/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:09.943584 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cdb7de-4c0a-45a5-a9a5-8415c976b60e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3990452e68a345ba8dc499ffe2b43f50, user_id=ab63d736f124406b80d1d6a29c975e8d, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:09.946465 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cdb7de-4c0a-45a5-a9a5-8415c976b60e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:09.963511 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1346/2690] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:55:09 2022] PUT /identity/v3/projects/3990452e68a345ba8dc499ffe2b43f50/users/ab63d736f124406b80d1d6a29c975e8d/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:09.967670 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e202d-d7eb-491d-894f-3a88a51085fd admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:09.978519 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e202d-d7eb-491d-894f-3a88a51085fd admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:10.054020 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53d9dc-17c0-42d4-bd22-a75259363298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:10.054641 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53d9dc-17c0-42d4-bd22-a75259363298 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:10.054905 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53d9dc-17c0-42d4-bd22-a75259363298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:10.055165 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53d9dc-17c0-42d4-bd22-a75259363298 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:10.055865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53d9dc-17c0-42d4-bd22-a75259363298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:10.057510 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53d9dc-17c0-42d4-bd22-a75259363298 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:10.068652 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1345/2691] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:55:10.073154 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cdb7de-4c0a-45a5-a9a5-8415c976b60e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:10.084153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cdb7de-4c0a-45a5-a9a5-8415c976b60e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:10.089246 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24470e0c-484f-49a1-af50-87fb527dc048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:10.090205 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24470e0c-484f-49a1-af50-87fb527dc048 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:10.090587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24470e0c-484f-49a1-af50-87fb527dc048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:10.090900 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24470e0c-484f-49a1-af50-87fb527dc048 admin admin] PATH_INFO: `/v3/projects/3990452e68a345ba8dc499ffe2b43f50/users/ab63d736f124406b80d1d6a29c975e8d/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:10.093074 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24470e0c-484f-49a1-af50-87fb527dc048 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3990452e68a345ba8dc499ffe2b43f50, user_id=ab63d736f124406b80d1d6a29c975e8d, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:10.095851 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24470e0c-484f-49a1-af50-87fb527dc048 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:10.107559 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1347/2692] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:55:10 2022] PUT /identity/v3/projects/3990452e68a345ba8dc499ffe2b43f50/users/ab63d736f124406b80d1d6a29c975e8d/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:10.119559 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caec13f-bdcf-4a7d-8bd0-82fc889f7bce None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:10.120311 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caec13f-bdcf-4a7d-8bd0-82fc889f7bce None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:10.120311 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caec13f-bdcf-4a7d-8bd0-82fc889f7bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:10.134939 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:10.151967 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-4caec13f-bdcf-4a7d-8bd0-82fc889f7bce None None] MFA Rules not processed for user `ab63d736f124406b80d1d6a29c975e8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:10.153617 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4caec13f-bdcf-4a7d-8bd0-82fc889f7bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:10.226337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1346/2693] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:10 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:10.239526 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24470e0c-484f-49a1-af50-87fb527dc048 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:10.241426 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-24470e0c-484f-49a1-af50-87fb527dc048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:10.303339 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:10.309529 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24470e0c-484f-49a1-af50-87fb527dc048 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:10.313656 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd050f-40d6-4ae2-81c3-6a9eb9a3fc66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:10.314266 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd050f-40d6-4ae2-81c3-6a9eb9a3fc66 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:10.314545 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd050f-40d6-4ae2-81c3-6a9eb9a3fc66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:10.314800 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd050f-40d6-4ae2-81c3-6a9eb9a3fc66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:10.324883 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd050f-40d6-4ae2-81c3-6a9eb9a3fc66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:10.326326 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd050f-40d6-4ae2-81c3-6a9eb9a3fc66 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:10.336657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1348/2694] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:55:10 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:55:10.387770 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caec13f-bdcf-4a7d-8bd0-82fc889f7bce None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:10.389321 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4caec13f-bdcf-4a7d-8bd0-82fc889f7bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:10.401951 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caec13f-bdcf-4a7d-8bd0-82fc889f7bce None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:10.405939 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca8af16-ebf5-4f3e-b374-7df150f8d93b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:10.406547 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8af16-ebf5-4f3e-b374-7df150f8d93b service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:10.406810 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8af16-ebf5-4f3e-b374-7df150f8d93b service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:10.407078 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8af16-ebf5-4f3e-b374-7df150f8d93b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:10.478904 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca8af16-ebf5-4f3e-b374-7df150f8d93b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:10.480373 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca8af16-ebf5-4f3e-b374-7df150f8d93b service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:10.490077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1347/2695] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:55:10 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:55:13.922466 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd050f-40d6-4ae2-81c3-6a9eb9a3fc66 service cinder] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:13.988176 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd050f-40d6-4ae2-81c3-6a9eb9a3fc66 service cinder] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:13.993720 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a4250-b806-4881-8dbb-fb95f015d381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:13.994371 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a4250-b806-4881-8dbb-fb95f015d381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:13.994646 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a4250-b806-4881-8dbb-fb95f015d381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:13.994912 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a4250-b806-4881-8dbb-fb95f015d381 admin admin] PATH_INFO: `/v3/users/f69cd49a14d44ff386ee64ba8ac1fe84` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:13.996115 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a4250-b806-4881-8dbb-fb95f015d381 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f69cd49a14d44ff386ee64ba8ac1fe84)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:13.998159 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a4250-b806-4881-8dbb-fb95f015d381 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:14.054993 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-810a4250-b806-4881-8dbb-fb95f015d381 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f69cd49a14d44ff386ee64ba8ac1fe84'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:14.063962 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-810a4250-b806-4881-8dbb-fb95f015d381 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f69cd49a14d44ff386ee64ba8ac1fe84'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:14.064630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-810a4250-b806-4881-8dbb-fb95f015d381 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f69cd49a14d44ff386ee64ba8ac1fe84'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:14.077707 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-810a4250-b806-4881-8dbb-fb95f015d381 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f69cd49a14d44ff386ee64ba8ac1fe84'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:14.085766 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-810a4250-b806-4881-8dbb-fb95f015d381 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f69cd49a14d44ff386ee64ba8ac1fe84'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:14.092225 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1349/2696] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:55:13 2022] DELETE /identity/v3/users/f69cd49a14d44ff386ee64ba8ac1fe84 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:14.097144 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326f74b-a6a7-418c-817c-a4d41c1cc94e None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:14.097669 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326f74b-a6a7-418c-817c-a4d41c1cc94e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:14.097779 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326f74b-a6a7-418c-817c-a4d41c1cc94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:14.117898 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-8326f74b-a6a7-418c-817c-a4d41c1cc94e None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:14.119196 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-8326f74b-a6a7-418c-817c-a4d41c1cc94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:14.182453 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1348/2697] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:14.193418 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a4250-b806-4881-8dbb-fb95f015d381 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:14.195240 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-810a4250-b806-4881-8dbb-fb95f015d381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:14.268306 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a4250-b806-4881-8dbb-fb95f015d381 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:14.272033 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5d186-9633-47c6-957e-567a3a3524f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:14.272654 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5d186-9633-47c6-957e-567a3a3524f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:14.272925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5d186-9633-47c6-957e-567a3a3524f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:14.273190 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5d186-9633-47c6-957e-567a3a3524f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:14.283550 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5d186-9633-47c6-957e-567a3a3524f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:14.285415 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5d186-9633-47c6-957e-567a3a3524f8 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:14.297126 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1350/2698] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:55:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:55:14.872902 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326f74b-a6a7-418c-817c-a4d41c1cc94e None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:14.874956 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-8326f74b-a6a7-418c-817c-a4d41c1cc94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:14.893569 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8326f74b-a6a7-418c-817c-a4d41c1cc94e None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:14.902914 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4969c0c-1da0-45ac-afb7-f7bee5afb1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:14.904495 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4969c0c-1da0-45ac-afb7-f7bee5afb1ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:14.905063 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4969c0c-1da0-45ac-afb7-f7bee5afb1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:14.905601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4969c0c-1da0-45ac-afb7-f7bee5afb1ad admin admin] PATH_INFO: `/v3/projects/292c3eb5534e44c8a48c322f20f6228c` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:14.907716 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4969c0c-1da0-45ac-afb7-f7bee5afb1ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=292c3eb5534e44c8a48c322f20f6228c)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:14.911665 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4969c0c-1da0-45ac-afb7-f7bee5afb1ad admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:14.966634 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:14.981306 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5d186-9633-47c6-957e-567a3a3524f8 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:14.982820 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-26b5d186-9633-47c6-957e-567a3a3524f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:14.990571 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d4969c0c-1da0-45ac-afb7-f7bee5afb1ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '292c3eb5534e44c8a48c322f20f6228c', 'request_id': 'req-d4969c0c-1da0-45ac-afb7-f7bee5afb1ad'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:14.997458 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5d186-9633-47c6-957e-567a3a3524f8 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:15.005715 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d4969c0c-1da0-45ac-afb7-f7bee5afb1ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '292c3eb5534e44c8a48c322f20f6228c', 'request_id': 'req-d4969c0c-1da0-45ac-afb7-f7bee5afb1ad'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:15.016240 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d4969c0c-1da0-45ac-afb7-f7bee5afb1ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '292c3eb5534e44c8a48c322f20f6228c', 'request_id': 'req-d4969c0c-1da0-45ac-afb7-f7bee5afb1ad'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:15.018154 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:15.044810 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d4969c0c-1da0-45ac-afb7-f7bee5afb1ad admin admin] The token cache is being invalidate because project 292c3eb5534e44c8a48c322f20f6228c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:55:15.045040 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d4969c0c-1da0-45ac-afb7-f7bee5afb1ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:15.045676 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-d4969c0c-1da0-45ac-afb7-f7bee5afb1ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:15.051361 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1349/2699] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:55:14 2022] DELETE /identity/v3/projects/292c3eb5534e44c8a48c322f20f6228c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:15.052911 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4969c0c-1da0-45ac-afb7-f7bee5afb1ad admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:15.054521 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d4969c0c-1da0-45ac-afb7-f7bee5afb1ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:15.190456 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4969c0c-1da0-45ac-afb7-f7bee5afb1ad admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:15.197972 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc7fa7-fcc7-459c-be7b-a3caa6fe42bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:15.199163 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc7fa7-fcc7-459c-be7b-a3caa6fe42bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:15.201658 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc7fa7-fcc7-459c-be7b-a3caa6fe42bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:15.202222 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc7fa7-fcc7-459c-be7b-a3caa6fe42bc admin admin] PATH_INFO: `/v3/users/ab63d736f124406b80d1d6a29c975e8d` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:15.204278 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc7fa7-fcc7-459c-be7b-a3caa6fe42bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab63d736f124406b80d1d6a29c975e8d)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:15.206967 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc7fa7-fcc7-459c-be7b-a3caa6fe42bc admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:15.263760 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226730a-706c-4df1-8dbd-5c71240924fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:15.263970 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226730a-706c-4df1-8dbd-5c71240924fc service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:15.264213 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226730a-706c-4df1-8dbd-5c71240924fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:15.264537 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226730a-706c-4df1-8dbd-5c71240924fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:15.269179 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f226730a-706c-4df1-8dbd-5c71240924fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:15.282111 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226730a-706c-4df1-8dbd-5c71240924fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:15.283782 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226730a-706c-4df1-8dbd-5c71240924fc service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:15.288179 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-95bc7fa7-fcc7-459c-be7b-a3caa6fe42bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab63d736f124406b80d1d6a29c975e8d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:15.292989 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1351/2700] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:55:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:55:15.298889 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-95bc7fa7-fcc7-459c-be7b-a3caa6fe42bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab63d736f124406b80d1d6a29c975e8d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:15.316776 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-95bc7fa7-fcc7-459c-be7b-a3caa6fe42bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab63d736f124406b80d1d6a29c975e8d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:15.317552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-95bc7fa7-fcc7-459c-be7b-a3caa6fe42bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab63d736f124406b80d1d6a29c975e8d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:15.325888 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-95bc7fa7-fcc7-459c-be7b-a3caa6fe42bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab63d736f124406b80d1d6a29c975e8d'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:15.333654 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1350/2701] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:55:15 2022] DELETE /identity/v3/users/ab63d736f124406b80d1d6a29c975e8d => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:15.916725 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226730a-706c-4df1-8dbd-5c71240924fc service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:15.929220 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226730a-706c-4df1-8dbd-5c71240924fc service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:16.029524 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a4f86-fceb-4228-b112-3fe33d3ad7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:16.030191 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a4f86-fceb-4228-b112-3fe33d3ad7d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:16.030690 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a4f86-fceb-4228-b112-3fe33d3ad7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:16.030828 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a4f86-fceb-4228-b112-3fe33d3ad7d4 admin admin] PATH_INFO: `/v3/projects/3990452e68a345ba8dc499ffe2b43f50` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:16.033048 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a4f86-fceb-4228-b112-3fe33d3ad7d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3990452e68a345ba8dc499ffe2b43f50)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:16.041573 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a4f86-fceb-4228-b112-3fe33d3ad7d4 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:16.098941 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e36a4f86-fceb-4228-b112-3fe33d3ad7d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3990452e68a345ba8dc499ffe2b43f50', 'request_id': 'req-e36a4f86-fceb-4228-b112-3fe33d3ad7d4'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:16.105286 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e36a4f86-fceb-4228-b112-3fe33d3ad7d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3990452e68a345ba8dc499ffe2b43f50', 'request_id': 'req-e36a4f86-fceb-4228-b112-3fe33d3ad7d4'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:16.112681 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e36a4f86-fceb-4228-b112-3fe33d3ad7d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3990452e68a345ba8dc499ffe2b43f50', 'request_id': 'req-e36a4f86-fceb-4228-b112-3fe33d3ad7d4'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:16.131697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e36a4f86-fceb-4228-b112-3fe33d3ad7d4 admin admin] The token cache is being invalidate because project 3990452e68a345ba8dc499ffe2b43f50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:55:16.132015 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e36a4f86-fceb-4228-b112-3fe33d3ad7d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:16.132635 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e36a4f86-fceb-4228-b112-3fe33d3ad7d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:16.137605 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1352/2702] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:55:15 2022] DELETE /identity/v3/projects/3990452e68a345ba8dc499ffe2b43f50 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:16.139844 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06389a9-1d17-4996-afca-4df5199ff946 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:16.140134 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06389a9-1d17-4996-afca-4df5199ff946 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:16.140477 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06389a9-1d17-4996-afca-4df5199ff946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:16.162727 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-a06389a9-1d17-4996-afca-4df5199ff946 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:16.164119 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a06389a9-1d17-4996-afca-4df5199ff946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:16.197149 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:16.242405 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1351/2703] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:16.250647 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366b2b1-610d-4c02-8b4b-080860c873a6 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:16.251289 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366b2b1-610d-4c02-8b4b-080860c873a6 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:16.251693 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366b2b1-610d-4c02-8b4b-080860c873a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:16.274059 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-6366b2b1-610d-4c02-8b4b-080860c873a6 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:16.293163 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6366b2b1-610d-4c02-8b4b-080860c873a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:16.305627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1353/2704] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:16.310193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06389a9-1d17-4996-afca-4df5199ff946 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:16.322534 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06389a9-1d17-4996-afca-4df5199ff946 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:16.328265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b233a-cf93-41c5-ae39-0e68bdbbc75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:16.328952 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b233a-cf93-41c5-ae39-0e68bdbbc75e admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:16.329224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b233a-cf93-41c5-ae39-0e68bdbbc75e admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:16.329491 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b233a-cf93-41c5-ae39-0e68bdbbc75e admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:16.330149 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b233a-cf93-41c5-ae39-0e68bdbbc75e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:55:16.330447 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b233a-cf93-41c5-ae39-0e68bdbbc75e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:16.332526 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b233a-cf93-41c5-ae39-0e68bdbbc75e admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:16.345820 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1352/2705] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 26 05:55:16.350471 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366b2b1-610d-4c02-8b4b-080860c873a6 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:16.360917 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366b2b1-610d-4c02-8b4b-080860c873a6 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:16.365869 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856d114-02a6-410d-95c7-019bd7e55f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:16.366556 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856d114-02a6-410d-95c7-019bd7e55f3e admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:16.366888 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856d114-02a6-410d-95c7-019bd7e55f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:16.367417 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856d114-02a6-410d-95c7-019bd7e55f3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:16.368656 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856d114-02a6-410d-95c7-019bd7e55f3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:16.370092 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856d114-02a6-410d-95c7-019bd7e55f3e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:16.399288 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1354/2706] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:55:16 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:55:16.404243 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b233a-cf93-41c5-ae39-0e68bdbbc75e admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:16.415087 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b233a-cf93-41c5-ae39-0e68bdbbc75e admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:16.486549 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fcbbd9-ac41-4408-97ee-14d6e828b60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:16.487388 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcbbd9-ac41-4408-97ee-14d6e828b60d admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:16.487668 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcbbd9-ac41-4408-97ee-14d6e828b60d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:16.487976 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcbbd9-ac41-4408-97ee-14d6e828b60d admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:16.491056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fcbbd9-ac41-4408-97ee-14d6e828b60d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:16.491056 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fcbbd9-ac41-4408-97ee-14d6e828b60d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:16.515806 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1353/2707] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:55:16 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:55:16.520228 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856d114-02a6-410d-95c7-019bd7e55f3e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:16.531789 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856d114-02a6-410d-95c7-019bd7e55f3e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:16.537527 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ce985-31b9-46d1-b801-ac77ec08023f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:16.538307 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ce985-31b9-46d1-b801-ac77ec08023f admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:16.538584 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ce985-31b9-46d1-b801-ac77ec08023f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:16.538981 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ce985-31b9-46d1-b801-ac77ec08023f admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:16.539640 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ce985-31b9-46d1-b801-ac77ec08023f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:16.541304 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ce985-31b9-46d1-b801-ac77ec08023f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:16.552544 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1355/2708] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:55:16.556998 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fcbbd9-ac41-4408-97ee-14d6e828b60d admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:16.568894 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fcbbd9-ac41-4408-97ee-14d6e828b60d admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:16.573981 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b0cf7d-fcda-4bb4-a186-de3d26385854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:16.574725 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0cf7d-fcda-4bb4-a186-de3d26385854 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:16.575009 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0cf7d-fcda-4bb4-a186-de3d26385854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:16.575285 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0cf7d-fcda-4bb4-a186-de3d26385854 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:16.575973 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b0cf7d-fcda-4bb4-a186-de3d26385854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:16.578253 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b0cf7d-fcda-4bb4-a186-de3d26385854 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:16.590157 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1354/2709] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:55:16.594557 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ce985-31b9-46d1-b801-ac77ec08023f admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:16.602773 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:16.609746 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ce985-31b9-46d1-b801-ac77ec08023f admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:16.619054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91051a5-f3c3-425c-a719-ee16eb823f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:16.619775 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91051a5-f3c3-425c-a719-ee16eb823f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:16.620341 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91051a5-f3c3-425c-a719-ee16eb823f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:16.621133 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91051a5-f3c3-425c-a719-ee16eb823f21 admin admin] PATH_INFO: `/v3/projects/2da8b62bcd0b4b938eddc21771a79491/users/2ad09ca49d93402cafeba48ca230a9c3/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:16.642882 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91051a5-f3c3-425c-a719-ee16eb823f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2da8b62bcd0b4b938eddc21771a79491, user_id=2ad09ca49d93402cafeba48ca230a9c3, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:16.645504 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91051a5-f3c3-425c-a719-ee16eb823f21 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:16.663176 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1356/2710] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:55:16 2022] PUT /identity/v3/projects/2da8b62bcd0b4b938eddc21771a79491/users/2ad09ca49d93402cafeba48ca230a9c3/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:16.676718 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c98b3-b32a-4e6a-b48a-399b8dbeba9d None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:16.677464 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c98b3-b32a-4e6a-b48a-399b8dbeba9d None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:16.677785 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c98b3-b32a-4e6a-b48a-399b8dbeba9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:16.721263 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-ac1c98b3-b32a-4e6a-b48a-399b8dbeba9d None None] MFA Rules not processed for user `2ad09ca49d93402cafeba48ca230a9c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:16.722502 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ac1c98b3-b32a-4e6a-b48a-399b8dbeba9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:16.793567 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1355/2711] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:16.799268 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91051a5-f3c3-425c-a719-ee16eb823f21 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:16.868904 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91051a5-f3c3-425c-a719-ee16eb823f21 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:16.874232 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1a32f-04a9-4350-9f78-b4b04f6a4b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:16.875230 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1a32f-04a9-4350-9f78-b4b04f6a4b0d admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:16.875230 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1a32f-04a9-4350-9f78-b4b04f6a4b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:16.875430 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1a32f-04a9-4350-9f78-b4b04f6a4b0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:16.876123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1a32f-04a9-4350-9f78-b4b04f6a4b0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:16.878066 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1a32f-04a9-4350-9f78-b4b04f6a4b0d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:16.913467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c98b3-b32a-4e6a-b48a-399b8dbeba9d None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:16.915249 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1357/2712] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:55:16 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:55:16.926371 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c98b3-b32a-4e6a-b48a-399b8dbeba9d None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:16.959602 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:16.996539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c29c1b-dc1d-41c0-be96-60cb1155a82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:16.997170 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c29c1b-dc1d-41c0-be96-60cb1155a82a admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:16.997446 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c29c1b-dc1d-41c0-be96-60cb1155a82a admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:16.997717 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c29c1b-dc1d-41c0-be96-60cb1155a82a admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:17.008026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c29c1b-dc1d-41c0-be96-60cb1155a82a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:17.010624 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c29c1b-dc1d-41c0-be96-60cb1155a82a admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:17.050048 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1356/2713] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:55:16 2022] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:55:17.053913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1a32f-04a9-4350-9f78-b4b04f6a4b0d admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:17.070383 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1a32f-04a9-4350-9f78-b4b04f6a4b0d admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:17.085976 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae653916-9087-40d5-b1a5-5ca506ab6067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:17.086799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae653916-9087-40d5-b1a5-5ca506ab6067 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:17.087172 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae653916-9087-40d5-b1a5-5ca506ab6067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:17.087697 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae653916-9087-40d5-b1a5-5ca506ab6067 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:17.088467 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae653916-9087-40d5-b1a5-5ca506ab6067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:17.093040 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae653916-9087-40d5-b1a5-5ca506ab6067 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:17.104654 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1358/2714] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:55:17.108861 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c29c1b-dc1d-41c0-be96-60cb1155a82a admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:17.120192 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c29c1b-dc1d-41c0-be96-60cb1155a82a admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:17.125429 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b686d6-19fa-4ec1-9a90-0cf18f0f4680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:17.126050 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b686d6-19fa-4ec1-9a90-0cf18f0f4680 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:17.126319 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b686d6-19fa-4ec1-9a90-0cf18f0f4680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:17.126586 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b686d6-19fa-4ec1-9a90-0cf18f0f4680 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:17.127250 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b686d6-19fa-4ec1-9a90-0cf18f0f4680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:17.128884 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b686d6-19fa-4ec1-9a90-0cf18f0f4680 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:17.143137 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1357/2715] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:55:17.144347 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae653916-9087-40d5-b1a5-5ca506ab6067 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:17.166060 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae653916-9087-40d5-b1a5-5ca506ab6067 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:17.170482 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91a986-a1e0-4735-9b1a-07b960a1f63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:17.171155 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91a986-a1e0-4735-9b1a-07b960a1f63f admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:17.171428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91a986-a1e0-4735-9b1a-07b960a1f63f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:17.171699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91a986-a1e0-4735-9b1a-07b960a1f63f admin admin] PATH_INFO: `/v3/projects/720543a4d91349cd991d2ca0a8707029/users/a52b3881277c49ba90deaa41335fc982/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:17.188708 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d91a986-a1e0-4735-9b1a-07b960a1f63f admin admin] RBAC: Authorizing `identity:create_grant(project_id=720543a4d91349cd991d2ca0a8707029, user_id=a52b3881277c49ba90deaa41335fc982, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:17.191900 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d91a986-a1e0-4735-9b1a-07b960a1f63f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:17.206626 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1359/2716] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:55:17 2022] PUT /identity/v3/projects/720543a4d91349cd991d2ca0a8707029/users/a52b3881277c49ba90deaa41335fc982/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:17.216899 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbdd1a-1cd7-45c2-a56f-0d1bf99c426f None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:17.217429 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbdd1a-1cd7-45c2-a56f-0d1bf99c426f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:17.217765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbdd1a-1cd7-45c2-a56f-0d1bf99c426f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:17.246469 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-8acbdd1a-1cd7-45c2-a56f-0d1bf99c426f None None] MFA Rules not processed for user `a52b3881277c49ba90deaa41335fc982`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:17.247698 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-8acbdd1a-1cd7-45c2-a56f-0d1bf99c426f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:17.326998 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1358/2717] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:17.332561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91a986-a1e0-4735-9b1a-07b960a1f63f admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:17.412056 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91a986-a1e0-4735-9b1a-07b960a1f63f admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:17.416733 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a363d82-95cd-4f5d-b93d-616213f39e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:17.417335 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a363d82-95cd-4f5d-b93d-616213f39e62 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:17.417626 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a363d82-95cd-4f5d-b93d-616213f39e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:17.417897 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a363d82-95cd-4f5d-b93d-616213f39e62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:17.418529 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a363d82-95cd-4f5d-b93d-616213f39e62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:17.420462 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a363d82-95cd-4f5d-b93d-616213f39e62 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:17.451608 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1360/2718] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:55:17 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:55:17.455702 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbdd1a-1cd7-45c2-a56f-0d1bf99c426f None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:17.474506 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbdd1a-1cd7-45c2-a56f-0d1bf99c426f None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:17.540199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43a7e0-9287-4629-bb01-d7ef98ac2446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:17.540838 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43a7e0-9287-4629-bb01-d7ef98ac2446 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:17.541104 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43a7e0-9287-4629-bb01-d7ef98ac2446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:17.541372 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43a7e0-9287-4629-bb01-d7ef98ac2446 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:17.542012 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43a7e0-9287-4629-bb01-d7ef98ac2446 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:17.543936 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43a7e0-9287-4629-bb01-d7ef98ac2446 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:17.567452 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1359/2719] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:55:17 2022] POST /identity/v3/users => generated 296 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:55:17.572173 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a363d82-95cd-4f5d-b93d-616213f39e62 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:17.582913 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a363d82-95cd-4f5d-b93d-616213f39e62 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:17.587631 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11afc4f-40e6-4abc-ad39-48906cab7b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:17.588268 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11afc4f-40e6-4abc-ad39-48906cab7b9d admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:17.588556 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11afc4f-40e6-4abc-ad39-48906cab7b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:17.588824 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11afc4f-40e6-4abc-ad39-48906cab7b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:17.589456 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11afc4f-40e6-4abc-ad39-48906cab7b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:17.591061 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11afc4f-40e6-4abc-ad39-48906cab7b9d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:17.601406 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1361/2720] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:55:17.606488 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43a7e0-9287-4629-bb01-d7ef98ac2446 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:17.619481 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43a7e0-9287-4629-bb01-d7ef98ac2446 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:17.624616 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ad5ed-a530-484d-ad44-0271f204e6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:17.625335 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ad5ed-a530-484d-ad44-0271f204e6b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:17.625602 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ad5ed-a530-484d-ad44-0271f204e6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:17.625884 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ad5ed-a530-484d-ad44-0271f204e6b1 admin admin] PATH_INFO: `/v3/projects/08791bc7ecae4729b618f096f904077d/users/9e995bf72bb24dabafa3c4aa57e098fd/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:17.642089 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ad5ed-a530-484d-ad44-0271f204e6b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08791bc7ecae4729b618f096f904077d, user_id=9e995bf72bb24dabafa3c4aa57e098fd, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:17.644868 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ad5ed-a530-484d-ad44-0271f204e6b1 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:17.660291 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1360/2721] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:55:17 2022] PUT /identity/v3/projects/08791bc7ecae4729b618f096f904077d/users/9e995bf72bb24dabafa3c4aa57e098fd/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:17.664605 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11afc4f-40e6-4abc-ad39-48906cab7b9d admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:17.671303 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:17.676175 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11afc4f-40e6-4abc-ad39-48906cab7b9d admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:17.744474 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16afa95d-e353-4325-aa18-d877ff00bfdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:17.745098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afa95d-e353-4325-aa18-d877ff00bfdf admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:17.745373 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afa95d-e353-4325-aa18-d877ff00bfdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:17.745641 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afa95d-e353-4325-aa18-d877ff00bfdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:17.746284 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16afa95d-e353-4325-aa18-d877ff00bfdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:17.747945 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16afa95d-e353-4325-aa18-d877ff00bfdf admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:17.758663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1362/2722] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:17 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:55:17.763224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ad5ed-a530-484d-ad44-0271f204e6b1 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:17.770635 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:17.777818 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ad5ed-a530-484d-ad44-0271f204e6b1 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:17.784346 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e8e82-b601-422e-90ce-85d2e1c5f631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:17.785019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e8e82-b601-422e-90ce-85d2e1c5f631 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:17.785292 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e8e82-b601-422e-90ce-85d2e1c5f631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:17.785557 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e8e82-b601-422e-90ce-85d2e1c5f631 admin admin] PATH_INFO: `/v3/projects/08791bc7ecae4729b618f096f904077d/users/9e995bf72bb24dabafa3c4aa57e098fd/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:17.787520 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e8e82-b601-422e-90ce-85d2e1c5f631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08791bc7ecae4729b618f096f904077d, user_id=9e995bf72bb24dabafa3c4aa57e098fd, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:17.790199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e8e82-b601-422e-90ce-85d2e1c5f631 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:17.802195 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1361/2723] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:55:17 2022] PUT /identity/v3/projects/08791bc7ecae4729b618f096f904077d/users/9e995bf72bb24dabafa3c4aa57e098fd/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:17.812627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ea18f-ba4e-45df-a559-76b4d459f0cb None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:17.812911 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ea18f-ba4e-45df-a559-76b4d459f0cb None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:17.813186 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ea18f-ba4e-45df-a559-76b4d459f0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:17.843396 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-d61ea18f-ba4e-45df-a559-76b4d459f0cb None None] MFA Rules not processed for user `9e995bf72bb24dabafa3c4aa57e098fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:17.844663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d61ea18f-ba4e-45df-a559-76b4d459f0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:17.915688 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1363/2724] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:17.933956 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e8e82-b601-422e-90ce-85d2e1c5f631 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:17.935856 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5e3e8e82-b601-422e-90ce-85d2e1c5f631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:18.001752 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e8e82-b601-422e-90ce-85d2e1c5f631 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:18.006129 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78813a2c-d5c1-4284-b32f-e4914f1237ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:18.006909 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78813a2c-d5c1-4284-b32f-e4914f1237ac service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:18.007283 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78813a2c-d5c1-4284-b32f-e4914f1237ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:18.007651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78813a2c-d5c1-4284-b32f-e4914f1237ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:18.018032 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78813a2c-d5c1-4284-b32f-e4914f1237ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:18.019521 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78813a2c-d5c1-4284-b32f-e4914f1237ac service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:18.032728 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1362/2725] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:55:17 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:55:18.078252 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ea18f-ba4e-45df-a559-76b4d459f0cb None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:18.079997 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d61ea18f-ba4e-45df-a559-76b4d459f0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:18.093251 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ea18f-ba4e-45df-a559-76b4d459f0cb None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:18.097067 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15b2f9-22a7-40cf-a4dc-7ef37d117658 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:18.097665 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15b2f9-22a7-40cf-a4dc-7ef37d117658 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:18.097939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15b2f9-22a7-40cf-a4dc-7ef37d117658 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:18.098205 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15b2f9-22a7-40cf-a4dc-7ef37d117658 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:18.165840 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15b2f9-22a7-40cf-a4dc-7ef37d117658 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:18.167199 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15b2f9-22a7-40cf-a4dc-7ef37d117658 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:18.177495 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1364/2726] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:55:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:55:21.137451 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78813a2c-d5c1-4284-b32f-e4914f1237ac service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:21.217353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78813a2c-d5c1-4284-b32f-e4914f1237ac service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:21.222631 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e5075-ea16-48a8-966c-766c6a5105d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:21.223262 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e5075-ea16-48a8-966c-766c6a5105d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:21.223626 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e5075-ea16-48a8-966c-766c6a5105d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:21.223894 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e5075-ea16-48a8-966c-766c6a5105d8 admin admin] PATH_INFO: `/v3/users/2ad09ca49d93402cafeba48ca230a9c3` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:21.225479 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e5075-ea16-48a8-966c-766c6a5105d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ad09ca49d93402cafeba48ca230a9c3)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:21.227010 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e5075-ea16-48a8-966c-766c6a5105d8 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:21.279205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-ba8e5075-ea16-48a8-966c-766c6a5105d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ad09ca49d93402cafeba48ca230a9c3'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:21.290701 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-ba8e5075-ea16-48a8-966c-766c6a5105d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ad09ca49d93402cafeba48ca230a9c3'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:21.306312 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-ba8e5075-ea16-48a8-966c-766c6a5105d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ad09ca49d93402cafeba48ca230a9c3'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:21.307182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-ba8e5075-ea16-48a8-966c-766c6a5105d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ad09ca49d93402cafeba48ca230a9c3'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:21.314680 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-ba8e5075-ea16-48a8-966c-766c6a5105d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ad09ca49d93402cafeba48ca230a9c3'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:21.320881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1363/2727] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:55:21 2022] DELETE /identity/v3/users/2ad09ca49d93402cafeba48ca230a9c3 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:55:21.325452 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa333dee-8bda-463e-96c7-ea5f3bb1194e None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:21.325939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa333dee-8bda-463e-96c7-ea5f3bb1194e None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:21.326065 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa333dee-8bda-463e-96c7-ea5f3bb1194e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:21.346281 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-aa333dee-8bda-463e-96c7-ea5f3bb1194e None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:21.347551 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-aa333dee-8bda-463e-96c7-ea5f3bb1194e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:21.366636 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:21.408894 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1365/2728] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:21.419129 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e5075-ea16-48a8-966c-766c6a5105d8 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:21.420765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ba8e5075-ea16-48a8-966c-766c6a5105d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:21.437749 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:21.524948 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e5075-ea16-48a8-966c-766c6a5105d8 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:21.530016 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b1ffe-bf92-490f-baa1-a52a0132b913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:21.530774 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b1ffe-bf92-490f-baa1-a52a0132b913 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:21.531169 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b1ffe-bf92-490f-baa1-a52a0132b913 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:21.531507 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347b1ffe-bf92-490f-baa1-a52a0132b913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:21.542456 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b1ffe-bf92-490f-baa1-a52a0132b913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:21.543929 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347b1ffe-bf92-490f-baa1-a52a0132b913 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:21.571836 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1364/2729] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:55:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:55:21.972916 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa333dee-8bda-463e-96c7-ea5f3bb1194e None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:21.974746 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-aa333dee-8bda-463e-96c7-ea5f3bb1194e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:21.990770 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa333dee-8bda-463e-96c7-ea5f3bb1194e None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:21.998484 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a703e-583b-4e8f-b723-a19f476a1bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:21.999368 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a703e-583b-4e8f-b723-a19f476a1bb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:21.999768 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a703e-583b-4e8f-b723-a19f476a1bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:22.000251 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a703e-583b-4e8f-b723-a19f476a1bb1 admin admin] PATH_INFO: `/v3/projects/2da8b62bcd0b4b938eddc21771a79491` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:22.001559 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a703e-583b-4e8f-b723-a19f476a1bb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2da8b62bcd0b4b938eddc21771a79491)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:22.003583 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a703e-583b-4e8f-b723-a19f476a1bb1 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:22.099146 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-bd3a703e-583b-4e8f-b723-a19f476a1bb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2da8b62bcd0b4b938eddc21771a79491', 'request_id': 'req-bd3a703e-583b-4e8f-b723-a19f476a1bb1'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:22.106382 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-bd3a703e-583b-4e8f-b723-a19f476a1bb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2da8b62bcd0b4b938eddc21771a79491', 'request_id': 'req-bd3a703e-583b-4e8f-b723-a19f476a1bb1'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:22.114273 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-bd3a703e-583b-4e8f-b723-a19f476a1bb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2da8b62bcd0b4b938eddc21771a79491', 'request_id': 'req-bd3a703e-583b-4e8f-b723-a19f476a1bb1'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:22.136313 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-bd3a703e-583b-4e8f-b723-a19f476a1bb1 admin admin] The token cache is being invalidate because project 2da8b62bcd0b4b938eddc21771a79491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:55:22.136784 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-bd3a703e-583b-4e8f-b723-a19f476a1bb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:22.137978 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-bd3a703e-583b-4e8f-b723-a19f476a1bb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:22.140871 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1366/2730] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:55:21 2022] DELETE /identity/v3/projects/2da8b62bcd0b4b938eddc21771a79491 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:22.147493 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b1ffe-bf92-490f-baa1-a52a0132b913 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:22.159609 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347b1ffe-bf92-490f-baa1-a52a0132b913 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:22.226226 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a754222-51fb-4db6-9ef3-7def380aa52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:22.227057 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a754222-51fb-4db6-9ef3-7def380aa52c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:22.227416 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a754222-51fb-4db6-9ef3-7def380aa52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:22.227790 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a754222-51fb-4db6-9ef3-7def380aa52c admin admin] PATH_INFO: `/v3/users/a52b3881277c49ba90deaa41335fc982` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:22.229433 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a754222-51fb-4db6-9ef3-7def380aa52c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a52b3881277c49ba90deaa41335fc982)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:22.231359 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a754222-51fb-4db6-9ef3-7def380aa52c admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:22.285744 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3a754222-51fb-4db6-9ef3-7def380aa52c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a52b3881277c49ba90deaa41335fc982'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:22.294041 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3a754222-51fb-4db6-9ef3-7def380aa52c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a52b3881277c49ba90deaa41335fc982'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:22.308188 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3a754222-51fb-4db6-9ef3-7def380aa52c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a52b3881277c49ba90deaa41335fc982'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:22.308992 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3a754222-51fb-4db6-9ef3-7def380aa52c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a52b3881277c49ba90deaa41335fc982'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:22.319046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-3a754222-51fb-4db6-9ef3-7def380aa52c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a52b3881277c49ba90deaa41335fc982'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:22.326432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1365/2731] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:55:22 2022] DELETE /identity/v3/users/a52b3881277c49ba90deaa41335fc982 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:22.658586 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a703e-583b-4e8f-b723-a19f476a1bb1 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:22.660155 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-bd3a703e-583b-4e8f-b723-a19f476a1bb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:22.677146 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a703e-583b-4e8f-b723-a19f476a1bb1 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:22.743206 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2484d5-20bd-4c1f-bcb5-b20b43e3d2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:22.743872 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2484d5-20bd-4c1f-bcb5-b20b43e3d2b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:22.744149 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2484d5-20bd-4c1f-bcb5-b20b43e3d2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:22.744415 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2484d5-20bd-4c1f-bcb5-b20b43e3d2b7 admin admin] PATH_INFO: `/v3/projects/720543a4d91349cd991d2ca0a8707029` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:22.745528 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2484d5-20bd-4c1f-bcb5-b20b43e3d2b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=720543a4d91349cd991d2ca0a8707029)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:22.747460 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2484d5-20bd-4c1f-bcb5-b20b43e3d2b7 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:22.794243 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ce2484d5-20bd-4c1f-bcb5-b20b43e3d2b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '720543a4d91349cd991d2ca0a8707029', 'request_id': 'req-ce2484d5-20bd-4c1f-bcb5-b20b43e3d2b7'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:22.795409 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:22.801633 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ce2484d5-20bd-4c1f-bcb5-b20b43e3d2b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '720543a4d91349cd991d2ca0a8707029', 'request_id': 'req-ce2484d5-20bd-4c1f-bcb5-b20b43e3d2b7'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:22.809106 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ce2484d5-20bd-4c1f-bcb5-b20b43e3d2b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '720543a4d91349cd991d2ca0a8707029', 'request_id': 'req-ce2484d5-20bd-4c1f-bcb5-b20b43e3d2b7'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:22.822439 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ce2484d5-20bd-4c1f-bcb5-b20b43e3d2b7 admin admin] The token cache is being invalidate because project 720543a4d91349cd991d2ca0a8707029 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:55:22.822713 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ce2484d5-20bd-4c1f-bcb5-b20b43e3d2b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:22.823372 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ce2484d5-20bd-4c1f-bcb5-b20b43e3d2b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:22.825183 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1367/2732] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:55:22 2022] DELETE /identity/v3/projects/720543a4d91349cd991d2ca0a8707029 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:22.829443 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a754222-51fb-4db6-9ef3-7def380aa52c admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:22.830923 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-3a754222-51fb-4db6-9ef3-7def380aa52c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:22.843991 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a754222-51fb-4db6-9ef3-7def380aa52c admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:22.882025 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:22.912735 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe6459-5918-4c30-887a-f03bedb06102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:22.913378 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe6459-5918-4c30-887a-f03bedb06102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:22.913652 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe6459-5918-4c30-887a-f03bedb06102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:22.913923 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe6459-5918-4c30-887a-f03bedb06102 admin admin] PATH_INFO: `/v3/users/9e995bf72bb24dabafa3c4aa57e098fd` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:22.915075 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe6459-5918-4c30-887a-f03bedb06102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e995bf72bb24dabafa3c4aa57e098fd)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:22.917030 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe6459-5918-4c30-887a-f03bedb06102 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:22.968237 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-56fe6459-5918-4c30-887a-f03bedb06102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e995bf72bb24dabafa3c4aa57e098fd'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:22.977048 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-56fe6459-5918-4c30-887a-f03bedb06102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e995bf72bb24dabafa3c4aa57e098fd'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:22.993689 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-56fe6459-5918-4c30-887a-f03bedb06102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e995bf72bb24dabafa3c4aa57e098fd'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:22.994497 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-56fe6459-5918-4c30-887a-f03bedb06102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e995bf72bb24dabafa3c4aa57e098fd'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:23.003882 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-56fe6459-5918-4c30-887a-f03bedb06102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e995bf72bb24dabafa3c4aa57e098fd'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:23.012564 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1366/2733] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:55:22 2022] DELETE /identity/v3/users/9e995bf72bb24dabafa3c4aa57e098fd => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:23.391042 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2484d5-20bd-4c1f-bcb5-b20b43e3d2b7 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:23.393052 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ce2484d5-20bd-4c1f-bcb5-b20b43e3d2b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:23.410483 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2484d5-20bd-4c1f-bcb5-b20b43e3d2b7 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:23.479888 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a11a9-4976-413a-aae3-f3819671b736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:23.480547 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a11a9-4976-413a-aae3-f3819671b736 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:23.480836 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a11a9-4976-413a-aae3-f3819671b736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:23.481129 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a11a9-4976-413a-aae3-f3819671b736 admin admin] PATH_INFO: `/v3/projects/08791bc7ecae4729b618f096f904077d` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:23.482285 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a11a9-4976-413a-aae3-f3819671b736 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08791bc7ecae4729b618f096f904077d)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:23.484251 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776a11a9-4976-413a-aae3-f3819671b736 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:23.545498 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-776a11a9-4976-413a-aae3-f3819671b736 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08791bc7ecae4729b618f096f904077d', 'request_id': 'req-776a11a9-4976-413a-aae3-f3819671b736'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:23.553385 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-776a11a9-4976-413a-aae3-f3819671b736 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08791bc7ecae4729b618f096f904077d', 'request_id': 'req-776a11a9-4976-413a-aae3-f3819671b736'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:23.560424 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-776a11a9-4976-413a-aae3-f3819671b736 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08791bc7ecae4729b618f096f904077d', 'request_id': 'req-776a11a9-4976-413a-aae3-f3819671b736'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:23.585793 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-776a11a9-4976-413a-aae3-f3819671b736 admin admin] The token cache is being invalidate because project 08791bc7ecae4729b618f096f904077d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:55:23.586575 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-776a11a9-4976-413a-aae3-f3819671b736 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:23.587599 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-776a11a9-4976-413a-aae3-f3819671b736 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:23.592123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1368/2734] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:55:23 2022] DELETE /identity/v3/projects/08791bc7ecae4729b618f096f904077d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:23.602112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8f8d2-619e-4cd9-8e34-8b3c254078a7 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:23.602688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8f8d2-619e-4cd9-8e34-8b3c254078a7 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:23.602688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8f8d2-619e-4cd9-8e34-8b3c254078a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:23.623662 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-d9b8f8d2-619e-4cd9-8e34-8b3c254078a7 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:23.624941 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d9b8f8d2-619e-4cd9-8e34-8b3c254078a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:23.691077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1367/2735] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:23.701454 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b8caa-543e-469c-b276-0dd30d403a2c None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:23.702031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b8caa-543e-469c-b276-0dd30d403a2c None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:23.702031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b8caa-543e-469c-b276-0dd30d403a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:23.725071 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-cf8b8caa-543e-469c-b276-0dd30d403a2c None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:23.726294 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-cf8b8caa-543e-469c-b276-0dd30d403a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:23.734699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1369/2736] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:23.739326 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8f8d2-619e-4cd9-8e34-8b3c254078a7 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:23.750120 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8f8d2-619e-4cd9-8e34-8b3c254078a7 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:23.754915 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f86f38-5fb4-4825-90dc-41e9a7584c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:23.755693 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f86f38-5fb4-4825-90dc-41e9a7584c28 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:23.756145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f86f38-5fb4-4825-90dc-41e9a7584c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:23.756411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f86f38-5fb4-4825-90dc-41e9a7584c28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:23.757068 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f86f38-5fb4-4825-90dc-41e9a7584c28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:55:23.757360 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f86f38-5fb4-4825-90dc-41e9a7584c28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:23.758950 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f86f38-5fb4-4825-90dc-41e9a7584c28 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:23.771609 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1368/2737] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:55:23.776384 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b8caa-543e-469c-b276-0dd30d403a2c None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:23.786134 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b8caa-543e-469c-b276-0dd30d403a2c None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:23.791316 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf05233-9e9c-4f4f-b703-29a50c4e6c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:23.791967 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf05233-9e9c-4f4f-b703-29a50c4e6c44 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:23.792241 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf05233-9e9c-4f4f-b703-29a50c4e6c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:23.792557 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf05233-9e9c-4f4f-b703-29a50c4e6c44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:23.793204 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf05233-9e9c-4f4f-b703-29a50c4e6c44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:23.795194 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf05233-9e9c-4f4f-b703-29a50c4e6c44 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:23.825293 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1370/2738] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:55:23 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:55:23.838219 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f86f38-5fb4-4825-90dc-41e9a7584c28 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:23.848751 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f86f38-5fb4-4825-90dc-41e9a7584c28 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:23.889808 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:23.915143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc091736-a722-458b-8cb0-f7e3f09d8a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:23.915984 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc091736-a722-458b-8cb0-f7e3f09d8a4d admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:23.916327 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc091736-a722-458b-8cb0-f7e3f09d8a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:23.917701 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc091736-a722-458b-8cb0-f7e3f09d8a4d admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:23.917701 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc091736-a722-458b-8cb0-f7e3f09d8a4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:23.920613 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc091736-a722-458b-8cb0-f7e3f09d8a4d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:23.953932 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1369/2739] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:55:23 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:55:23.959618 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf05233-9e9c-4f4f-b703-29a50c4e6c44 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:23.974427 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf05233-9e9c-4f4f-b703-29a50c4e6c44 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:23.979277 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36746af4-e558-4815-b572-d8c7f42a77e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:23.979980 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36746af4-e558-4815-b572-d8c7f42a77e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:23.980323 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36746af4-e558-4815-b572-d8c7f42a77e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:23.980598 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36746af4-e558-4815-b572-d8c7f42a77e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:23.981243 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36746af4-e558-4815-b572-d8c7f42a77e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:23.983715 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36746af4-e558-4815-b572-d8c7f42a77e0 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:23.998657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1371/2740] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:55:24.000762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc091736-a722-458b-8cb0-f7e3f09d8a4d admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:24.013465 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc091736-a722-458b-8cb0-f7e3f09d8a4d admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:24.018337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee72a5-0cb0-4e6f-9bf5-66b79b039af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:24.018945 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee72a5-0cb0-4e6f-9bf5-66b79b039af9 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:24.019219 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee72a5-0cb0-4e6f-9bf5-66b79b039af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:24.019481 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee72a5-0cb0-4e6f-9bf5-66b79b039af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:24.020153 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee72a5-0cb0-4e6f-9bf5-66b79b039af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:24.022009 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee72a5-0cb0-4e6f-9bf5-66b79b039af9 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:24.034342 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1370/2741] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:55:24.038403 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36746af4-e558-4815-b572-d8c7f42a77e0 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:24.049753 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36746af4-e558-4815-b572-d8c7f42a77e0 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:24.056315 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a712f1-be7e-483f-a492-6433f613c18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:24.057056 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a712f1-be7e-483f-a492-6433f613c18e admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:24.057395 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a712f1-be7e-483f-a492-6433f613c18e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:24.057707 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a712f1-be7e-483f-a492-6433f613c18e admin admin] PATH_INFO: `/v3/projects/8b4d127ea1014418b6c95a3d09cc87a5/users/a2a48024a5814d32956e9ea1c99466bf/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:24.073540 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a712f1-be7e-483f-a492-6433f613c18e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b4d127ea1014418b6c95a3d09cc87a5, user_id=a2a48024a5814d32956e9ea1c99466bf, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:24.076178 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a712f1-be7e-483f-a492-6433f613c18e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:24.091339 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1372/2742] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:55:24 2022] PUT /identity/v3/projects/8b4d127ea1014418b6c95a3d09cc87a5/users/a2a48024a5814d32956e9ea1c99466bf/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:24.103580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527a957-1d39-46b2-8d5b-eff03c4f06f2 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:24.103899 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527a957-1d39-46b2-8d5b-eff03c4f06f2 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:24.104650 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527a957-1d39-46b2-8d5b-eff03c4f06f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:24.133863 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-0527a957-1d39-46b2-8d5b-eff03c4f06f2 None None] MFA Rules not processed for user `a2a48024a5814d32956e9ea1c99466bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:24.135081 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0527a957-1d39-46b2-8d5b-eff03c4f06f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:24.208916 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1371/2743] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:24.213645 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a712f1-be7e-483f-a492-6433f613c18e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:24.219398 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:24.280564 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a712f1-be7e-483f-a492-6433f613c18e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:24.285515 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc3257-a3ec-4133-a937-e7e164c8bf8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:24.286216 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc3257-a3ec-4133-a937-e7e164c8bf8e admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:24.286489 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc3257-a3ec-4133-a937-e7e164c8bf8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:24.286755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc3257-a3ec-4133-a937-e7e164c8bf8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:24.287388 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc3257-a3ec-4133-a937-e7e164c8bf8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:24.289320 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc3257-a3ec-4133-a937-e7e164c8bf8e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:24.316861 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1373/2744] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:55:24 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:55:24.321963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527a957-1d39-46b2-8d5b-eff03c4f06f2 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:24.333469 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527a957-1d39-46b2-8d5b-eff03c4f06f2 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:24.402335 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca3692c-4f8f-492a-991c-c846ffeb1965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:24.402954 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3692c-4f8f-492a-991c-c846ffeb1965 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:24.403227 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3692c-4f8f-492a-991c-c846ffeb1965 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:24.403892 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3692c-4f8f-492a-991c-c846ffeb1965 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:24.404539 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca3692c-4f8f-492a-991c-c846ffeb1965 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:24.406444 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca3692c-4f8f-492a-991c-c846ffeb1965 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:24.430072 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1372/2745] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:55:24 2022] POST /identity/v3/users => generated 300 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:55:24.434847 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc3257-a3ec-4133-a937-e7e164c8bf8e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:24.448707 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc3257-a3ec-4133-a937-e7e164c8bf8e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:24.453758 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9e985-a794-4a80-b2cf-07d881e1d418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:24.454307 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9e985-a794-4a80-b2cf-07d881e1d418 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:24.454580 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9e985-a794-4a80-b2cf-07d881e1d418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:24.454844 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9e985-a794-4a80-b2cf-07d881e1d418 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:24.455484 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9e985-a794-4a80-b2cf-07d881e1d418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:24.457158 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9e985-a794-4a80-b2cf-07d881e1d418 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:24.468407 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1374/2746] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:55:24.472937 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca3692c-4f8f-492a-991c-c846ffeb1965 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:24.484653 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca3692c-4f8f-492a-991c-c846ffeb1965 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:24.489439 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ca6e8-eab5-4c1a-904d-161f0bb9f95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:24.490278 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ca6e8-eab5-4c1a-904d-161f0bb9f95e admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:24.490554 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ca6e8-eab5-4c1a-904d-161f0bb9f95e admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:24.491295 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ca6e8-eab5-4c1a-904d-161f0bb9f95e admin admin] PATH_INFO: `/v3/projects/e172c36c501d43c0916aaafdf69b28bb/users/b5726ce8716c49cd8559ced55a1f0694/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:24.506240 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ca6e8-eab5-4c1a-904d-161f0bb9f95e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e172c36c501d43c0916aaafdf69b28bb, user_id=b5726ce8716c49cd8559ced55a1f0694, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:24.509608 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ca6e8-eab5-4c1a-904d-161f0bb9f95e admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:24.524087 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1373/2747] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:55:24 2022] PUT /identity/v3/projects/e172c36c501d43c0916aaafdf69b28bb/users/b5726ce8716c49cd8559ced55a1f0694/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:24.528870 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9e985-a794-4a80-b2cf-07d881e1d418 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:24.540381 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9e985-a794-4a80-b2cf-07d881e1d418 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:24.644790 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfdee49-b33a-443d-aa73-d9cf7947bec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:24.644790 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdee49-b33a-443d-aa73-d9cf7947bec3 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:24.644790 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdee49-b33a-443d-aa73-d9cf7947bec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:24.644790 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdee49-b33a-443d-aa73-d9cf7947bec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:24.646411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfdee49-b33a-443d-aa73-d9cf7947bec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:24.646411 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfdee49-b33a-443d-aa73-d9cf7947bec3 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:24.667949 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1375/2748] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:55:24.669709 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ca6e8-eab5-4c1a-904d-161f0bb9f95e admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:24.685825 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ca6e8-eab5-4c1a-904d-161f0bb9f95e admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:24.693447 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96546443-034b-45dc-95ae-aef3b01c73ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:24.694884 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96546443-034b-45dc-95ae-aef3b01c73ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:24.695154 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96546443-034b-45dc-95ae-aef3b01c73ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:24.695417 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96546443-034b-45dc-95ae-aef3b01c73ae admin admin] PATH_INFO: `/v3/projects/e172c36c501d43c0916aaafdf69b28bb/users/b5726ce8716c49cd8559ced55a1f0694/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:24.698934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96546443-034b-45dc-95ae-aef3b01c73ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=e172c36c501d43c0916aaafdf69b28bb, user_id=b5726ce8716c49cd8559ced55a1f0694, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:24.701887 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96546443-034b-45dc-95ae-aef3b01c73ae admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:24.713038 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:24.718299 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900fd47-4456-4d3d-af1b-387f4b9f2dcb None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:24.718914 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900fd47-4456-4d3d-af1b-387f4b9f2dcb None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:24.718914 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900fd47-4456-4d3d-af1b-387f4b9f2dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:24.720104 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1374/2749] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:55:24 2022] PUT /identity/v3/projects/e172c36c501d43c0916aaafdf69b28bb/users/b5726ce8716c49cd8559ced55a1f0694/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:24.731910 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd25eba-0276-4022-a08a-9703912f3e8a None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:24.731910 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd25eba-0276-4022-a08a-9703912f3e8a None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:24.731910 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd25eba-0276-4022-a08a-9703912f3e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:24.764091 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-2bd25eba-0276-4022-a08a-9703912f3e8a None None] MFA Rules not processed for user `b5726ce8716c49cd8559ced55a1f0694`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:24.765366 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2bd25eba-0276-4022-a08a-9703912f3e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:24.778933 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-8900fd47-4456-4d3d-af1b-387f4b9f2dcb None None] MFA Rules not processed for user `5bdaf32400b94aa291ad43a3131e1d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:24.779335 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8900fd47-4456-4d3d-af1b-387f4b9f2dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:24.837955 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:24.854874 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1375/2750] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:24 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:24.866833 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd25eba-0276-4022-a08a-9703912f3e8a None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:24.868199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2bd25eba-0276-4022-a08a-9703912f3e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:24.871299 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1376/2751] 10.222.0.66 () {58 vars in 967 bytes} [Mon Sep 26 05:55:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:55:24.948346 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900fd47-4456-4d3d-af1b-387f4b9f2dcb None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:24.950175 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8900fd47-4456-4d3d-af1b-387f4b9f2dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:24.979705 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd25eba-0276-4022-a08a-9703912f3e8a None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:24.984162 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d65e8e-568e-4a0d-879a-5bae3932eb95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:24.985148 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d65e8e-568e-4a0d-879a-5bae3932eb95 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:24.985589 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d65e8e-568e-4a0d-879a-5bae3932eb95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:24.986109 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d65e8e-568e-4a0d-879a-5bae3932eb95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:24.997748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d65e8e-568e-4a0d-879a-5bae3932eb95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:24.999839 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d65e8e-568e-4a0d-879a-5bae3932eb95 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:25.024492 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1376/2752] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:55:24 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:55:25.099151 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900fd47-4456-4d3d-af1b-387f4b9f2dcb None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:25.105644 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795f250-0a51-4453-9e03-bcb6bea87280 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '830cd52ac42548b2ade17b5215aefd28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:25.106759 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795f250-0a51-4453-9e03-bcb6bea87280 service swift] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:25.107232 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795f250-0a51-4453-9e03-bcb6bea87280 service swift] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:25.107870 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795f250-0a51-4453-9e03-bcb6bea87280 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:25.122723 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795f250-0a51-4453-9e03-bcb6bea87280 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:25.125091 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795f250-0a51-4453-9e03-bcb6bea87280 service swift] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:25.135329 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1377/2753] 10.222.0.66 () {60 vars in 1384 bytes} [Mon Sep 26 05:55:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 26 05:55:25.832879 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d65e8e-568e-4a0d-879a-5bae3932eb95 service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:25.925278 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d65e8e-568e-4a0d-879a-5bae3932eb95 service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:25.930493 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c468ce-2834-40e6-91c0-cdd0364eb323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:25.931146 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c468ce-2834-40e6-91c0-cdd0364eb323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:25.931412 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c468ce-2834-40e6-91c0-cdd0364eb323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:25.931673 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c468ce-2834-40e6-91c0-cdd0364eb323 admin admin] PATH_INFO: `/v3/users/a2a48024a5814d32956e9ea1c99466bf` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:25.932871 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c468ce-2834-40e6-91c0-cdd0364eb323 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2a48024a5814d32956e9ea1c99466bf)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:25.934795 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c468ce-2834-40e6-91c0-cdd0364eb323 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:25.975365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:25.996091 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-33c468ce-2834-40e6-91c0-cdd0364eb323 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2a48024a5814d32956e9ea1c99466bf'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:26.006847 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-33c468ce-2834-40e6-91c0-cdd0364eb323 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2a48024a5814d32956e9ea1c99466bf'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:26.025522 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-33c468ce-2834-40e6-91c0-cdd0364eb323 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2a48024a5814d32956e9ea1c99466bf'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:26.026438 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-33c468ce-2834-40e6-91c0-cdd0364eb323 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2a48024a5814d32956e9ea1c99466bf'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:26.034222 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-33c468ce-2834-40e6-91c0-cdd0364eb323 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2a48024a5814d32956e9ea1c99466bf'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:26.040203 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1377/2754] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:55:25 2022] DELETE /identity/v3/users/a2a48024a5814d32956e9ea1c99466bf => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:26.045301 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d51c7-a68f-44f5-9561-fff102328ade None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:26.046191 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d51c7-a68f-44f5-9561-fff102328ade None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:26.046456 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d51c7-a68f-44f5-9561-fff102328ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:26.066754 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-340d51c7-a68f-44f5-9561-fff102328ade None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:26.068132 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-340d51c7-a68f-44f5-9561-fff102328ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:26.140040 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1378/2755] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:55:26.185671 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c468ce-2834-40e6-91c0-cdd0364eb323 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:26.189631 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-33c468ce-2834-40e6-91c0-cdd0364eb323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:26.313490 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c468ce-2834-40e6-91c0-cdd0364eb323 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:26.320858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16cfdb-0550-43b9-a059-606d01b8663b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:26.321655 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16cfdb-0550-43b9-a059-606d01b8663b service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:26.322022 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16cfdb-0550-43b9-a059-606d01b8663b service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:26.322296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16cfdb-0550-43b9-a059-606d01b8663b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:26.335005 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16cfdb-0550-43b9-a059-606d01b8663b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:26.336550 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16cfdb-0550-43b9-a059-606d01b8663b service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:26.348659 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1378/2756] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:55:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:55:27.238589 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d51c7-a68f-44f5-9561-fff102328ade None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:27.241651 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-340d51c7-a68f-44f5-9561-fff102328ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:27.284626 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d51c7-a68f-44f5-9561-fff102328ade None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:27.291239 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b795d8-36ab-4c89-83bd-b2b122757cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:27.292369 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b795d8-36ab-4c89-83bd-b2b122757cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:27.292773 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b795d8-36ab-4c89-83bd-b2b122757cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:27.293030 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b795d8-36ab-4c89-83bd-b2b122757cb3 admin admin] PATH_INFO: `/v3/projects/8b4d127ea1014418b6c95a3d09cc87a5` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:27.294292 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b795d8-36ab-4c89-83bd-b2b122757cb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b4d127ea1014418b6c95a3d09cc87a5)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:27.296342 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b795d8-36ab-4c89-83bd-b2b122757cb3 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:27.360651 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e9b795d8-36ab-4c89-83bd-b2b122757cb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b4d127ea1014418b6c95a3d09cc87a5', 'request_id': 'req-e9b795d8-36ab-4c89-83bd-b2b122757cb3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:27.362759 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:27.367607 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e9b795d8-36ab-4c89-83bd-b2b122757cb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b4d127ea1014418b6c95a3d09cc87a5', 'request_id': 'req-e9b795d8-36ab-4c89-83bd-b2b122757cb3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:27.375988 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e9b795d8-36ab-4c89-83bd-b2b122757cb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b4d127ea1014418b6c95a3d09cc87a5', 'request_id': 'req-e9b795d8-36ab-4c89-83bd-b2b122757cb3'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:27.392200 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e9b795d8-36ab-4c89-83bd-b2b122757cb3 admin admin] The token cache is being invalidate because project 8b4d127ea1014418b6c95a3d09cc87a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:55:27.392509 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e9b795d8-36ab-4c89-83bd-b2b122757cb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:27.393394 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-e9b795d8-36ab-4c89-83bd-b2b122757cb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:27.395163 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1379/2757] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:55:27 2022] DELETE /identity/v3/projects/8b4d127ea1014418b6c95a3d09cc87a5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:27.400688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16cfdb-0550-43b9-a059-606d01b8663b service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:27.413235 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16cfdb-0550-43b9-a059-606d01b8663b service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:27.516695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a3cd0-e679-4fdd-b32f-f3816a0c463c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:27.518779 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a3cd0-e679-4fdd-b32f-f3816a0c463c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:27.520184 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a3cd0-e679-4fdd-b32f-f3816a0c463c admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:27.520858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a3cd0-e679-4fdd-b32f-f3816a0c463c admin admin] PATH_INFO: `/v3/users/b5726ce8716c49cd8559ced55a1f0694` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:27.526209 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a3cd0-e679-4fdd-b32f-f3816a0c463c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5726ce8716c49cd8559ced55a1f0694)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:27.526209 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a3cd0-e679-4fdd-b32f-f3816a0c463c admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:27.618929 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-430a3cd0-e679-4fdd-b32f-f3816a0c463c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5726ce8716c49cd8559ced55a1f0694'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:27.623389 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:27.629833 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-430a3cd0-e679-4fdd-b32f-f3816a0c463c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5726ce8716c49cd8559ced55a1f0694'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:27.648036 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-430a3cd0-e679-4fdd-b32f-f3816a0c463c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5726ce8716c49cd8559ced55a1f0694'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:27.649047 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-430a3cd0-e679-4fdd-b32f-f3816a0c463c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5726ce8716c49cd8559ced55a1f0694'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:27.657843 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-430a3cd0-e679-4fdd-b32f-f3816a0c463c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5726ce8716c49cd8559ced55a1f0694'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:27.666131 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1379/2758] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:55:27 2022] DELETE /identity/v3/users/b5726ce8716c49cd8559ced55a1f0694 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:28.007195 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b795d8-36ab-4c89-83bd-b2b122757cb3 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:28.008746 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e9b795d8-36ab-4c89-83bd-b2b122757cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:28.026078 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b795d8-36ab-4c89-83bd-b2b122757cb3 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:28.097848 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8fb990-a35f-4a5b-b028-355e76132d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:28.099056 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fb990-a35f-4a5b-b028-355e76132d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:28.099056 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fb990-a35f-4a5b-b028-355e76132d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:28.099303 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fb990-a35f-4a5b-b028-355e76132d19 admin admin] PATH_INFO: `/v3/projects/e172c36c501d43c0916aaafdf69b28bb` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:28.100469 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8fb990-a35f-4a5b-b028-355e76132d19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e172c36c501d43c0916aaafdf69b28bb)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:28.102637 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8fb990-a35f-4a5b-b028-355e76132d19 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:28.175773 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4d8fb990-a35f-4a5b-b028-355e76132d19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e172c36c501d43c0916aaafdf69b28bb', 'request_id': 'req-4d8fb990-a35f-4a5b-b028-355e76132d19'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:28.184536 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4d8fb990-a35f-4a5b-b028-355e76132d19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e172c36c501d43c0916aaafdf69b28bb', 'request_id': 'req-4d8fb990-a35f-4a5b-b028-355e76132d19'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:28.195120 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4d8fb990-a35f-4a5b-b028-355e76132d19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e172c36c501d43c0916aaafdf69b28bb', 'request_id': 'req-4d8fb990-a35f-4a5b-b028-355e76132d19'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:28.215662 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4d8fb990-a35f-4a5b-b028-355e76132d19 admin admin] The token cache is being invalidate because project e172c36c501d43c0916aaafdf69b28bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:55:28.215990 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4d8fb990-a35f-4a5b-b028-355e76132d19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:28.217715 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-4d8fb990-a35f-4a5b-b028-355e76132d19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:28.219424 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1380/2759] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:55:28 2022] DELETE /identity/v3/projects/e172c36c501d43c0916aaafdf69b28bb => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:55:28.224922 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f389f-8247-4b0a-bf67-56a6716df68f None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:28.225224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f389f-8247-4b0a-bf67-56a6716df68f None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:28.225468 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f389f-8247-4b0a-bf67-56a6716df68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:28.246888 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-e69f389f-8247-4b0a-bf67-56a6716df68f None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:28.249050 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e69f389f-8247-4b0a-bf67-56a6716df68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:28.326966 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1380/2760] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:55:28.396103 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521a44c-7a9d-4ca0-abc0-b9a4d1906e52 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:28.396746 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521a44c-7a9d-4ca0-abc0-b9a4d1906e52 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:28.396746 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521a44c-7a9d-4ca0-abc0-b9a4d1906e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:28.417787 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-a521a44c-7a9d-4ca0-abc0-b9a4d1906e52 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:28.419041 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a521a44c-7a9d-4ca0-abc0-b9a4d1906e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:28.431827 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1381/2761] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:28.432748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f389f-8247-4b0a-bf67-56a6716df68f None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:28.444599 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f389f-8247-4b0a-bf67-56a6716df68f None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:28.451339 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c31237-a814-4442-a4ce-4ba0329411bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:28.452216 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c31237-a814-4442-a4ce-4ba0329411bf admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:28.452543 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c31237-a814-4442-a4ce-4ba0329411bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:28.452970 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c31237-a814-4442-a4ce-4ba0329411bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:28.458067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c31237-a814-4442-a4ce-4ba0329411bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:55:28.458067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c31237-a814-4442-a4ce-4ba0329411bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:28.458067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c31237-a814-4442-a4ce-4ba0329411bf admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:28.469835 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1381/2762] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:55:28.474858 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521a44c-7a9d-4ca0-abc0-b9a4d1906e52 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:28.484436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521a44c-7a9d-4ca0-abc0-b9a4d1906e52 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:28.489710 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6571661-f05e-42fa-947d-740cb08419ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:28.490346 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6571661-f05e-42fa-947d-740cb08419ff admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:28.490611 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6571661-f05e-42fa-947d-740cb08419ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:28.490873 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6571661-f05e-42fa-947d-740cb08419ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:28.491656 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6571661-f05e-42fa-947d-740cb08419ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:28.493607 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6571661-f05e-42fa-947d-740cb08419ff admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:28.529806 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c31237-a814-4442-a4ce-4ba0329411bf admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:28.530645 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1382/2763] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:55:28 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:55:28.544913 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c31237-a814-4442-a4ce-4ba0329411bf admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:28.621493 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc06e4-42b6-4af2-9ed4-a33066afd2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:28.622111 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc06e4-42b6-4af2-9ed4-a33066afd2f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:28.622385 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc06e4-42b6-4af2-9ed4-a33066afd2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:28.622651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bc06e4-42b6-4af2-9ed4-a33066afd2f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:28.623350 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc06e4-42b6-4af2-9ed4-a33066afd2f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:28.625399 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bc06e4-42b6-4af2-9ed4-a33066afd2f0 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:28.659921 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1382/2764] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:55:28 2022] POST /identity/v3/users => generated 286 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:55:28.661987 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6571661-f05e-42fa-947d-740cb08419ff admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:28.673221 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6571661-f05e-42fa-947d-740cb08419ff admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:28.680019 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8840960-688b-42b4-b8fc-a82e7890fac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:28.680646 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8840960-688b-42b4-b8fc-a82e7890fac8 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:28.681027 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8840960-688b-42b4-b8fc-a82e7890fac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:28.681215 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8840960-688b-42b4-b8fc-a82e7890fac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:28.682063 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8840960-688b-42b4-b8fc-a82e7890fac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:28.690381 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8840960-688b-42b4-b8fc-a82e7890fac8 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:28.702458 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1383/2765] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:55:28.706816 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc06e4-42b6-4af2-9ed4-a33066afd2f0 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:28.721592 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bc06e4-42b6-4af2-9ed4-a33066afd2f0 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:28.729351 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cce21c-445c-4475-b86a-6ddf04731a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:28.730238 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cce21c-445c-4475-b86a-6ddf04731a81 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:28.730690 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cce21c-445c-4475-b86a-6ddf04731a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:28.731182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cce21c-445c-4475-b86a-6ddf04731a81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:28.731906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cce21c-445c-4475-b86a-6ddf04731a81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:28.733797 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cce21c-445c-4475-b86a-6ddf04731a81 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:28.751427 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1383/2766] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:55:28.755903 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8840960-688b-42b4-b8fc-a82e7890fac8 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:28.768959 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8840960-688b-42b4-b8fc-a82e7890fac8 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:28.774827 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24e5e7-6604-4561-9709-64d389339b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:28.775607 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24e5e7-6604-4561-9709-64d389339b95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:28.775988 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24e5e7-6604-4561-9709-64d389339b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:28.776335 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24e5e7-6604-4561-9709-64d389339b95 admin admin] PATH_INFO: `/v3/projects/1aa2c7b46e5444eebb0377b9e97f91be/users/7aa40bcadb0e4261925c85fb023fbc76/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:28.809039 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24e5e7-6604-4561-9709-64d389339b95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aa2c7b46e5444eebb0377b9e97f91be, user_id=7aa40bcadb0e4261925c85fb023fbc76, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:28.812139 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24e5e7-6604-4561-9709-64d389339b95 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:28.830759 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1384/2767] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:55:28 2022] PUT /identity/v3/projects/1aa2c7b46e5444eebb0377b9e97f91be/users/7aa40bcadb0e4261925c85fb023fbc76/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:28.841981 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad828ee-2f4f-4185-9bdf-ec05b973e6db None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:28.842179 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad828ee-2f4f-4185-9bdf-ec05b973e6db None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:28.843821 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad828ee-2f4f-4185-9bdf-ec05b973e6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:28.875990 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-2ad828ee-2f4f-4185-9bdf-ec05b973e6db None None] MFA Rules not processed for user `7aa40bcadb0e4261925c85fb023fbc76`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:28.877222 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2ad828ee-2f4f-4185-9bdf-ec05b973e6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:28.916489 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:28.970458 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1384/2768] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:55:28.976749 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24e5e7-6604-4561-9709-64d389339b95 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:29.002374 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:29.090294 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24e5e7-6604-4561-9709-64d389339b95 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:29.095537 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca750c-83a6-4ec9-af9f-ec9596613643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:29.096175 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca750c-83a6-4ec9-af9f-ec9596613643 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:29.096433 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca750c-83a6-4ec9-af9f-ec9596613643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:29.096709 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca750c-83a6-4ec9-af9f-ec9596613643 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:29.097397 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca750c-83a6-4ec9-af9f-ec9596613643 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:29.099439 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca750c-83a6-4ec9-af9f-ec9596613643 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:29.147822 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1385/2769] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:55:28 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:55:29.152061 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad828ee-2f4f-4185-9bdf-ec05b973e6db None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:29.171019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad828ee-2f4f-4185-9bdf-ec05b973e6db None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:29.243484 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b367c-f8fb-49a6-bfcc-2359f73730c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:29.244229 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b367c-f8fb-49a6-bfcc-2359f73730c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:29.244542 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b367c-f8fb-49a6-bfcc-2359f73730c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:29.244849 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b367c-f8fb-49a6-bfcc-2359f73730c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:29.245614 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b367c-f8fb-49a6-bfcc-2359f73730c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:29.247763 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b367c-f8fb-49a6-bfcc-2359f73730c1 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:29.276806 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1385/2770] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:55:29 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:55:29.278199 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca750c-83a6-4ec9-af9f-ec9596613643 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:29.302344 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca750c-83a6-4ec9-af9f-ec9596613643 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:29.308634 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244656f8-57e9-421d-a977-c47a68bee049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:29.309256 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244656f8-57e9-421d-a977-c47a68bee049 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:29.309529 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244656f8-57e9-421d-a977-c47a68bee049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:29.309791 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244656f8-57e9-421d-a977-c47a68bee049 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:29.310702 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244656f8-57e9-421d-a977-c47a68bee049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:29.312086 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244656f8-57e9-421d-a977-c47a68bee049 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:29.328348 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1386/2771] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:55:29.330405 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b367c-f8fb-49a6-bfcc-2359f73730c1 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:29.340897 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b367c-f8fb-49a6-bfcc-2359f73730c1 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:29.348047 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167b325-c33a-461d-a02c-1600c5e1e493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:29.348759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167b325-c33a-461d-a02c-1600c5e1e493 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:29.349027 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167b325-c33a-461d-a02c-1600c5e1e493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:29.349300 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167b325-c33a-461d-a02c-1600c5e1e493 admin admin] PATH_INFO: `/v3/projects/eb4a5d940f3a40e2b9ccac242076c336/users/30a077efed7e4ce09229bf707d157594/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:29.367760 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4167b325-c33a-461d-a02c-1600c5e1e493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb4a5d940f3a40e2b9ccac242076c336, user_id=30a077efed7e4ce09229bf707d157594, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:29.370807 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4167b325-c33a-461d-a02c-1600c5e1e493 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:29.395572 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1386/2772] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:55:29 2022] PUT /identity/v3/projects/eb4a5d940f3a40e2b9ccac242076c336/users/30a077efed7e4ce09229bf707d157594/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:29.396943 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244656f8-57e9-421d-a977-c47a68bee049 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:29.407928 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244656f8-57e9-421d-a977-c47a68bee049 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:29.514891 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b2d6d-29a2-41b0-8d47-3195697faa6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:29.516013 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b2d6d-29a2-41b0-8d47-3195697faa6b admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:29.516381 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b2d6d-29a2-41b0-8d47-3195697faa6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:29.517093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b2d6d-29a2-41b0-8d47-3195697faa6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:29.518179 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b2d6d-29a2-41b0-8d47-3195697faa6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:29.520625 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b2d6d-29a2-41b0-8d47-3195697faa6b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:29.534552 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1387/2773] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:55:29.538841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167b325-c33a-461d-a02c-1600c5e1e493 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:29.551522 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167b325-c33a-461d-a02c-1600c5e1e493 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:29.558640 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcb256-a125-42a1-ae1b-3b9e0924b986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:29.559618 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcb256-a125-42a1-ae1b-3b9e0924b986 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:29.559933 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcb256-a125-42a1-ae1b-3b9e0924b986 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:29.560290 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcb256-a125-42a1-ae1b-3b9e0924b986 admin admin] PATH_INFO: `/v3/projects/eb4a5d940f3a40e2b9ccac242076c336/users/30a077efed7e4ce09229bf707d157594/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:29.562966 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdcb256-a125-42a1-ae1b-3b9e0924b986 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb4a5d940f3a40e2b9ccac242076c336, user_id=30a077efed7e4ce09229bf707d157594, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:29.567972 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdcb256-a125-42a1-ae1b-3b9e0924b986 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:29.583606 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1387/2774] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:55:29 2022] PUT /identity/v3/projects/eb4a5d940f3a40e2b9ccac242076c336/users/30a077efed7e4ce09229bf707d157594/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:29.596001 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e7ccd-812b-48b5-a2a2-f8609f536a25 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:29.596282 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e7ccd-812b-48b5-a2a2-f8609f536a25 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:29.596557 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e7ccd-812b-48b5-a2a2-f8609f536a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:29.649434 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-452e7ccd-812b-48b5-a2a2-f8609f536a25 None None] MFA Rules not processed for user `30a077efed7e4ce09229bf707d157594`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:29.658858 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-452e7ccd-812b-48b5-a2a2-f8609f536a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:29.795981 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1388/2775] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:29.808890 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcb256-a125-42a1-ae1b-3b9e0924b986 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:29.811026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-acdcb256-a125-42a1-ae1b-3b9e0924b986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:29.894936 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcb256-a125-42a1-ae1b-3b9e0924b986 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:29.899292 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e9693-7b17-4308-b54b-24d57b192b24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:29.899772 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e9693-7b17-4308-b54b-24d57b192b24 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:29.900738 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e9693-7b17-4308-b54b-24d57b192b24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:29.901001 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35e9693-7b17-4308-b54b-24d57b192b24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:29.959668 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:30.018473 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e9693-7b17-4308-b54b-24d57b192b24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:30.019955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35e9693-7b17-4308-b54b-24d57b192b24 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:30.047362 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1388/2776] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:55:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:55:30.050543 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e7ccd-812b-48b5-a2a2-f8609f536a25 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:30.052015 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-452e7ccd-812b-48b5-a2a2-f8609f536a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:30.058273 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:30.126234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e7ccd-812b-48b5-a2a2-f8609f536a25 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:30.130269 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97009a-cb29-42ec-ad67-2db3af29e962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:30.131075 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97009a-cb29-42ec-ad67-2db3af29e962 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:30.131773 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97009a-cb29-42ec-ad67-2db3af29e962 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:30.132217 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97009a-cb29-42ec-ad67-2db3af29e962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:30.134626 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-dd97009a-cb29-42ec-ad67-2db3af29e962 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:30.223238 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97009a-cb29-42ec-ad67-2db3af29e962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:30.225030 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97009a-cb29-42ec-ad67-2db3af29e962 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:30.236671 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1389/2777] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:55:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:55:32.738622 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e9693-7b17-4308-b54b-24d57b192b24 service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:32.756344 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35e9693-7b17-4308-b54b-24d57b192b24 service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:32.761324 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98288764-c6e6-4248-b580-48f8bfc25070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:32.762012 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98288764-c6e6-4248-b580-48f8bfc25070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:32.762287 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98288764-c6e6-4248-b580-48f8bfc25070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:32.762557 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98288764-c6e6-4248-b580-48f8bfc25070 admin admin] PATH_INFO: `/v3/users/7aa40bcadb0e4261925c85fb023fbc76` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:32.763823 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98288764-c6e6-4248-b580-48f8bfc25070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aa40bcadb0e4261925c85fb023fbc76)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:32.765832 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98288764-c6e6-4248-b580-48f8bfc25070 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:32.855473 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-98288764-c6e6-4248-b580-48f8bfc25070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aa40bcadb0e4261925c85fb023fbc76'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:32.871934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-98288764-c6e6-4248-b580-48f8bfc25070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aa40bcadb0e4261925c85fb023fbc76'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:32.891841 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-98288764-c6e6-4248-b580-48f8bfc25070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aa40bcadb0e4261925c85fb023fbc76'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:32.893247 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-98288764-c6e6-4248-b580-48f8bfc25070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aa40bcadb0e4261925c85fb023fbc76'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:32.901457 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-98288764-c6e6-4248-b580-48f8bfc25070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aa40bcadb0e4261925c85fb023fbc76'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:32.909135 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1389/2778] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:55:32 2022] DELETE /identity/v3/users/7aa40bcadb0e4261925c85fb023fbc76 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:32.913652 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbd27c-0a45-4a10-ae0e-58fac834e8f1 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:32.914207 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbd27c-0a45-4a10-ae0e-58fac834e8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:32.914207 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfbd27c-0a45-4a10-ae0e-58fac834e8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:32.937887 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-acfbd27c-0a45-4a10-ae0e-58fac834e8f1 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:32.939124 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-acfbd27c-0a45-4a10-ae0e-58fac834e8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:33.017496 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1390/2779] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:33.030888 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98288764-c6e6-4248-b580-48f8bfc25070 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:33.032668 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-98288764-c6e6-4248-b580-48f8bfc25070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:33.149763 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98288764-c6e6-4248-b580-48f8bfc25070 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:33.156310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86bf92-b1e3-484e-ae33-9df916ee5848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:33.157239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86bf92-b1e3-484e-ae33-9df916ee5848 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:33.157836 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86bf92-b1e3-484e-ae33-9df916ee5848 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:33.158310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86bf92-b1e3-484e-ae33-9df916ee5848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:33.177105 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86bf92-b1e3-484e-ae33-9df916ee5848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:33.178635 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86bf92-b1e3-484e-ae33-9df916ee5848 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:33.190466 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1390/2780] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:55:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:55:33.540822 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbd27c-0a45-4a10-ae0e-58fac834e8f1 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:33.542317 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-acfbd27c-0a45-4a10-ae0e-58fac834e8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:33.565567 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfbd27c-0a45-4a10-ae0e-58fac834e8f1 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:33.570774 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7a6b9-b08a-408c-9d27-9fbe2fcabb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:33.571623 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7a6b9-b08a-408c-9d27-9fbe2fcabb2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:33.571950 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7a6b9-b08a-408c-9d27-9fbe2fcabb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:33.572223 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7a6b9-b08a-408c-9d27-9fbe2fcabb2e admin admin] PATH_INFO: `/v3/projects/1aa2c7b46e5444eebb0377b9e97f91be` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:33.573390 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7a6b9-b08a-408c-9d27-9fbe2fcabb2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aa2c7b46e5444eebb0377b9e97f91be)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:33.575309 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7a6b9-b08a-408c-9d27-9fbe2fcabb2e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:33.645537 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:33.647152 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-33b7a6b9-b08a-408c-9d27-9fbe2fcabb2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aa2c7b46e5444eebb0377b9e97f91be', 'request_id': 'req-33b7a6b9-b08a-408c-9d27-9fbe2fcabb2e'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:33.654939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-33b7a6b9-b08a-408c-9d27-9fbe2fcabb2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aa2c7b46e5444eebb0377b9e97f91be', 'request_id': 'req-33b7a6b9-b08a-408c-9d27-9fbe2fcabb2e'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:33.666042 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-33b7a6b9-b08a-408c-9d27-9fbe2fcabb2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aa2c7b46e5444eebb0377b9e97f91be', 'request_id': 'req-33b7a6b9-b08a-408c-9d27-9fbe2fcabb2e'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:33.707939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-33b7a6b9-b08a-408c-9d27-9fbe2fcabb2e admin admin] The token cache is being invalidate because project 1aa2c7b46e5444eebb0377b9e97f91be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:55:33.708286 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-33b7a6b9-b08a-408c-9d27-9fbe2fcabb2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:33.711679 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-33b7a6b9-b08a-408c-9d27-9fbe2fcabb2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:33.714239 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1391/2781] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:55:33 2022] DELETE /identity/v3/projects/1aa2c7b46e5444eebb0377b9e97f91be => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:33.718467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86bf92-b1e3-484e-ae33-9df916ee5848 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:33.737579 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86bf92-b1e3-484e-ae33-9df916ee5848 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:33.852027 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:33.885047 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782af801-7e23-43c0-91fd-504d6583b901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:33.885926 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782af801-7e23-43c0-91fd-504d6583b901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:33.886354 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782af801-7e23-43c0-91fd-504d6583b901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:33.886771 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782af801-7e23-43c0-91fd-504d6583b901 admin admin] PATH_INFO: `/v3/users/30a077efed7e4ce09229bf707d157594` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:33.888306 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782af801-7e23-43c0-91fd-504d6583b901 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30a077efed7e4ce09229bf707d157594)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:33.890620 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782af801-7e23-43c0-91fd-504d6583b901 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:33.999940 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-782af801-7e23-43c0-91fd-504d6583b901 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30a077efed7e4ce09229bf707d157594'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:34.014344 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-782af801-7e23-43c0-91fd-504d6583b901 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30a077efed7e4ce09229bf707d157594'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:34.074610 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-782af801-7e23-43c0-91fd-504d6583b901 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30a077efed7e4ce09229bf707d157594'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:34.075893 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-782af801-7e23-43c0-91fd-504d6583b901 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30a077efed7e4ce09229bf707d157594'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:34.087547 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-782af801-7e23-43c0-91fd-504d6583b901 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30a077efed7e4ce09229bf707d157594'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:34.108002 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1391/2782] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:55:33 2022] DELETE /identity/v3/users/30a077efed7e4ce09229bf707d157594 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:34.256071 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7a6b9-b08a-408c-9d27-9fbe2fcabb2e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:34.260581 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-33b7a6b9-b08a-408c-9d27-9fbe2fcabb2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:34.311544 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7a6b9-b08a-408c-9d27-9fbe2fcabb2e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:34.425272 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fd4d3-ae4b-4f3a-9f75-09e98b0df543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:34.428579 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fd4d3-ae4b-4f3a-9f75-09e98b0df543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:34.428882 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fd4d3-ae4b-4f3a-9f75-09e98b0df543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:34.430958 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48fd4d3-ae4b-4f3a-9f75-09e98b0df543 admin admin] PATH_INFO: `/v3/users/0b6bc601f9f74d55b7c1a0033cf7c06c` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:34.431110 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48fd4d3-ae4b-4f3a-9f75-09e98b0df543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b6bc601f9f74d55b7c1a0033cf7c06c)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:34.433387 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48fd4d3-ae4b-4f3a-9f75-09e98b0df543 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:34.450104 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782af801-7e23-43c0-91fd-504d6583b901 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:34.451768 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-782af801-7e23-43c0-91fd-504d6583b901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:34.469617 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782af801-7e23-43c0-91fd-504d6583b901 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:34.483634 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc87229-5f87-450d-9d9f-88343dadc5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:34.484613 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc87229-5f87-450d-9d9f-88343dadc5d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:34.485278 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc87229-5f87-450d-9d9f-88343dadc5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:34.485699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc87229-5f87-450d-9d9f-88343dadc5d2 admin admin] PATH_INFO: `/v3/users/1aebaf488289488387d0b9efa7818285` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:34.502734 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc87229-5f87-450d-9d9f-88343dadc5d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aebaf488289488387d0b9efa7818285)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:34.505132 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc87229-5f87-450d-9d9f-88343dadc5d2 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:34.508325 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-c48fd4d3-ae4b-4f3a-9f75-09e98b0df543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b6bc601f9f74d55b7c1a0033cf7c06c'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:34.524607 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-c48fd4d3-ae4b-4f3a-9f75-09e98b0df543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b6bc601f9f74d55b7c1a0033cf7c06c'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:34.526068 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-c48fd4d3-ae4b-4f3a-9f75-09e98b0df543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b6bc601f9f74d55b7c1a0033cf7c06c'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:34.540465 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-c48fd4d3-ae4b-4f3a-9f75-09e98b0df543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b6bc601f9f74d55b7c1a0033cf7c06c'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:34.548948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-c48fd4d3-ae4b-4f3a-9f75-09e98b0df543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b6bc601f9f74d55b7c1a0033cf7c06c'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:34.558544 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1392/2783] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:55:34 2022] DELETE /identity/v3/users/0b6bc601f9f74d55b7c1a0033cf7c06c => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:34.559396 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fd4d3-ae4b-4f3a-9f75-09e98b0df543 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:34.560894 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c48fd4d3-ae4b-4f3a-9f75-09e98b0df543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:34.566382 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-0bc87229-5f87-450d-9d9f-88343dadc5d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aebaf488289488387d0b9efa7818285'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:34.580960 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-0bc87229-5f87-450d-9d9f-88343dadc5d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aebaf488289488387d0b9efa7818285'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:34.600132 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-0bc87229-5f87-450d-9d9f-88343dadc5d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aebaf488289488387d0b9efa7818285'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:34.600888 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-0bc87229-5f87-450d-9d9f-88343dadc5d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aebaf488289488387d0b9efa7818285'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:34.612310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-0bc87229-5f87-450d-9d9f-88343dadc5d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aebaf488289488387d0b9efa7818285'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:34.619155 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1392/2784] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:55:34 2022] DELETE /identity/v3/users/1aebaf488289488387d0b9efa7818285 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:55:34.649729 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:34.654316 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48fd4d3-ae4b-4f3a-9f75-09e98b0df543 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:34.724539 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d3910-8e43-4dd6-81f2-3acf5b312613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:34.725283 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d3910-8e43-4dd6-81f2-3acf5b312613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:34.725562 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d3910-8e43-4dd6-81f2-3acf5b312613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:34.725813 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d3910-8e43-4dd6-81f2-3acf5b312613 admin admin] PATH_INFO: `/v3/projects/eb4a5d940f3a40e2b9ccac242076c336` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:34.727192 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d3910-8e43-4dd6-81f2-3acf5b312613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb4a5d940f3a40e2b9ccac242076c336)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:34.729902 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d3910-8e43-4dd6-81f2-3acf5b312613 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:34.785854 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2e4d3910-8e43-4dd6-81f2-3acf5b312613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb4a5d940f3a40e2b9ccac242076c336', 'request_id': 'req-2e4d3910-8e43-4dd6-81f2-3acf5b312613'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:34.796163 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2e4d3910-8e43-4dd6-81f2-3acf5b312613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb4a5d940f3a40e2b9ccac242076c336', 'request_id': 'req-2e4d3910-8e43-4dd6-81f2-3acf5b312613'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:34.803675 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2e4d3910-8e43-4dd6-81f2-3acf5b312613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb4a5d940f3a40e2b9ccac242076c336', 'request_id': 'req-2e4d3910-8e43-4dd6-81f2-3acf5b312613'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:34.809118 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc87229-5f87-450d-9d9f-88343dadc5d2 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:34.810583 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-0bc87229-5f87-450d-9d9f-88343dadc5d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:34.825524 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc87229-5f87-450d-9d9f-88343dadc5d2 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:34.825774 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2e4d3910-8e43-4dd6-81f2-3acf5b312613 admin admin] The token cache is being invalidate because project eb4a5d940f3a40e2b9ccac242076c336 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:55:34.826209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2e4d3910-8e43-4dd6-81f2-3acf5b312613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:34.826723 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-2e4d3910-8e43-4dd6-81f2-3acf5b312613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:34.828425 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1393/2785] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:55:34 2022] DELETE /identity/v3/projects/eb4a5d940f3a40e2b9ccac242076c336 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:34.833855 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a87b5-21d6-44d6-83c8-fce3f362ecf8 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:34.834403 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a87b5-21d6-44d6-83c8-fce3f362ecf8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:34.834867 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a87b5-21d6-44d6-83c8-fce3f362ecf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:34.858592 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-8f7a87b5-21d6-44d6-83c8-fce3f362ecf8 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:34.859878 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8f7a87b5-21d6-44d6-83c8-fce3f362ecf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:34.870583 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:34.913826 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84204ab3-e3a3-4d2d-a589-3622c405addb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:34.914656 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84204ab3-e3a3-4d2d-a589-3622c405addb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:34.914922 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84204ab3-e3a3-4d2d-a589-3622c405addb admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:34.915197 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84204ab3-e3a3-4d2d-a589-3622c405addb admin admin] PATH_INFO: `/v3/projects/37dc6cb86ab3460a9ef7eddbcbae953d` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:34.916375 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84204ab3-e3a3-4d2d-a589-3622c405addb admin admin] RBAC: Authorizing `identity:delete_project(project_id=37dc6cb86ab3460a9ef7eddbcbae953d)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:34.918285 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84204ab3-e3a3-4d2d-a589-3622c405addb admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:34.931981 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1394/2786] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:34.932924 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a87b5-21d6-44d6-83c8-fce3f362ecf8 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:34.934197 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8f7a87b5-21d6-44d6-83c8-fce3f362ecf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:34.946333 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a87b5-21d6-44d6-83c8-fce3f362ecf8 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:34.952084 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b102a-5812-491c-80b2-f9d76771af99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:34.952809 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b102a-5812-491c-80b2-f9d76771af99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:34.953101 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b102a-5812-491c-80b2-f9d76771af99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:34.953374 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b102a-5812-491c-80b2-f9d76771af99 admin admin] PATH_INFO: `/v3/projects/e7e20c936b544041946c36379012278d` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:34.965273 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b102a-5812-491c-80b2-f9d76771af99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7e20c936b544041946c36379012278d)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:34.967229 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b102a-5812-491c-80b2-f9d76771af99 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:34.974828 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-84204ab3-e3a3-4d2d-a589-3622c405addb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37dc6cb86ab3460a9ef7eddbcbae953d', 'request_id': 'req-84204ab3-e3a3-4d2d-a589-3622c405addb'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:34.984096 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-84204ab3-e3a3-4d2d-a589-3622c405addb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37dc6cb86ab3460a9ef7eddbcbae953d', 'request_id': 'req-84204ab3-e3a3-4d2d-a589-3622c405addb'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:34.989931 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:34.990346 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-84204ab3-e3a3-4d2d-a589-3622c405addb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37dc6cb86ab3460a9ef7eddbcbae953d', 'request_id': 'req-84204ab3-e3a3-4d2d-a589-3622c405addb'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:35.004345 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-84204ab3-e3a3-4d2d-a589-3622c405addb admin admin] The token cache is being invalidate because project 37dc6cb86ab3460a9ef7eddbcbae953d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:55:35.004651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-84204ab3-e3a3-4d2d-a589-3622c405addb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:35.005336 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-84204ab3-e3a3-4d2d-a589-3622c405addb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:35.006921 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1393/2787] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:55:34 2022] DELETE /identity/v3/projects/37dc6cb86ab3460a9ef7eddbcbae953d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:35.008226 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbee26d-12f1-460c-85ad-7abaf0b149fe None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:35.008501 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbee26d-12f1-460c-85ad-7abaf0b149fe None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:35.008761 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbee26d-12f1-460c-85ad-7abaf0b149fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:35.033022 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-3cbee26d-12f1-460c-85ad-7abaf0b149fe None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:35.034284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-3cbee26d-12f1-460c-85ad-7abaf0b149fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:35.034510 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6f9b102a-5812-491c-80b2-f9d76771af99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7e20c936b544041946c36379012278d', 'request_id': 'req-6f9b102a-5812-491c-80b2-f9d76771af99'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:35.042034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6f9b102a-5812-491c-80b2-f9d76771af99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7e20c936b544041946c36379012278d', 'request_id': 'req-6f9b102a-5812-491c-80b2-f9d76771af99'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:35.051262 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6f9b102a-5812-491c-80b2-f9d76771af99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7e20c936b544041946c36379012278d', 'request_id': 'req-6f9b102a-5812-491c-80b2-f9d76771af99'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:35.067315 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6f9b102a-5812-491c-80b2-f9d76771af99 admin admin] The token cache is being invalidate because project e7e20c936b544041946c36379012278d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:55:35.067538 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6f9b102a-5812-491c-80b2-f9d76771af99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:35.068367 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-6f9b102a-5812-491c-80b2-f9d76771af99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:35.069982 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1395/2788] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:55:34 2022] DELETE /identity/v3/projects/e7e20c936b544041946c36379012278d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:35.070745 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b102a-5812-491c-80b2-f9d76771af99 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:35.072089 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6f9b102a-5812-491c-80b2-f9d76771af99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:35.120750 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1394/2789] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:35.126297 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4194a0-9448-40e1-86ba-579c4a7446c1 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:35.126590 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4194a0-9448-40e1-86ba-579c4a7446c1 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:35.126823 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4194a0-9448-40e1-86ba-579c4a7446c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:35.153316 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-9d4194a0-9448-40e1-86ba-579c4a7446c1 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:35.154962 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-9d4194a0-9448-40e1-86ba-579c4a7446c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:35.161603 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b102a-5812-491c-80b2-f9d76771af99 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:35.166388 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1395/2790] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:35.167209 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4194a0-9448-40e1-86ba-579c4a7446c1 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:35.169810 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6ba49-cda3-467d-a157-740eac443b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:35.170480 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6ba49-cda3-467d-a157-740eac443b1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:35.170755 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6ba49-cda3-467d-a157-740eac443b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:35.171004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d6ba49-cda3-467d-a157-740eac443b1f admin admin] PATH_INFO: `/v3/users/803a55d48c1f4b5ca335af4d5c984386` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:35.173198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6ba49-cda3-467d-a157-740eac443b1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=803a55d48c1f4b5ca335af4d5c984386)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:35.175338 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d6ba49-cda3-467d-a157-740eac443b1f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:35.179527 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4194a0-9448-40e1-86ba-579c4a7446c1 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:35.184588 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f7a93-caa9-4308-8c15-ad56dc96aa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:35.185284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f7a93-caa9-4308-8c15-ad56dc96aa1f admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:35.185574 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f7a93-caa9-4308-8c15-ad56dc96aa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:35.185883 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f7a93-caa9-4308-8c15-ad56dc96aa1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:35.186591 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f7a93-caa9-4308-8c15-ad56dc96aa1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:55:35.186968 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f7a93-caa9-4308-8c15-ad56dc96aa1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:35.188799 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f7a93-caa9-4308-8c15-ad56dc96aa1f admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:35.201955 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1396/2791] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:55:35.203242 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895d958-248f-40e2-8825-3026e412bd80 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:35.203494 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895d958-248f-40e2-8825-3026e412bd80 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:35.203786 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895d958-248f-40e2-8825-3026e412bd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:35.225231 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-1895d958-248f-40e2-8825-3026e412bd80 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:35.226444 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-1895d958-248f-40e2-8825-3026e412bd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:35.231569 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-65d6ba49-cda3-467d-a157-740eac443b1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '803a55d48c1f4b5ca335af4d5c984386'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:35.234840 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1397/2792] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:35.237087 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895d958-248f-40e2-8825-3026e412bd80 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:35.242908 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-65d6ba49-cda3-467d-a157-740eac443b1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '803a55d48c1f4b5ca335af4d5c984386'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:35.243852 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-65d6ba49-cda3-467d-a157-740eac443b1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '803a55d48c1f4b5ca335af4d5c984386'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:35.246133 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895d958-248f-40e2-8825-3026e412bd80 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:35.250739 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3790c-4759-48d6-9754-45be9fdcb3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:35.251466 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3790c-4759-48d6-9754-45be9fdcb3f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:35.251761 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3790c-4759-48d6-9754-45be9fdcb3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:35.252044 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3790c-4759-48d6-9754-45be9fdcb3f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:35.252807 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3790c-4759-48d6-9754-45be9fdcb3f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:35.254696 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3790c-4759-48d6-9754-45be9fdcb3f0 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:35.257624 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-65d6ba49-cda3-467d-a157-740eac443b1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '803a55d48c1f4b5ca335af4d5c984386'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:35.265035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-65d6ba49-cda3-467d-a157-740eac443b1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '803a55d48c1f4b5ca335af4d5c984386'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:35.271969 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1396/2793] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:55:35 2022] DELETE /identity/v3/users/803a55d48c1f4b5ca335af4d5c984386 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:35.272776 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6ba49-cda3-467d-a157-740eac443b1f admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:35.274290 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-65d6ba49-cda3-467d-a157-740eac443b1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:35.288257 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1398/2794] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:55:35 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:55:35.289966 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3790c-4759-48d6-9754-45be9fdcb3f0 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:35.291765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-67a3790c-4759-48d6-9754-45be9fdcb3f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:35.302790 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:35.312456 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:35.354866 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d6ba49-cda3-467d-a157-740eac443b1f admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:35.368428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3790c-4759-48d6-9754-45be9fdcb3f0 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:35.373700 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05790373-3407-494d-b5d8-9b3f2aae5ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:35.374389 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05790373-3407-494d-b5d8-9b3f2aae5ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:35.374769 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05790373-3407-494d-b5d8-9b3f2aae5ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:35.375649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05790373-3407-494d-b5d8-9b3f2aae5ef8 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:35.375852 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05790373-3407-494d-b5d8-9b3f2aae5ef8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:35.377965 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05790373-3407-494d-b5d8-9b3f2aae5ef8 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:35.407285 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1399/2795] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:55:35 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:55:35.408449 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05790373-3407-494d-b5d8-9b3f2aae5ef8 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:35.418659 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05790373-3407-494d-b5d8-9b3f2aae5ef8 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:35.418914 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b403024-61c8-4841-82b4-6bb5ba62e775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:35.419518 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b403024-61c8-4841-82b4-6bb5ba62e775 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:35.419830 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b403024-61c8-4841-82b4-6bb5ba62e775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:35.420094 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b403024-61c8-4841-82b4-6bb5ba62e775 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:35.420783 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b403024-61c8-4841-82b4-6bb5ba62e775 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:55:35.421035 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b403024-61c8-4841-82b4-6bb5ba62e775 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:35.422788 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b403024-61c8-4841-82b4-6bb5ba62e775 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:35.423753 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade48fa-7489-4e09-b525-41fae98b9cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:35.424826 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade48fa-7489-4e09-b525-41fae98b9cec admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:35.424826 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade48fa-7489-4e09-b525-41fae98b9cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:35.425016 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade48fa-7489-4e09-b525-41fae98b9cec admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:35.425579 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade48fa-7489-4e09-b525-41fae98b9cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:35.427211 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade48fa-7489-4e09-b525-41fae98b9cec admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:35.437158 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1397/2796] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:55:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:55:35.441391 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1400/2797] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:55:35.443031 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b403024-61c8-4841-82b4-6bb5ba62e775 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:35.444522 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade48fa-7489-4e09-b525-41fae98b9cec admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:35.456293 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b403024-61c8-4841-82b4-6bb5ba62e775 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:35.461470 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade48fa-7489-4e09-b525-41fae98b9cec admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:35.462532 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b41770-ed19-40bc-86c0-70f16d667d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:35.463207 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b41770-ed19-40bc-86c0-70f16d667d35 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:35.463428 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b41770-ed19-40bc-86c0-70f16d667d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:35.463698 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b41770-ed19-40bc-86c0-70f16d667d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:35.464381 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b41770-ed19-40bc-86c0-70f16d667d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:35.466043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b41770-ed19-40bc-86c0-70f16d667d35 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:35.466784 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e193e-c6ff-4f89-bf29-8d17c5dbdecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:35.467519 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e193e-c6ff-4f89-bf29-8d17c5dbdecb admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:35.467699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e193e-c6ff-4f89-bf29-8d17c5dbdecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:35.467991 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e193e-c6ff-4f89-bf29-8d17c5dbdecb admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:35.468670 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e193e-c6ff-4f89-bf29-8d17c5dbdecb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:35.470596 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e193e-c6ff-4f89-bf29-8d17c5dbdecb admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:35.478873 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1398/2798] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:55:35.479848 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b41770-ed19-40bc-86c0-70f16d667d35 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:35.481852 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e8b41770-ed19-40bc-86c0-70f16d667d35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:35.497294 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b41770-ed19-40bc-86c0-70f16d667d35 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:35.504570 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b39fb-88ed-4eee-86a6-b82284dda99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:35.505388 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b39fb-88ed-4eee-86a6-b82284dda99a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:35.505834 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b39fb-88ed-4eee-86a6-b82284dda99a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:35.506234 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97b39fb-88ed-4eee-86a6-b82284dda99a admin admin] PATH_INFO: `/v3/projects/8a0f97f755b741a29360772e2c99f844` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:35.506730 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1401/2799] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:55:35 2022] POST /identity/v3/projects => generated 375 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:55:35.507538 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e193e-c6ff-4f89-bf29-8d17c5dbdecb admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:35.507869 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b39fb-88ed-4eee-86a6-b82284dda99a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a0f97f755b741a29360772e2c99f844)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:35.510027 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97b39fb-88ed-4eee-86a6-b82284dda99a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:35.561145 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d97b39fb-88ed-4eee-86a6-b82284dda99a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a0f97f755b741a29360772e2c99f844', 'request_id': 'req-d97b39fb-88ed-4eee-86a6-b82284dda99a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:35.566806 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d97b39fb-88ed-4eee-86a6-b82284dda99a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a0f97f755b741a29360772e2c99f844', 'request_id': 'req-d97b39fb-88ed-4eee-86a6-b82284dda99a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:35.572258 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e193e-c6ff-4f89-bf29-8d17c5dbdecb admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:35.573184 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d97b39fb-88ed-4eee-86a6-b82284dda99a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a0f97f755b741a29360772e2c99f844', 'request_id': 'req-d97b39fb-88ed-4eee-86a6-b82284dda99a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:35.586299 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d97b39fb-88ed-4eee-86a6-b82284dda99a admin admin] The token cache is being invalidate because project 8a0f97f755b741a29360772e2c99f844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:55:35.586613 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d97b39fb-88ed-4eee-86a6-b82284dda99a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:35.587240 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d97b39fb-88ed-4eee-86a6-b82284dda99a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:35.588774 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1399/2800] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:55:35 2022] DELETE /identity/v3/projects/8a0f97f755b741a29360772e2c99f844 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:35.589576 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b39fb-88ed-4eee-86a6-b82284dda99a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:35.590915 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d97b39fb-88ed-4eee-86a6-b82284dda99a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:35.635629 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde2c3c-5794-4381-9f76-5872bf2009ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:35.636373 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde2c3c-5794-4381-9f76-5872bf2009ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:35.636651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde2c3c-5794-4381-9f76-5872bf2009ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:35.636927 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde2c3c-5794-4381-9f76-5872bf2009ae admin admin] PATH_INFO: `/v3/projects/a86319e16d7643758c8313cf932ec528/users/b631999267524bd3829f5e876987e961/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:35.648989 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:35.659325 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde2c3c-5794-4381-9f76-5872bf2009ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=a86319e16d7643758c8313cf932ec528, user_id=b631999267524bd3829f5e876987e961, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:35.664767 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcde2c3c-5794-4381-9f76-5872bf2009ae admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:35.669450 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:35.676901 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97b39fb-88ed-4eee-86a6-b82284dda99a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:35.688046 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1402/2801] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:55:35 2022] PUT /identity/v3/projects/a86319e16d7643758c8313cf932ec528/users/b631999267524bd3829f5e876987e961/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:35.698892 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bdee4-432c-4d10-b48e-b09cb045cd03 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:35.699154 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bdee4-432c-4d10-b48e-b09cb045cd03 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:35.699426 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bdee4-432c-4d10-b48e-b09cb045cd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:35.736128 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-012bdee4-432c-4d10-b48e-b09cb045cd03 None None] MFA Rules not processed for user `b631999267524bd3829f5e876987e961`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:35.737617 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-012bdee4-432c-4d10-b48e-b09cb045cd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:35.750577 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8cf80-9e48-4f11-86c9-368dd2ba0a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:35.751344 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8cf80-9e48-4f11-86c9-368dd2ba0a2d admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:35.751691 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8cf80-9e48-4f11-86c9-368dd2ba0a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:35.752168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8cf80-9e48-4f11-86c9-368dd2ba0a2d admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:35.752767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd8cf80-9e48-4f11-86c9-368dd2ba0a2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:35.755268 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd8cf80-9e48-4f11-86c9-368dd2ba0a2d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:35.781374 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1400/2802] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:55:35 2022] POST /identity/v3/users => generated 288 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:55:35.785811 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8cf80-9e48-4f11-86c9-368dd2ba0a2d admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:35.804842 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8cf80-9e48-4f11-86c9-368dd2ba0a2d admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:35.809795 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d03297-1901-4b21-af81-1d003446038e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:35.810427 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d03297-1901-4b21-af81-1d003446038e admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:35.810699 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d03297-1901-4b21-af81-1d003446038e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:35.810967 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d03297-1901-4b21-af81-1d003446038e admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:35.811617 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d03297-1901-4b21-af81-1d003446038e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:35.813301 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d03297-1901-4b21-af81-1d003446038e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:35.825296 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1401/2803] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:55:35.826406 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1403/2804] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:35.829137 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d03297-1901-4b21-af81-1d003446038e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:35.830896 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bdee4-432c-4d10-b48e-b09cb045cd03 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:35.832490 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-012bdee4-432c-4d10-b48e-b09cb045cd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:35.839772 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d03297-1901-4b21-af81-1d003446038e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:35.845394 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f2e45-9b0c-4a1e-9c75-00c883142875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:35.846051 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f2e45-9b0c-4a1e-9c75-00c883142875 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:35.846473 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f2e45-9b0c-4a1e-9c75-00c883142875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:35.846735 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f2e45-9b0c-4a1e-9c75-00c883142875 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:35.847232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bdee4-432c-4d10-b48e-b09cb045cd03 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:35.847353 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f2e45-9b0c-4a1e-9c75-00c883142875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:35.849253 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f2e45-9b0c-4a1e-9c75-00c883142875 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:35.853082 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd21fc-17cb-4318-80ac-b15db03df52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:35.853877 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd21fc-17cb-4318-80ac-b15db03df52c admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:35.854244 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd21fc-17cb-4318-80ac-b15db03df52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:35.854607 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd21fc-17cb-4318-80ac-b15db03df52c admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:35.855359 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd21fc-17cb-4318-80ac-b15db03df52c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:35.857458 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd21fc-17cb-4318-80ac-b15db03df52c admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:35.862456 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1402/2805] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:55:35.866811 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f2e45-9b0c-4a1e-9c75-00c883142875 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:35.877122 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f2e45-9b0c-4a1e-9c75-00c883142875 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:35.882123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95df6b9-7b0f-4130-af13-eb8e9b3f20b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:35.882960 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95df6b9-7b0f-4130-af13-eb8e9b3f20b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:35.883188 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95df6b9-7b0f-4130-af13-eb8e9b3f20b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:35.883452 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95df6b9-7b0f-4130-af13-eb8e9b3f20b7 admin admin] PATH_INFO: `/v3/projects/d9d87fe9827d4440b568a5ca5ef84812/users/001e119eeb774965a45bc34384e477b3/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:35.888010 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1404/2806] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:55:35 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:55:35.892252 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd21fc-17cb-4318-80ac-b15db03df52c admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:35.899439 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95df6b9-7b0f-4130-af13-eb8e9b3f20b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9d87fe9827d4440b568a5ca5ef84812, user_id=001e119eeb774965a45bc34384e477b3, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:35.902098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95df6b9-7b0f-4130-af13-eb8e9b3f20b7 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:35.916090 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1403/2807] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:55:35 2022] PUT /identity/v3/projects/d9d87fe9827d4440b568a5ca5ef84812/users/001e119eeb774965a45bc34384e477b3/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 05:55:35.921027 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cca90-ee60-46a3-9d29-8de9ed15e8f8 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:35.921295 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cca90-ee60-46a3-9d29-8de9ed15e8f8 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:35.921564 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cca90-ee60-46a3-9d29-8de9ed15e8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:35.939997 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-1e0cca90-ee60-46a3-9d29-8de9ed15e8f8 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:35.941194 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1e0cca90-ee60-46a3-9d29-8de9ed15e8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:35.957008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd21fc-17cb-4318-80ac-b15db03df52c admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:36.003764 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1404/2808] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:55:36.013838 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0cca90-ee60-46a3-9d29-8de9ed15e8f8 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:36.015213 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1e0cca90-ee60-46a3-9d29-8de9ed15e8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:36.018483 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04893a-e2ae-4146-a849-a20b27a05979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:36.019130 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04893a-e2ae-4146-a849-a20b27a05979 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:36.019404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04893a-e2ae-4146-a849-a20b27a05979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:36.019674 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04893a-e2ae-4146-a849-a20b27a05979 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:36.020747 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04893a-e2ae-4146-a849-a20b27a05979 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:36.023363 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04893a-e2ae-4146-a849-a20b27a05979 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:36.043629 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:36.051036 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1405/2809] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:55:35 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:55:36.055368 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04893a-e2ae-4146-a849-a20b27a05979 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:36.058812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:36.067185 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04893a-e2ae-4146-a849-a20b27a05979 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:36.071986 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f404b-0894-4e45-808b-490dc588aa59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:36.072593 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f404b-0894-4e45-808b-490dc588aa59 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:36.072901 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f404b-0894-4e45-808b-490dc588aa59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:36.073186 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f404b-0894-4e45-808b-490dc588aa59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:36.073853 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f404b-0894-4e45-808b-490dc588aa59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:36.075505 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8f404b-0894-4e45-808b-490dc588aa59 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:36.077351 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0cca90-ee60-46a3-9d29-8de9ed15e8f8 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:36.081066 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a295c9-36a6-4edf-a6ff-5cbeb04d93f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:36.081710 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a295c9-36a6-4edf-a6ff-5cbeb04d93f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:36.081984 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a295c9-36a6-4edf-a6ff-5cbeb04d93f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:36.082252 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a295c9-36a6-4edf-a6ff-5cbeb04d93f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:36.085851 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1406/2810] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:55:36.090069 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f404b-0894-4e45-808b-490dc588aa59 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:36.094419 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a295c9-36a6-4edf-a6ff-5cbeb04d93f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:36.096072 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a295c9-36a6-4edf-a6ff-5cbeb04d93f7 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:36.099807 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8f404b-0894-4e45-808b-490dc588aa59 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:36.104597 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975a163-688e-4b43-bf71-039a7828e5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:36.105265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975a163-688e-4b43-bf71-039a7828e5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:36.105542 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975a163-688e-4b43-bf71-039a7828e5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:36.105811 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975a163-688e-4b43-bf71-039a7828e5f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:36.106356 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1405/2811] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:55:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:55:36.106504 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975a163-688e-4b43-bf71-039a7828e5f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:36.108214 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975a163-688e-4b43-bf71-039a7828e5f7 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:36.119404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1407/2812] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:55:36.123898 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a295c9-36a6-4edf-a6ff-5cbeb04d93f7 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:36.134050 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a295c9-36a6-4edf-a6ff-5cbeb04d93f7 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:36.139254 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41c751-4b96-4311-8831-277b37ba62d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:36.139939 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41c751-4b96-4311-8831-277b37ba62d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:36.140215 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41c751-4b96-4311-8831-277b37ba62d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:36.140505 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41c751-4b96-4311-8831-277b37ba62d4 admin admin] PATH_INFO: `/v3/projects/a8752ca4f20c4b8f80e5efc8888db42a/users/2c9b51c491a44c5e8d617532bd847e94/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:36.157143 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41c751-4b96-4311-8831-277b37ba62d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8752ca4f20c4b8f80e5efc8888db42a, user_id=2c9b51c491a44c5e8d617532bd847e94, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:36.159865 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41c751-4b96-4311-8831-277b37ba62d4 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:36.175952 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1406/2813] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:55:36 2022] PUT /identity/v3/projects/a8752ca4f20c4b8f80e5efc8888db42a/users/2c9b51c491a44c5e8d617532bd847e94/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:36.188353 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13c6f0-62f1-4916-8dba-2629b6f2722b None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:36.188595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13c6f0-62f1-4916-8dba-2629b6f2722b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:36.188917 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13c6f0-62f1-4916-8dba-2629b6f2722b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:36.223338 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-ab13c6f0-62f1-4916-8dba-2629b6f2722b None None] MFA Rules not processed for user `2c9b51c491a44c5e8d617532bd847e94`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:36.224756 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ab13c6f0-62f1-4916-8dba-2629b6f2722b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:36.314309 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1408/2814] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:36.319206 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41c751-4b96-4311-8831-277b37ba62d4 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:36.383620 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41c751-4b96-4311-8831-277b37ba62d4 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:36.388941 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca29da-294b-491a-a1f5-43820d9f7319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:36.389732 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca29da-294b-491a-a1f5-43820d9f7319 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:36.390188 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca29da-294b-491a-a1f5-43820d9f7319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:36.390626 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ca29da-294b-491a-a1f5-43820d9f7319 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:36.391268 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca29da-294b-491a-a1f5-43820d9f7319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:36.393347 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ca29da-294b-491a-a1f5-43820d9f7319 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:36.422236 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1407/2815] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:55:36 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:55:36.426410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13c6f0-62f1-4916-8dba-2629b6f2722b None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:36.437892 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13c6f0-62f1-4916-8dba-2629b6f2722b None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:36.515986 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203250db-6cf9-4bd4-92f1-37510f6c9556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:36.516670 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203250db-6cf9-4bd4-92f1-37510f6c9556 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:36.516950 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203250db-6cf9-4bd4-92f1-37510f6c9556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:36.517217 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203250db-6cf9-4bd4-92f1-37510f6c9556 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:36.517893 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203250db-6cf9-4bd4-92f1-37510f6c9556 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:36.520187 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203250db-6cf9-4bd4-92f1-37510f6c9556 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:36.548428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1409/2816] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:55:36 2022] POST /identity/v3/users => generated 299 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:55:36.553404 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca29da-294b-491a-a1f5-43820d9f7319 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:36.566185 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ca29da-294b-491a-a1f5-43820d9f7319 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:36.572221 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401dc5f-6a4d-4d26-aca2-f779bcf2fdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:36.573203 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401dc5f-6a4d-4d26-aca2-f779bcf2fdf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:36.573536 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401dc5f-6a4d-4d26-aca2-f779bcf2fdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:36.573870 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401dc5f-6a4d-4d26-aca2-f779bcf2fdf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:36.574648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d401dc5f-6a4d-4d26-aca2-f779bcf2fdf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:36.576555 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d401dc5f-6a4d-4d26-aca2-f779bcf2fdf8 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:36.596211 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1408/2817] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 26 05:55:36.597662 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203250db-6cf9-4bd4-92f1-37510f6c9556 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:36.610758 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203250db-6cf9-4bd4-92f1-37510f6c9556 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:36.617025 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd31c6f-20a2-4a13-ad43-24afcc7cfe02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:36.617725 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd31c6f-20a2-4a13-ad43-24afcc7cfe02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:36.618019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd31c6f-20a2-4a13-ad43-24afcc7cfe02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:36.618280 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd31c6f-20a2-4a13-ad43-24afcc7cfe02 admin admin] PATH_INFO: `/v3/projects/ae05a4cb5b2a4887b7449e763a6e23c5/users/35a31f16d5ec49929bb6f8dde48397a8/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:36.639110 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd31c6f-20a2-4a13-ad43-24afcc7cfe02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae05a4cb5b2a4887b7449e763a6e23c5, user_id=35a31f16d5ec49929bb6f8dde48397a8, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:36.642365 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd31c6f-20a2-4a13-ad43-24afcc7cfe02 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:36.658063 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1410/2818] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:55:36 2022] PUT /identity/v3/projects/ae05a4cb5b2a4887b7449e763a6e23c5/users/35a31f16d5ec49929bb6f8dde48397a8/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:36.662323 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401dc5f-6a4d-4d26-aca2-f779bcf2fdf8 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:36.673282 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401dc5f-6a4d-4d26-aca2-f779bcf2fdf8 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:36.740464 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51bbb9-0b1a-46fe-9dbc-81129f197862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:36.741073 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51bbb9-0b1a-46fe-9dbc-81129f197862 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:36.741367 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51bbb9-0b1a-46fe-9dbc-81129f197862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:36.741799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51bbb9-0b1a-46fe-9dbc-81129f197862 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:36.742437 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51bbb9-0b1a-46fe-9dbc-81129f197862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:36.744082 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51bbb9-0b1a-46fe-9dbc-81129f197862 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:36.754338 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1409/2819] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:55:36.758920 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd31c6f-20a2-4a13-ad43-24afcc7cfe02 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:36.773749 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd31c6f-20a2-4a13-ad43-24afcc7cfe02 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:36.779395 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55308a-2c4e-4d43-ba49-bdda6cd88f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:36.780200 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55308a-2c4e-4d43-ba49-bdda6cd88f09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:36.780598 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55308a-2c4e-4d43-ba49-bdda6cd88f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:36.780874 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55308a-2c4e-4d43-ba49-bdda6cd88f09 admin admin] PATH_INFO: `/v3/projects/ae05a4cb5b2a4887b7449e763a6e23c5/users/35a31f16d5ec49929bb6f8dde48397a8/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:36.783091 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55308a-2c4e-4d43-ba49-bdda6cd88f09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae05a4cb5b2a4887b7449e763a6e23c5, user_id=35a31f16d5ec49929bb6f8dde48397a8, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:36.785974 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55308a-2c4e-4d43-ba49-bdda6cd88f09 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:36.799054 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1411/2820] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:55:36 2022] PUT /identity/v3/projects/ae05a4cb5b2a4887b7449e763a6e23c5/users/35a31f16d5ec49929bb6f8dde48397a8/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:36.809079 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d23e59-160c-48b4-860d-8bcfc02186de None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:36.809450 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d23e59-160c-48b4-860d-8bcfc02186de None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:36.809979 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d23e59-160c-48b4-860d-8bcfc02186de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:36.842952 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-e8d23e59-160c-48b4-860d-8bcfc02186de None None] MFA Rules not processed for user `35a31f16d5ec49929bb6f8dde48397a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:36.844843 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e8d23e59-160c-48b4-860d-8bcfc02186de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:36.855024 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:36.922481 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1410/2821] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:36 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:36.934761 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55308a-2c4e-4d43-ba49-bdda6cd88f09 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:36.936798 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5c55308a-2c4e-4d43-ba49-bdda6cd88f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:36.966355 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:37.002009 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55308a-2c4e-4d43-ba49-bdda6cd88f09 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:37.005938 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4ee1f-2abc-40a9-bca9-53e85d76c58a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:37.006563 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4ee1f-2abc-40a9-bca9-53e85d76c58a service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:37.006838 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4ee1f-2abc-40a9-bca9-53e85d76c58a service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:37.007106 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4ee1f-2abc-40a9-bca9-53e85d76c58a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:37.081865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4ee1f-2abc-40a9-bca9-53e85d76c58a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:37.083361 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda4ee1f-2abc-40a9-bca9-53e85d76c58a service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:37.093934 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1412/2822] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:55:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:55:38.749285 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d23e59-160c-48b4-860d-8bcfc02186de None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:38.750953 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e8d23e59-160c-48b4-860d-8bcfc02186de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:38.766875 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d23e59-160c-48b4-860d-8bcfc02186de None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:38.771207 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78d0f6-19b3-458c-83ed-b5f2d4c7115f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:38.771871 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78d0f6-19b3-458c-83ed-b5f2d4c7115f service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:38.772144 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78d0f6-19b3-458c-83ed-b5f2d4c7115f service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:38.772431 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78d0f6-19b3-458c-83ed-b5f2d4c7115f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:38.891813 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78d0f6-19b3-458c-83ed-b5f2d4c7115f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:38.893436 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78d0f6-19b3-458c-83ed-b5f2d4c7115f service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:38.911253 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1411/2823] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:55:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:55:39.608792 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4ee1f-2abc-40a9-bca9-53e85d76c58a service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:39.620765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4ee1f-2abc-40a9-bca9-53e85d76c58a service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:39.626426 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51925a-7314-4835-a824-05de8ffef3c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:39.627150 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51925a-7314-4835-a824-05de8ffef3c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:39.627490 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51925a-7314-4835-a824-05de8ffef3c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:39.627897 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51925a-7314-4835-a824-05de8ffef3c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:39.641232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51925a-7314-4835-a824-05de8ffef3c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:39.643371 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51925a-7314-4835-a824-05de8ffef3c0 service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:39.659491 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1413/2824] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:55:39 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:55:40.488212 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f9fa9-23e4-4fdf-a0df-f888267f3c21 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:40.488733 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f9fa9-23e4-4fdf-a0df-f888267f3c21 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:40.488733 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f9fa9-23e4-4fdf-a0df-f888267f3c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:40.523270 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-661f9fa9-23e4-4fdf-a0df-f888267f3c21 None None] MFA Rules not processed for user `001e119eeb774965a45bc34384e477b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:40.525120 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-661f9fa9-23e4-4fdf-a0df-f888267f3c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:40.629479 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1412/2825] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:40.650222 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51925a-7314-4835-a824-05de8ffef3c0 service cinder] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:40.651893 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2c51925a-7314-4835-a824-05de8ffef3c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:40.737159 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51925a-7314-4835-a824-05de8ffef3c0 service cinder] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:40.743483 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234a6ad-2f98-4a91-b08e-e8bff9a0601e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:40.744134 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234a6ad-2f98-4a91-b08e-e8bff9a0601e service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:40.744403 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234a6ad-2f98-4a91-b08e-e8bff9a0601e service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:40.744662 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234a6ad-2f98-4a91-b08e-e8bff9a0601e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:40.753338 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3234a6ad-2f98-4a91-b08e-e8bff9a0601e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:40.754984 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3234a6ad-2f98-4a91-b08e-e8bff9a0601e service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:40.764906 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1414/2826] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:55:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:55:42.368999 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2889408-3925-426b-b947-db5fe8344702 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:42.369791 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2889408-3925-426b-b947-db5fe8344702 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:42.369791 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2889408-3925-426b-b947-db5fe8344702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:42.399587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-f2889408-3925-426b-b947-db5fe8344702 None None] MFA Rules not processed for user `001e119eeb774965a45bc34384e477b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:42.399587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-f2889408-3925-426b-b947-db5fe8344702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:42.409777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1413/2827] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:43.847072 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234a6ad-2f98-4a91-b08e-e8bff9a0601e service nova] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:43.902218 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=100 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:43.940507 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234a6ad-2f98-4a91-b08e-e8bff9a0601e service nova] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:43.949969 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab90bf-a426-4dd5-b2a9-668bdf2543d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:43.951679 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab90bf-a426-4dd5-b2a9-668bdf2543d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:43.952482 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab90bf-a426-4dd5-b2a9-668bdf2543d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:43.953189 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab90bf-a426-4dd5-b2a9-668bdf2543d5 admin admin] PATH_INFO: `/v3/users/b631999267524bd3829f5e876987e961` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:43.954835 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab90bf-a426-4dd5-b2a9-668bdf2543d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b631999267524bd3829f5e876987e961)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:43.957116 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab90bf-a426-4dd5-b2a9-668bdf2543d5 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:44.019062 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e3ab90bf-a426-4dd5-b2a9-668bdf2543d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b631999267524bd3829f5e876987e961'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:44.031042 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e3ab90bf-a426-4dd5-b2a9-668bdf2543d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b631999267524bd3829f5e876987e961'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:44.048391 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e3ab90bf-a426-4dd5-b2a9-668bdf2543d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b631999267524bd3829f5e876987e961'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:44.049285 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e3ab90bf-a426-4dd5-b2a9-668bdf2543d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b631999267524bd3829f5e876987e961'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:44.059726 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e3ab90bf-a426-4dd5-b2a9-668bdf2543d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b631999267524bd3829f5e876987e961'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:44.068383 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1415/2828] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:55:43 2022] DELETE /identity/v3/users/b631999267524bd3829f5e876987e961 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:44.072940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bac0a-87f8-4d21-88e7-dbbfdba64f74 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:44.074022 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bac0a-87f8-4d21-88e7-dbbfdba64f74 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:44.074406 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bac0a-87f8-4d21-88e7-dbbfdba64f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:44.102531 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c91bac0a-87f8-4d21-88e7-dbbfdba64f74 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:44.103791 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c91bac0a-87f8-4d21-88e7-dbbfdba64f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:44.129641 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=100 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:44.188537 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1414/2829] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 05:55:44.199422 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab90bf-a426-4dd5-b2a9-668bdf2543d5 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:44.202909 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e3ab90bf-a426-4dd5-b2a9-668bdf2543d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:44.276209 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab90bf-a426-4dd5-b2a9-668bdf2543d5 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:44.283913 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fed15-ef56-46db-8e87-184ec0e08ad9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:44.284543 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fed15-ef56-46db-8e87-184ec0e08ad9 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:44.284820 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fed15-ef56-46db-8e87-184ec0e08ad9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:44.285087 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fed15-ef56-46db-8e87-184ec0e08ad9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:44.298014 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67fed15-ef56-46db-8e87-184ec0e08ad9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:44.299467 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67fed15-ef56-46db-8e87-184ec0e08ad9 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:44.313862 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1416/2830] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:55:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:55:44.765139 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bac0a-87f8-4d21-88e7-dbbfdba64f74 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:44.766801 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c91bac0a-87f8-4d21-88e7-dbbfdba64f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:44.781728 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bac0a-87f8-4d21-88e7-dbbfdba64f74 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:44.787118 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d9f71-acd5-4f2c-ad12-07423d9d197a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:44.787893 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d9f71-acd5-4f2c-ad12-07423d9d197a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:44.788116 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d9f71-acd5-4f2c-ad12-07423d9d197a admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:44.788342 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d9f71-acd5-4f2c-ad12-07423d9d197a admin admin] PATH_INFO: `/v3/projects/a86319e16d7643758c8313cf932ec528` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:44.789627 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d9f71-acd5-4f2c-ad12-07423d9d197a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a86319e16d7643758c8313cf932ec528)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:44.802137 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d9f71-acd5-4f2c-ad12-07423d9d197a admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:44.871358 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0f3d9f71-acd5-4f2c-ad12-07423d9d197a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a86319e16d7643758c8313cf932ec528', 'request_id': 'req-0f3d9f71-acd5-4f2c-ad12-07423d9d197a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:44.885007 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0f3d9f71-acd5-4f2c-ad12-07423d9d197a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a86319e16d7643758c8313cf932ec528', 'request_id': 'req-0f3d9f71-acd5-4f2c-ad12-07423d9d197a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:44.892947 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0f3d9f71-acd5-4f2c-ad12-07423d9d197a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a86319e16d7643758c8313cf932ec528', 'request_id': 'req-0f3d9f71-acd5-4f2c-ad12-07423d9d197a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:44.911038 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0f3d9f71-acd5-4f2c-ad12-07423d9d197a admin admin] The token cache is being invalidate because project a86319e16d7643758c8313cf932ec528 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:55:44.911914 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0f3d9f71-acd5-4f2c-ad12-07423d9d197a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:44.912859 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-0f3d9f71-acd5-4f2c-ad12-07423d9d197a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:44.914586 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1415/2831] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:55:44 2022] DELETE /identity/v3/projects/a86319e16d7643758c8313cf932ec528 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:44.919121 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fed15-ef56-46db-8e87-184ec0e08ad9 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:44.930393 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fed15-ef56-46db-8e87-184ec0e08ad9 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:45.002774 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a2df7-386b-43a2-a427-0964d8df5769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:45.003566 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a2df7-386b-43a2-a427-0964d8df5769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:45.003886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a2df7-386b-43a2-a427-0964d8df5769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:45.004265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a2df7-386b-43a2-a427-0964d8df5769 admin admin] PATH_INFO: `/v3/users/2c9b51c491a44c5e8d617532bd847e94` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:45.005580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323a2df7-386b-43a2-a427-0964d8df5769 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c9b51c491a44c5e8d617532bd847e94)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:45.007649 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323a2df7-386b-43a2-a427-0964d8df5769 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:45.020380 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:45.087778 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-323a2df7-386b-43a2-a427-0964d8df5769 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c9b51c491a44c5e8d617532bd847e94'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:45.099825 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-323a2df7-386b-43a2-a427-0964d8df5769 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c9b51c491a44c5e8d617532bd847e94'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:45.116651 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-323a2df7-386b-43a2-a427-0964d8df5769 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c9b51c491a44c5e8d617532bd847e94'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:45.117913 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-323a2df7-386b-43a2-a427-0964d8df5769 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c9b51c491a44c5e8d617532bd847e94'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:45.129777 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-323a2df7-386b-43a2-a427-0964d8df5769 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c9b51c491a44c5e8d617532bd847e94'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:45.146606 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1417/2832] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:55:44 2022] DELETE /identity/v3/users/2c9b51c491a44c5e8d617532bd847e94 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:45.488916 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d9f71-acd5-4f2c-ad12-07423d9d197a admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:45.491638 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-0f3d9f71-acd5-4f2c-ad12-07423d9d197a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:45.515354 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d9f71-acd5-4f2c-ad12-07423d9d197a admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:45.605143 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b609cc1-1392-458a-b679-ef2b73657548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:45.606151 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b609cc1-1392-458a-b679-ef2b73657548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:45.606647 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b609cc1-1392-458a-b679-ef2b73657548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:45.607405 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b609cc1-1392-458a-b679-ef2b73657548 admin admin] PATH_INFO: `/v3/projects/a8752ca4f20c4b8f80e5efc8888db42a` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:45.609099 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b609cc1-1392-458a-b679-ef2b73657548 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8752ca4f20c4b8f80e5efc8888db42a)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:45.611350 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b609cc1-1392-458a-b679-ef2b73657548 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:45.665962 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1b609cc1-1392-458a-b679-ef2b73657548 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8752ca4f20c4b8f80e5efc8888db42a', 'request_id': 'req-1b609cc1-1392-458a-b679-ef2b73657548'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:45.668021 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:45.672470 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1b609cc1-1392-458a-b679-ef2b73657548 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8752ca4f20c4b8f80e5efc8888db42a', 'request_id': 'req-1b609cc1-1392-458a-b679-ef2b73657548'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:45.682232 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1b609cc1-1392-458a-b679-ef2b73657548 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8752ca4f20c4b8f80e5efc8888db42a', 'request_id': 'req-1b609cc1-1392-458a-b679-ef2b73657548'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:45.696999 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1b609cc1-1392-458a-b679-ef2b73657548 admin admin] The token cache is being invalidate because project a8752ca4f20c4b8f80e5efc8888db42a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:55:45.697286 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1b609cc1-1392-458a-b679-ef2b73657548 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:45.698082 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-1b609cc1-1392-458a-b679-ef2b73657548 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:45.702872 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1416/2833] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:55:45 2022] DELETE /identity/v3/projects/a8752ca4f20c4b8f80e5efc8888db42a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:45.704239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a2df7-386b-43a2-a427-0964d8df5769 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:45.706322 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-323a2df7-386b-43a2-a427-0964d8df5769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:45.724975 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323a2df7-386b-43a2-a427-0964d8df5769 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:45.815976 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbbc92-2026-4cb4-82ee-172e3d8faf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:45.816614 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbbc92-2026-4cb4-82ee-172e3d8faf10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:45.816882 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbbc92-2026-4cb4-82ee-172e3d8faf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:45.817171 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbbc92-2026-4cb4-82ee-172e3d8faf10 admin admin] PATH_INFO: `/v3/users/35a31f16d5ec49929bb6f8dde48397a8` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:45.818395 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cbbc92-2026-4cb4-82ee-172e3d8faf10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35a31f16d5ec49929bb6f8dde48397a8)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:45.820502 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cbbc92-2026-4cb4-82ee-172e3d8faf10 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:45.872643 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-96cbbc92-2026-4cb4-82ee-172e3d8faf10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35a31f16d5ec49929bb6f8dde48397a8'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:45.880569 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-96cbbc92-2026-4cb4-82ee-172e3d8faf10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35a31f16d5ec49929bb6f8dde48397a8'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:45.895203 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-96cbbc92-2026-4cb4-82ee-172e3d8faf10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35a31f16d5ec49929bb6f8dde48397a8'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:45.896126 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-96cbbc92-2026-4cb4-82ee-172e3d8faf10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35a31f16d5ec49929bb6f8dde48397a8'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:45.903543 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-96cbbc92-2026-4cb4-82ee-172e3d8faf10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35a31f16d5ec49929bb6f8dde48397a8'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:45.910258 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1418/2834] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:55:45 2022] DELETE /identity/v3/users/35a31f16d5ec49929bb6f8dde48397a8 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:46.388565 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b609cc1-1392-458a-b679-ef2b73657548 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:46.395962 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-1b609cc1-1392-458a-b679-ef2b73657548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:46.410620 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b609cc1-1392-458a-b679-ef2b73657548 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:46.469388 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbbc92-2026-4cb4-82ee-172e3d8faf10 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:46.471764 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-96cbbc92-2026-4cb4-82ee-172e3d8faf10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:46.486190 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:46.488470 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae8665-67fd-4613-8fe5-11c7e4a971f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:46.489340 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae8665-67fd-4613-8fe5-11c7e4a971f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:46.489936 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae8665-67fd-4613-8fe5-11c7e4a971f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:46.489936 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae8665-67fd-4613-8fe5-11c7e4a971f7 admin admin] PATH_INFO: `/v3/projects/ae05a4cb5b2a4887b7449e763a6e23c5` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:46.491217 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae8665-67fd-4613-8fe5-11c7e4a971f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae05a4cb5b2a4887b7449e763a6e23c5)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:46.493957 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae8665-67fd-4613-8fe5-11c7e4a971f7 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:46.556799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-aaae8665-67fd-4613-8fe5-11c7e4a971f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae05a4cb5b2a4887b7449e763a6e23c5', 'request_id': 'req-aaae8665-67fd-4613-8fe5-11c7e4a971f7'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:46.564841 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-aaae8665-67fd-4613-8fe5-11c7e4a971f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae05a4cb5b2a4887b7449e763a6e23c5', 'request_id': 'req-aaae8665-67fd-4613-8fe5-11c7e4a971f7'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:46.574807 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-aaae8665-67fd-4613-8fe5-11c7e4a971f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae05a4cb5b2a4887b7449e763a6e23c5', 'request_id': 'req-aaae8665-67fd-4613-8fe5-11c7e4a971f7'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:46.584631 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbbc92-2026-4cb4-82ee-172e3d8faf10 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:46.593687 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-aaae8665-67fd-4613-8fe5-11c7e4a971f7 admin admin] The token cache is being invalidate because project ae05a4cb5b2a4887b7449e763a6e23c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:55:46.594720 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-aaae8665-67fd-4613-8fe5-11c7e4a971f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:46.596171 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-aaae8665-67fd-4613-8fe5-11c7e4a971f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:46.599819 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1417/2835] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:55:46 2022] DELETE /identity/v3/projects/ae05a4cb5b2a4887b7449e763a6e23c5 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:46.609790 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a1f19-da3a-4fc9-8fd6-30967e53fe07 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:46.610283 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a1f19-da3a-4fc9-8fd6-30967e53fe07 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:46.611312 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a1f19-da3a-4fc9-8fd6-30967e53fe07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:46.637638 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-468a1f19-da3a-4fc9-8fd6-30967e53fe07 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:46.639233 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-468a1f19-da3a-4fc9-8fd6-30967e53fe07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:46.686632 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5b449-95cc-4062-8b1e-cb094362d861 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:46.687327 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5b449-95cc-4062-8b1e-cb094362d861 service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:46.687543 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5b449-95cc-4062-8b1e-cb094362d861 service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:46.687843 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5b449-95cc-4062-8b1e-cb094362d861 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:46.689805 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-bab5b449-95cc-4062-8b1e-cb094362d861 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:46.703125 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5b449-95cc-4062-8b1e-cb094362d861 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:46.705270 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab5b449-95cc-4062-8b1e-cb094362d861 service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:46.717858 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1419/2836] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:55:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:55:46.734645 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1418/2837] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:46.743221 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc9289-69b7-4703-bf5c-2e7b125e7b75 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:46.743495 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc9289-69b7-4703-bf5c-2e7b125e7b75 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:46.743779 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc9289-69b7-4703-bf5c-2e7b125e7b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:46.767914 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-31bc9289-69b7-4703-bf5c-2e7b125e7b75 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:46.769169 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-31bc9289-69b7-4703-bf5c-2e7b125e7b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:46.781348 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1420/2838] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:46.797435 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a1f19-da3a-4fc9-8fd6-30967e53fe07 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:46.812155 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a1f19-da3a-4fc9-8fd6-30967e53fe07 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:46.817266 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606f5a1-ec94-48e3-a70e-c49d795d6721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:46.818265 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606f5a1-ec94-48e3-a70e-c49d795d6721 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:46.818605 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606f5a1-ec94-48e3-a70e-c49d795d6721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:46.818964 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606f5a1-ec94-48e3-a70e-c49d795d6721 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:46.819888 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e606f5a1-ec94-48e3-a70e-c49d795d6721 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 05:55:46.820206 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e606f5a1-ec94-48e3-a70e-c49d795d6721 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:46.822376 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e606f5a1-ec94-48e3-a70e-c49d795d6721 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:46.836758 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:46.848917 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1419/2839] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 05:55:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 05:55:46.854317 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc9289-69b7-4703-bf5c-2e7b125e7b75 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:46.867914 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc9289-69b7-4703-bf5c-2e7b125e7b75 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:46.873026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b19b6-ae2a-496a-b2bf-ac3eb972d43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:46.873654 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b19b6-ae2a-496a-b2bf-ac3eb972d43d admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:46.873921 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b19b6-ae2a-496a-b2bf-ac3eb972d43d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:46.874181 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b19b6-ae2a-496a-b2bf-ac3eb972d43d admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:46.875108 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b19b6-ae2a-496a-b2bf-ac3eb972d43d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:46.877267 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b19b6-ae2a-496a-b2bf-ac3eb972d43d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:46.911320 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1421/2840] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 05:55:46 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 05:55:46.915532 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606f5a1-ec94-48e3-a70e-c49d795d6721 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:46.926032 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606f5a1-ec94-48e3-a70e-c49d795d6721 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:46.996654 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93aaba2-aa45-4ad8-8b44-44de884b466b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:46.997293 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93aaba2-aa45-4ad8-8b44-44de884b466b admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:46.997566 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93aaba2-aa45-4ad8-8b44-44de884b466b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:46.997972 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93aaba2-aa45-4ad8-8b44-44de884b466b admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:46.998614 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93aaba2-aa45-4ad8-8b44-44de884b466b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:47.000611 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93aaba2-aa45-4ad8-8b44-44de884b466b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:47.036769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1420/2841] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 05:55:46 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 05:55:47.041253 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b19b6-ae2a-496a-b2bf-ac3eb972d43d admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:47.063001 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b19b6-ae2a-496a-b2bf-ac3eb972d43d admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:47.069450 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c418b9-e679-4aaa-9d5c-887c367ffd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:47.070173 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c418b9-e679-4aaa-9d5c-887c367ffd6c admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:47.070507 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c418b9-e679-4aaa-9d5c-887c367ffd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:47.070756 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c418b9-e679-4aaa-9d5c-887c367ffd6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:47.071404 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c418b9-e679-4aaa-9d5c-887c367ffd6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:47.073145 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c418b9-e679-4aaa-9d5c-887c367ffd6c admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:47.084653 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1422/2842] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:55:47.088991 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93aaba2-aa45-4ad8-8b44-44de884b466b admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:47.099296 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93aaba2-aa45-4ad8-8b44-44de884b466b admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:47.103911 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c735b97-3b22-44d7-a331-c372ffb1acb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:47.104512 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c735b97-3b22-44d7-a331-c372ffb1acb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:47.104788 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c735b97-3b22-44d7-a331-c372ffb1acb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:47.105056 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c735b97-3b22-44d7-a331-c372ffb1acb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:47.105690 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c735b97-3b22-44d7-a331-c372ffb1acb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:47.107306 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c735b97-3b22-44d7-a331-c372ffb1acb4 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:47.120360 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1421/2843] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 05:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 05:55:47.125069 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c418b9-e679-4aaa-9d5c-887c367ffd6c admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:47.138699 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c418b9-e679-4aaa-9d5c-887c367ffd6c admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:47.146045 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562a219-d5de-4f64-ad72-df05ea54dd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:47.146718 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562a219-d5de-4f64-ad72-df05ea54dd94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:47.146993 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562a219-d5de-4f64-ad72-df05ea54dd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:47.147266 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562a219-d5de-4f64-ad72-df05ea54dd94 admin admin] PATH_INFO: `/v3/projects/2937cbbc12b045a3895e0551f091564e/users/bf5a87be13394a00bee9606b9f79ff90/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:47.166038 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562a219-d5de-4f64-ad72-df05ea54dd94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2937cbbc12b045a3895e0551f091564e, user_id=bf5a87be13394a00bee9606b9f79ff90, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:47.168748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562a219-d5de-4f64-ad72-df05ea54dd94 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:47.186750 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1423/2844] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 05:55:47 2022] PUT /identity/v3/projects/2937cbbc12b045a3895e0551f091564e/users/bf5a87be13394a00bee9606b9f79ff90/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:47.198190 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a01cbf-f360-46e2-a3a4-bde404b4fd68 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:47.198551 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a01cbf-f360-46e2-a3a4-bde404b4fd68 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:47.198941 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a01cbf-f360-46e2-a3a4-bde404b4fd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:47.231925 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-75a01cbf-f360-46e2-a3a4-bde404b4fd68 None None] MFA Rules not processed for user `bf5a87be13394a00bee9606b9f79ff90`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:47.233136 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-75a01cbf-f360-46e2-a3a4-bde404b4fd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:47.315713 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1422/2845] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:47.327587 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562a219-d5de-4f64-ad72-df05ea54dd94 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:47.329379 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d562a219-d5de-4f64-ad72-df05ea54dd94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:47.366200 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:47.401820 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562a219-d5de-4f64-ad72-df05ea54dd94 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:47.406536 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbea52c-d028-4f18-91db-ce96d94b40ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:47.407526 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbea52c-d028-4f18-91db-ce96d94b40ae service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:47.407904 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbea52c-d028-4f18-91db-ce96d94b40ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:47.408240 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbea52c-d028-4f18-91db-ce96d94b40ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:47.418547 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbea52c-d028-4f18-91db-ce96d94b40ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:47.420139 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbea52c-d028-4f18-91db-ce96d94b40ae service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:47.429322 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1424/2846] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:55:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:55:50.060099 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a01cbf-f360-46e2-a3a4-bde404b4fd68 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:50.130525 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a01cbf-f360-46e2-a3a4-bde404b4fd68 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:50.135174 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fefd0e-aeb2-40e2-a216-3dedfec22b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:50.135847 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fefd0e-aeb2-40e2-a216-3dedfec22b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:50.136123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fefd0e-aeb2-40e2-a216-3dedfec22b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:50.136390 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fefd0e-aeb2-40e2-a216-3dedfec22b04 admin admin] PATH_INFO: `/v3/users/bf5a87be13394a00bee9606b9f79ff90` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:50.137566 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fefd0e-aeb2-40e2-a216-3dedfec22b04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf5a87be13394a00bee9606b9f79ff90)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:50.139657 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fefd0e-aeb2-40e2-a216-3dedfec22b04 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:50.145642 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:50.192832 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d0fefd0e-aeb2-40e2-a216-3dedfec22b04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf5a87be13394a00bee9606b9f79ff90'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:50.201552 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d0fefd0e-aeb2-40e2-a216-3dedfec22b04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf5a87be13394a00bee9606b9f79ff90'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:50.202174 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d0fefd0e-aeb2-40e2-a216-3dedfec22b04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf5a87be13394a00bee9606b9f79ff90'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:50.215269 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d0fefd0e-aeb2-40e2-a216-3dedfec22b04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf5a87be13394a00bee9606b9f79ff90'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:50.223787 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-d0fefd0e-aeb2-40e2-a216-3dedfec22b04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf5a87be13394a00bee9606b9f79ff90'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:50.230728 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1423/2847] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 05:55:50 2022] DELETE /identity/v3/users/bf5a87be13394a00bee9606b9f79ff90 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:50.235593 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ec6b9-f939-4b6e-a5b1-a5f21f4479c0 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:50.236288 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ec6b9-f939-4b6e-a5b1-a5f21f4479c0 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:50.236288 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ec6b9-f939-4b6e-a5b1-a5f21f4479c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:50.257392 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-381ec6b9-f939-4b6e-a5b1-a5f21f4479c0 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 05:55:50.259566 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-381ec6b9-f939-4b6e-a5b1-a5f21f4479c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:50.333264 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1425/2848] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 05:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 05:55:50.344146 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fefd0e-aeb2-40e2-a216-3dedfec22b04 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:50.345737 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d0fefd0e-aeb2-40e2-a216-3dedfec22b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:50.409314 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fefd0e-aeb2-40e2-a216-3dedfec22b04 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:50.413092 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290a155-0917-41f6-b74a-7a23a1685f12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:50.413713 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290a155-0917-41f6-b74a-7a23a1685f12 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:50.413986 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290a155-0917-41f6-b74a-7a23a1685f12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:50.414249 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290a155-0917-41f6-b74a-7a23a1685f12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:50.425904 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290a155-0917-41f6-b74a-7a23a1685f12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:50.426856 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290a155-0917-41f6-b74a-7a23a1685f12 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:50.439491 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1424/2849] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:55:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:55:50.817921 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ec6b9-f939-4b6e-a5b1-a5f21f4479c0 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:50.820096 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-381ec6b9-f939-4b6e-a5b1-a5f21f4479c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:50.838341 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ec6b9-f939-4b6e-a5b1-a5f21f4479c0 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:50.853645 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984d4be-4cee-4194-a0e8-93f4a34edaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:50.854378 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984d4be-4cee-4194-a0e8-93f4a34edaf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:50.854679 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984d4be-4cee-4194-a0e8-93f4a34edaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:50.854983 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984d4be-4cee-4194-a0e8-93f4a34edaf5 admin admin] PATH_INFO: `/v3/projects/2937cbbc12b045a3895e0551f091564e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:50.856326 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984d4be-4cee-4194-a0e8-93f4a34edaf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2937cbbc12b045a3895e0551f091564e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:50.858273 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984d4be-4cee-4194-a0e8-93f4a34edaf5 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:50.914418 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6984d4be-4cee-4194-a0e8-93f4a34edaf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2937cbbc12b045a3895e0551f091564e', 'request_id': 'req-6984d4be-4cee-4194-a0e8-93f4a34edaf5'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:50.924952 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6984d4be-4cee-4194-a0e8-93f4a34edaf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2937cbbc12b045a3895e0551f091564e', 'request_id': 'req-6984d4be-4cee-4194-a0e8-93f4a34edaf5'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:50.933137 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6984d4be-4cee-4194-a0e8-93f4a34edaf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2937cbbc12b045a3895e0551f091564e', 'request_id': 'req-6984d4be-4cee-4194-a0e8-93f4a34edaf5'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:50.945174 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6984d4be-4cee-4194-a0e8-93f4a34edaf5 admin admin] The token cache is being invalidate because project 2937cbbc12b045a3895e0551f091564e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 05:55:50.945461 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6984d4be-4cee-4194-a0e8-93f4a34edaf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:50.946179 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-6984d4be-4cee-4194-a0e8-93f4a34edaf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 05:55:50.947675 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1426/2850] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 05:55:50 2022] DELETE /identity/v3/projects/2937cbbc12b045a3895e0551f091564e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 05:55:57.100385 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290a155-0917-41f6-b74a-7a23a1685f12 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:55:57.101908 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8290a155-0917-41f6-b74a-7a23a1685f12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:57.177091 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290a155-0917-41f6-b74a-7a23a1685f12 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:55:57.205059 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:55:57.263312 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c69e1-4bb0-467a-a444-3f9fc0ad4067 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:55:57.263989 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c69e1-4bb0-467a-a444-3f9fc0ad4067 service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:55:57.264278 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c69e1-4bb0-467a-a444-3f9fc0ad4067 service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:55:57.264548 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c69e1-4bb0-467a-a444-3f9fc0ad4067 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:55:57.266978 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d42c69e1-4bb0-467a-a444-3f9fc0ad4067 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:55:57.280701 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c69e1-4bb0-467a-a444-3f9fc0ad4067 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:55:57.282324 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c69e1-4bb0-467a-a444-3f9fc0ad4067 service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:55:57.294339 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1425/2851] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:55:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:56:00.942185 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=68,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:56:07.289224 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=22 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:58:35.365229 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984d4be-4cee-4194-a0e8-93f4a34edaf5 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:58:35.367023 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-6984d4be-4cee-4194-a0e8-93f4a34edaf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:58:35.445050 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984d4be-4cee-4194-a0e8-93f4a34edaf5 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:58:35.450718 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0f9fa-78c8-4797-9fb3-639f5dca6605 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895edcfb20484b188a3877c9de8b59c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:58:35.451332 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0f9fa-78c8-4797-9fb3-639f5dca6605 service placement] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:58:35.451608 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0f9fa-78c8-4797-9fb3-639f5dca6605 service placement] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:58:35.451915 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0f9fa-78c8-4797-9fb3-639f5dca6605 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:58:35.453972 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-86c0f9fa-78c8-4797-9fb3-639f5dca6605 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:58:35.466761 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c0f9fa-78c8-4797-9fb3-639f5dca6605 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:58:35.468580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c0f9fa-78c8-4797-9fb3-639f5dca6605 service placement] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:58:35.478883 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1427/2852] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:58:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 05:58:45.474861 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=32 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 05:59:58.386476 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c69e1-4bb0-467a-a444-3f9fc0ad4067 service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:59:58.388168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d42c69e1-4bb0-467a-a444-3f9fc0ad4067 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:59:58.445672 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c69e1-4bb0-467a-a444-3f9fc0ad4067 service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:59:58.449852 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5254388-f6d2-4bdf-82d6-53b093f246a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:59:58.450493 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5254388-f6d2-4bdf-82d6-53b093f246a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:59:58.450828 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5254388-f6d2-4bdf-82d6-53b093f246a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:59:58.450995 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5254388-f6d2-4bdf-82d6-53b093f246a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:59:58.452852 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-d5254388-f6d2-4bdf-82d6-53b093f246a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:59:58.468481 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5254388-f6d2-4bdf-82d6-53b093f246a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:59:58.470321 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5254388-f6d2-4bdf-82d6-53b093f246a5 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:59:58.483879 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1426/2853] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:59:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 05:59:59.676444 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0f9fa-78c8-4797-9fb3-639f5dca6605 service placement] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 05:59:59.678588 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-86c0f9fa-78c8-4797-9fb3-639f5dca6605 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:59:59.693877 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0f9fa-78c8-4797-9fb3-639f5dca6605 service placement] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 05:59:59.698923 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89a04f-6286-45f5-b202-533e7ea327fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 05:59:59.699528 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89a04f-6286-45f5-b202-533e7ea327fb service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 05:59:59.700242 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89a04f-6286-45f5-b202-533e7ea327fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 05:59:59.700516 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d89a04f-6286-45f5-b202-533e7ea327fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 05:59:59.702474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5d89a04f-6286-45f5-b202-533e7ea327fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 05:59:59.717837 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89a04f-6286-45f5-b202-533e7ea327fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 05:59:59.719260 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d89a04f-6286-45f5-b202-533e7ea327fb service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 05:59:59.730832 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1428/2854] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 05:59:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 06:00:05.592243 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb42a4-9c0e-4322-ba15-3fa90e0f1d35 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:00:05.592816 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb42a4-9c0e-4322-ba15-3fa90e0f1d35 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:00:05.592816 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb42a4-9c0e-4322-ba15-3fa90e0f1d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:00:05.612900 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-7efb42a4-9c0e-4322-ba15-3fa90e0f1d35 None None] MFA Rules not processed for user `001e119eeb774965a45bc34384e477b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 06:00:05.614413 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7efb42a4-9c0e-4322-ba15-3fa90e0f1d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:00:05.680911 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1427/2855] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 06:00:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 06:00:06.003598 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89a04f-6286-45f5-b202-533e7ea327fb service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:00:06.016121 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d89a04f-6286-45f5-b202-533e7ea327fb service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:00:06.021047 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7bbc1-fd64-4ad8-a9dd-f99f0b28d3ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:00:06.021705 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7bbc1-fd64-4ad8-a9dd-f99f0b28d3ab service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:00:06.021978 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7bbc1-fd64-4ad8-a9dd-f99f0b28d3ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:00:06.022235 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7bbc1-fd64-4ad8-a9dd-f99f0b28d3ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:00:06.024339 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-26d7bbc1-fd64-4ad8-a9dd-f99f0b28d3ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:00:06.035310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7bbc1-fd64-4ad8-a9dd-f99f0b28d3ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:00:06.036856 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7bbc1-fd64-4ad8-a9dd-f99f0b28d3ab service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:00:06.045679 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1429/2856] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 06:00:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 06:00:06.390944 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb42a4-9c0e-4322-ba15-3fa90e0f1d35 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:00:06.392386 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-7efb42a4-9c0e-4322-ba15-3fa90e0f1d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:00:06.408064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb42a4-9c0e-4322-ba15-3fa90e0f1d35 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:00:06.413201 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae9567-384b-47b5-80e4-97e19a91db83 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895edcfb20484b188a3877c9de8b59c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:00:06.413819 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae9567-384b-47b5-80e4-97e19a91db83 service placement] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:00:06.414080 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae9567-384b-47b5-80e4-97e19a91db83 service placement] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:00:06.414341 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae9567-384b-47b5-80e4-97e19a91db83 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:00:06.416115 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-70ae9567-384b-47b5-80e4-97e19a91db83 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:00:06.428100 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae9567-384b-47b5-80e4-97e19a91db83 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:00:06.429803 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae9567-384b-47b5-80e4-97e19a91db83 service placement] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:00:06.441006 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1428/2857] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 06:00:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 06:00:13.636397 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7bbc1-fd64-4ad8-a9dd-f99f0b28d3ab service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:00:13.637928 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-26d7bbc1-fd64-4ad8-a9dd-f99f0b28d3ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:00:13.657349 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7bbc1-fd64-4ad8-a9dd-f99f0b28d3ab service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:00:13.662728 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c75c74-d58e-454e-9210-cf48592b76e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:00:13.663331 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c75c74-d58e-454e-9210-cf48592b76e8 service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:00:13.663604 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c75c74-d58e-454e-9210-cf48592b76e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:00:13.663899 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c75c74-d58e-454e-9210-cf48592b76e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:00:13.665611 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b6c75c74-d58e-454e-9210-cf48592b76e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:00:13.678014 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c75c74-d58e-454e-9210-cf48592b76e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:00:13.679580 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c75c74-d58e-454e-9210-cf48592b76e8 service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:00:13.690394 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1430/2858] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 06:00:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 06:00:16.436148 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=57 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:00:17.315209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae9567-384b-47b5-80e4-97e19a91db83 service placement] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:00:17.325775 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae9567-384b-47b5-80e4-97e19a91db83 service placement] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:00:17.330438 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcd870-683a-463f-83de-322ab6af32b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:00:17.331052 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcd870-683a-463f-83de-322ab6af32b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:00:17.331326 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcd870-683a-463f-83de-322ab6af32b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:00:17.331594 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcd870-683a-463f-83de-322ab6af32b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:00:17.333800 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-a6dcd870-683a-463f-83de-322ab6af32b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:00:17.346394 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dcd870-683a-463f-83de-322ab6af32b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:00:17.347908 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dcd870-683a-463f-83de-322ab6af32b2 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:00:17.356502 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1429/2859] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 06:00:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 06:00:23.685817 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=18 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:00:27.352614 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=6 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:01:32.192471 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c75c74-d58e-454e-9210-cf48592b76e8 service nova] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:01:32.194047 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-b6c75c74-d58e-454e-9210-cf48592b76e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:01:32.208050 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c75c74-d58e-454e-9210-cf48592b76e8 service nova] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:01:32.214221 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c243913-0765-4dc6-aaca-e89bf852707a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:01:32.214821 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c243913-0765-4dc6-aaca-e89bf852707a service nova] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:01:32.215089 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c243913-0765-4dc6-aaca-e89bf852707a service nova] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:01:32.215352 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c243913-0765-4dc6-aaca-e89bf852707a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:01:32.217420 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-5c243913-0765-4dc6-aaca-e89bf852707a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:01:32.228432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c243913-0765-4dc6-aaca-e89bf852707a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:01:32.229987 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c243913-0765-4dc6-aaca-e89bf852707a service nova] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:01:32.239448 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1431/2860] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 06:01:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 06:01:42.235141 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=6 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:01:47.681754 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcd870-683a-463f-83de-322ab6af32b2 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:01:47.708808 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcd870-683a-463f-83de-322ab6af32b2 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:01:47.717201 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a68c51-b4f2-4c62-8174-48688e2b6c9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c559a36836be411b9afd076f4c9a0655', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:01:47.718297 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a68c51-b4f2-4c62-8174-48688e2b6c9e service nova] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:01:47.718588 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a68c51-b4f2-4c62-8174-48688e2b6c9e service nova] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:01:47.718879 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a68c51-b4f2-4c62-8174-48688e2b6c9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:01:47.720803 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-b9a68c51-b4f2-4c62-8174-48688e2b6c9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:01:47.739510 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a68c51-b4f2-4c62-8174-48688e2b6c9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:01:47.741426 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a68c51-b4f2-4c62-8174-48688e2b6c9e service nova] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:01:47.754464 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1430/2861] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 06:01:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 06:01:53.642831 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c243913-0765-4dc6-aaca-e89bf852707a service nova] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:01:53.654323 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c243913-0765-4dc6-aaca-e89bf852707a service nova] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:01:53.659840 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17691573-076e-4815-84f0-8529776b0cf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:01:53.660447 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17691573-076e-4815-84f0-8529776b0cf1 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:01:53.660750 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17691573-076e-4815-84f0-8529776b0cf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:01:53.660990 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17691573-076e-4815-84f0-8529776b0cf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:01:53.663329 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-17691573-076e-4815-84f0-8529776b0cf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:01:53.731502 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17691573-076e-4815-84f0-8529776b0cf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:01:53.732983 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17691573-076e-4815-84f0-8529776b0cf1 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:01:53.743077 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1432/2862] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 06:01:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 06:01:57.046302 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a68c51-b4f2-4c62-8174-48688e2b6c9e service nova] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:01:57.061122 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a68c51-b4f2-4c62-8174-48688e2b6c9e service nova] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:01:57.066341 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568f82c-8f66-4a00-91de-5ed2815dcad4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895edcfb20484b188a3877c9de8b59c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:01:57.068299 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568f82c-8f66-4a00-91de-5ed2815dcad4 service placement] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:01:57.068583 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568f82c-8f66-4a00-91de-5ed2815dcad4 service placement] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:01:57.068852 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6568f82c-8f66-4a00-91de-5ed2815dcad4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:01:57.070741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6568f82c-8f66-4a00-91de-5ed2815dcad4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:01:57.076577 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17691573-076e-4815-84f0-8529776b0cf1 service neutron] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:01:57.078597 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-17691573-076e-4815-84f0-8529776b0cf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:01:57.084270 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568f82c-8f66-4a00-91de-5ed2815dcad4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:01:57.085845 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6568f82c-8f66-4a00-91de-5ed2815dcad4 service placement] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:01:57.094801 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17691573-076e-4815-84f0-8529776b0cf1 service neutron] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:01:57.098581 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1431/2863] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 06:01:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 06:01:57.101949 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5d32d-fe33-4156-88f6-4a4f234ec0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:01:57.102610 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5d32d-fe33-4156-88f6-4a4f234ec0bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:01:57.102883 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5d32d-fe33-4156-88f6-4a4f234ec0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:01:57.103154 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5d32d-fe33-4156-88f6-4a4f234ec0bd admin admin] PATH_INFO: `/v3/users/001e119eeb774965a45bc34384e477b3` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:01:57.104335 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf5d32d-fe33-4156-88f6-4a4f234ec0bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=001e119eeb774965a45bc34384e477b3)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:01:57.106259 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf5d32d-fe33-4156-88f6-4a4f234ec0bd admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:01:57.168406 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-aaf5d32d-fe33-4156-88f6-4a4f234ec0bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '001e119eeb774965a45bc34384e477b3'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:01:57.177359 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-aaf5d32d-fe33-4156-88f6-4a4f234ec0bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '001e119eeb774965a45bc34384e477b3'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:01:57.192570 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-aaf5d32d-fe33-4156-88f6-4a4f234ec0bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '001e119eeb774965a45bc34384e477b3'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:01:57.193392 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-aaf5d32d-fe33-4156-88f6-4a4f234ec0bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '001e119eeb774965a45bc34384e477b3'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:01:57.201619 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-aaf5d32d-fe33-4156-88f6-4a4f234ec0bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '001e119eeb774965a45bc34384e477b3'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:01:57.208112 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1433/2864] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 06:01:57 2022] DELETE /identity/v3/users/001e119eeb774965a45bc34384e477b3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 06:01:57.417209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568f82c-8f66-4a00-91de-5ed2815dcad4 service placement] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:01:57.427767 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6568f82c-8f66-4a00-91de-5ed2815dcad4 service placement] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:01:57.490303 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378320a8-3a93-4141-a40f-3a8c020382a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:01:57.490938 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378320a8-3a93-4141-a40f-3a8c020382a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:01:57.491243 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378320a8-3a93-4141-a40f-3a8c020382a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:01:57.491507 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378320a8-3a93-4141-a40f-3a8c020382a7 admin admin] PATH_INFO: `/v3/projects/d9d87fe9827d4440b568a5ca5ef84812` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:01:57.492736 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378320a8-3a93-4141-a40f-3a8c020382a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9d87fe9827d4440b568a5ca5ef84812)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:01:57.494637 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378320a8-3a93-4141-a40f-3a8c020382a7 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:01:57.548997 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-378320a8-3a93-4141-a40f-3a8c020382a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9d87fe9827d4440b568a5ca5ef84812', 'request_id': 'req-378320a8-3a93-4141-a40f-3a8c020382a7'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:01:57.554777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-378320a8-3a93-4141-a40f-3a8c020382a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9d87fe9827d4440b568a5ca5ef84812', 'request_id': 'req-378320a8-3a93-4141-a40f-3a8c020382a7'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:01:57.561866 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-378320a8-3a93-4141-a40f-3a8c020382a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9d87fe9827d4440b568a5ca5ef84812', 'request_id': 'req-378320a8-3a93-4141-a40f-3a8c020382a7'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:01:57.577638 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-378320a8-3a93-4141-a40f-3a8c020382a7 admin admin] The token cache is being invalidate because project d9d87fe9827d4440b568a5ca5ef84812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 06:01:57.577945 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-378320a8-3a93-4141-a40f-3a8c020382a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:01:57.578591 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-378320a8-3a93-4141-a40f-3a8c020382a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:01:57.580197 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1432/2865] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 06:01:57 2022] DELETE /identity/v3/projects/d9d87fe9827d4440b568a5ca5ef84812 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 06:01:57.586654 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f8af2-fa9c-4e12-bb4f-76ed12293ce6 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:01:57.587239 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f8af2-fa9c-4e12-bb4f-76ed12293ce6 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:01:57.587695 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f8af2-fa9c-4e12-bb4f-76ed12293ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:01:57.614598 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-4d4f8af2-fa9c-4e12-bb4f-76ed12293ce6 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 06:01:57.615875 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-4d4f8af2-fa9c-4e12-bb4f-76ed12293ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:01:57.679590 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1434/2866] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 06:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 06:01:57.688818 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99999ce3-6398-4933-aecb-667bbaa61ecc None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:01:57.689470 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99999ce3-6398-4933-aecb-667bbaa61ecc None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:01:57.689881 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99999ce3-6398-4933-aecb-667bbaa61ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:01:57.713196 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-99999ce3-6398-4933-aecb-667bbaa61ecc None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 06:01:57.714567 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-99999ce3-6398-4933-aecb-667bbaa61ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:01:57.726814 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1433/2867] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 06:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 06:01:57.732225 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f8af2-fa9c-4e12-bb4f-76ed12293ce6 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:01:57.742919 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f8af2-fa9c-4e12-bb4f-76ed12293ce6 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:01:57.749016 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22db81a-fd34-4997-8547-7532e0102712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:01:57.749711 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22db81a-fd34-4997-8547-7532e0102712 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:01:57.749981 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22db81a-fd34-4997-8547-7532e0102712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:01:57.750243 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22db81a-fd34-4997-8547-7532e0102712 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:01:57.750882 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22db81a-fd34-4997-8547-7532e0102712 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 06:01:57.751178 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22db81a-fd34-4997-8547-7532e0102712 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:01:57.752881 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22db81a-fd34-4997-8547-7532e0102712 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:01:57.754597 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:01:57.767494 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1435/2868] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 06:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 06:01:57.772233 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99999ce3-6398-4933-aecb-667bbaa61ecc None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:01:57.782440 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99999ce3-6398-4933-aecb-667bbaa61ecc None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:01:57.788321 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56662a5a-830a-4acf-91bf-bf69adb137df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:01:57.789000 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56662a5a-830a-4acf-91bf-bf69adb137df admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:01:57.789246 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56662a5a-830a-4acf-91bf-bf69adb137df admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:01:57.789505 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56662a5a-830a-4acf-91bf-bf69adb137df admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:01:57.790128 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56662a5a-830a-4acf-91bf-bf69adb137df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:01:57.792057 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56662a5a-830a-4acf-91bf-bf69adb137df admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:01:57.823451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1434/2869] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 06:01:57 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 06:01:57.827886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22db81a-fd34-4997-8547-7532e0102712 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:01:57.839118 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22db81a-fd34-4997-8547-7532e0102712 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:01:57.916325 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053811c-f279-4f3f-b306-4d75ae7d0f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:01:57.919150 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053811c-f279-4f3f-b306-4d75ae7d0f6e admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:01:57.919424 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053811c-f279-4f3f-b306-4d75ae7d0f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:01:57.919678 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053811c-f279-4f3f-b306-4d75ae7d0f6e admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:01:57.920346 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053811c-f279-4f3f-b306-4d75ae7d0f6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:01:57.922319 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053811c-f279-4f3f-b306-4d75ae7d0f6e admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:01:57.946582 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1436/2870] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 06:01:57 2022] POST /identity/v3/users => generated 284 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 06:01:57.950788 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56662a5a-830a-4acf-91bf-bf69adb137df admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:01:57.961625 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56662a5a-830a-4acf-91bf-bf69adb137df admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:01:57.966734 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e5db3-200c-46e9-b622-db99476abe0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:01:57.967433 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e5db3-200c-46e9-b622-db99476abe0e admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:01:57.967608 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e5db3-200c-46e9-b622-db99476abe0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:01:57.968021 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e5db3-200c-46e9-b622-db99476abe0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:01:57.968660 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e5db3-200c-46e9-b622-db99476abe0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:01:57.970260 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e5db3-200c-46e9-b622-db99476abe0e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:01:57.981333 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1435/2871] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 06:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 06:01:57.985639 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053811c-f279-4f3f-b306-4d75ae7d0f6e admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:01:57.996487 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053811c-f279-4f3f-b306-4d75ae7d0f6e admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:01:58.001581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75fdc5-f823-477d-b742-0f0950bc4e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:01:58.002215 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75fdc5-f823-477d-b742-0f0950bc4e75 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:01:58.002492 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75fdc5-f823-477d-b742-0f0950bc4e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:01:58.002763 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75fdc5-f823-477d-b742-0f0950bc4e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:01:58.003413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75fdc5-f823-477d-b742-0f0950bc4e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:01:58.005080 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75fdc5-f823-477d-b742-0f0950bc4e75 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:01:58.016416 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1437/2872] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 06:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 06:01:58.022399 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e5db3-200c-46e9-b622-db99476abe0e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:01:58.035910 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e5db3-200c-46e9-b622-db99476abe0e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:01:58.041513 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9f540-3e07-4f5f-9410-32f72d303a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:01:58.042186 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9f540-3e07-4f5f-9410-32f72d303a3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:01:58.042461 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9f540-3e07-4f5f-9410-32f72d303a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:01:58.042729 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9f540-3e07-4f5f-9410-32f72d303a3f admin admin] PATH_INFO: `/v3/projects/f6b8f3de3e9b4f5f8366b67de5bdfdb2/users/153bf24c762943158f92883981715c1e/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:01:58.059008 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9f540-3e07-4f5f-9410-32f72d303a3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6b8f3de3e9b4f5f8366b67de5bdfdb2, user_id=153bf24c762943158f92883981715c1e, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:01:58.061812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9f540-3e07-4f5f-9410-32f72d303a3f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:01:58.075014 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:01:58.085456 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1436/2873] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 06:01:58 2022] PUT /identity/v3/projects/f6b8f3de3e9b4f5f8366b67de5bdfdb2/users/153bf24c762943158f92883981715c1e/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 06:01:58.098897 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a6a18-0533-4bf6-beb4-cc4524f011b5 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:01:58.099422 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a6a18-0533-4bf6-beb4-cc4524f011b5 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:01:58.099422 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a6a18-0533-4bf6-beb4-cc4524f011b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:01:58.130707 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-9c7a6a18-0533-4bf6-beb4-cc4524f011b5 None None] MFA Rules not processed for user `153bf24c762943158f92883981715c1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 06:01:58.131971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-9c7a6a18-0533-4bf6-beb4-cc4524f011b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:01:58.208308 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1438/2874] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 06:01:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 06:01:58.220517 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9f540-3e07-4f5f-9410-32f72d303a3f admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:01:58.222867 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-18c9f540-3e07-4f5f-9410-32f72d303a3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:01:58.288168 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9f540-3e07-4f5f-9410-32f72d303a3f admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:01:58.293711 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73203a99-a622-4867-b347-596ccba9c156 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:01:58.294677 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73203a99-a622-4867-b347-596ccba9c156 service cinder] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:01:58.295113 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73203a99-a622-4867-b347-596ccba9c156 service cinder] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:01:58.295421 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73203a99-a622-4867-b347-596ccba9c156 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:01:58.305540 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73203a99-a622-4867-b347-596ccba9c156 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:01:58.306992 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73203a99-a622-4867-b347-596ccba9c156 service cinder] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:01:58.316952 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1437/2875] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 06:01:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 06:02:06.884682 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a6a18-0533-4bf6-beb4-cc4524f011b5 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:06.963194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a6a18-0533-4bf6-beb4-cc4524f011b5 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:06.968869 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a90a4a-e3f1-483f-a9c4-b7c1307ae68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:06.969503 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a90a4a-e3f1-483f-a9c4-b7c1307ae68b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:06.969769 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a90a4a-e3f1-483f-a9c4-b7c1307ae68b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:06.970030 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a90a4a-e3f1-483f-a9c4-b7c1307ae68b admin admin] PATH_INFO: `/v3/users/153bf24c762943158f92883981715c1e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:06.971331 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a90a4a-e3f1-483f-a9c4-b7c1307ae68b admin admin] RBAC: Authorizing `identity:delete_user(user_id=153bf24c762943158f92883981715c1e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:06.973324 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a90a4a-e3f1-483f-a9c4-b7c1307ae68b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:06.975717 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:02:07.021450 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e9a90a4a-e3f1-483f-a9c4-b7c1307ae68b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '153bf24c762943158f92883981715c1e'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:07.033229 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e9a90a4a-e3f1-483f-a9c4-b7c1307ae68b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '153bf24c762943158f92883981715c1e'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:07.052045 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e9a90a4a-e3f1-483f-a9c4-b7c1307ae68b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '153bf24c762943158f92883981715c1e'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:07.052818 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e9a90a4a-e3f1-483f-a9c4-b7c1307ae68b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '153bf24c762943158f92883981715c1e'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:07.059887 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-e9a90a4a-e3f1-483f-a9c4-b7c1307ae68b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '153bf24c762943158f92883981715c1e'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:07.065989 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1439/2876] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 06:02:06 2022] DELETE /identity/v3/users/153bf24c762943158f92883981715c1e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 06:02:07.071096 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f02c83-b19d-440f-bf7a-a7d5cf1b69ee None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:07.071799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f02c83-b19d-440f-bf7a-a7d5cf1b69ee None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:07.071799 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f02c83-b19d-440f-bf7a-a7d5cf1b69ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:07.093377 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-22f02c83-b19d-440f-bf7a-a7d5cf1b69ee None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 06:02:07.094635 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-22f02c83-b19d-440f-bf7a-a7d5cf1b69ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:02:07.171868 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1438/2877] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 06:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 06:02:07.182274 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a90a4a-e3f1-483f-a9c4-b7c1307ae68b admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:07.184006 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-e9a90a4a-e3f1-483f-a9c4-b7c1307ae68b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:02:07.245337 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a90a4a-e3f1-483f-a9c4-b7c1307ae68b admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:07.249573 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf6d85e-95b5-4b14-b824-f9fcdd54e3b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:07.250218 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6d85e-95b5-4b14-b824-f9fcdd54e3b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:07.250494 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6d85e-95b5-4b14-b824-f9fcdd54e3b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:07.250762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf6d85e-95b5-4b14-b824-f9fcdd54e3b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:07.261205 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6d85e-95b5-4b14-b824-f9fcdd54e3b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:07.262645 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf6d85e-95b5-4b14-b824-f9fcdd54e3b6 service neutron] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:07.272055 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1440/2878] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 06:02:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 06:02:07.557179 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f02c83-b19d-440f-bf7a-a7d5cf1b69ee None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:07.559490 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-22f02c83-b19d-440f-bf7a-a7d5cf1b69ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:02:07.574862 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f02c83-b19d-440f-bf7a-a7d5cf1b69ee None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:07.580366 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93e870-247c-4b2f-89bc-5838ac577776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:07.581450 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93e870-247c-4b2f-89bc-5838ac577776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:07.581866 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93e870-247c-4b2f-89bc-5838ac577776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:07.582270 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93e870-247c-4b2f-89bc-5838ac577776 admin admin] PATH_INFO: `/v3/projects/f6b8f3de3e9b4f5f8366b67de5bdfdb2` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:07.583904 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93e870-247c-4b2f-89bc-5838ac577776 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6b8f3de3e9b4f5f8366b67de5bdfdb2)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:07.587777 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93e870-247c-4b2f-89bc-5838ac577776 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:07.641025 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ba93e870-247c-4b2f-89bc-5838ac577776 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6b8f3de3e9b4f5f8366b67de5bdfdb2', 'request_id': 'req-ba93e870-247c-4b2f-89bc-5838ac577776'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:07.648437 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ba93e870-247c-4b2f-89bc-5838ac577776 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6b8f3de3e9b4f5f8366b67de5bdfdb2', 'request_id': 'req-ba93e870-247c-4b2f-89bc-5838ac577776'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:07.655781 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ba93e870-247c-4b2f-89bc-5838ac577776 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6b8f3de3e9b4f5f8366b67de5bdfdb2', 'request_id': 'req-ba93e870-247c-4b2f-89bc-5838ac577776'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:07.671235 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ba93e870-247c-4b2f-89bc-5838ac577776 admin admin] The token cache is being invalidate because project f6b8f3de3e9b4f5f8366b67de5bdfdb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81683) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 06:02:07.671514 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ba93e870-247c-4b2f-89bc-5838ac577776 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:07.672137 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-ba93e870-247c-4b2f-89bc-5838ac577776 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:07.673618 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1439/2879] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 06:02:07 2022] DELETE /identity/v3/projects/f6b8f3de3e9b4f5f8366b67de5bdfdb2 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 06:02:07.678951 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd9c70-fb35-46d4-8aa7-d3c5992e60b7 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:07.679232 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd9c70-fb35-46d4-8aa7-d3c5992e60b7 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:07.679495 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd9c70-fb35-46d4-8aa7-d3c5992e60b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:07.699983 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-f5cd9c70-fb35-46d4-8aa7-d3c5992e60b7 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 06:02:07.701245 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f5cd9c70-fb35-46d4-8aa7-d3c5992e60b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:02:07.764914 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1441/2880] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 06:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 06:02:07.773461 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109d82b-42fc-4c5a-a78b-4fcca4ca6ba7 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:07.773712 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109d82b-42fc-4c5a-a78b-4fcca4ca6ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:07.774009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109d82b-42fc-4c5a-a78b-4fcca4ca6ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:07.794617 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-8109d82b-42fc-4c5a-a78b-4fcca4ca6ba7 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 06:02:07.795836 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8109d82b-42fc-4c5a-a78b-4fcca4ca6ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:02:07.804178 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1440/2881] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 06:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 06:02:07.810452 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd9c70-fb35-46d4-8aa7-d3c5992e60b7 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:07.822664 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd9c70-fb35-46d4-8aa7-d3c5992e60b7 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:07.827550 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4daf3ce-a319-4d23-b728-50c42588b7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:07.828182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4daf3ce-a319-4d23-b728-50c42588b7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:07.828450 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4daf3ce-a319-4d23-b728-50c42588b7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:07.828712 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4daf3ce-a319-4d23-b728-50c42588b7d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:07.829371 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4daf3ce-a319-4d23-b728-50c42588b7d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81682) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 06:02:07.829664 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4daf3ce-a319-4d23-b728-50c42588b7d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:07.831236 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4daf3ce-a319-4d23-b728-50c42588b7d0 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:07.843163 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1442/2882] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 06:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 06:02:07.847557 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109d82b-42fc-4c5a-a78b-4fcca4ca6ba7 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:07.857604 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109d82b-42fc-4c5a-a78b-4fcca4ca6ba7 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:07.863195 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54949e-134d-4953-88c6-a73463c06d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:07.863816 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54949e-134d-4953-88c6-a73463c06d7d admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:07.864082 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54949e-134d-4953-88c6-a73463c06d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:07.864341 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54949e-134d-4953-88c6-a73463c06d7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:07.864961 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a54949e-134d-4953-88c6-a73463c06d7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:07.866867 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a54949e-134d-4953-88c6-a73463c06d7d admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:07.890844 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:02:07.904187 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1441/2883] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 06:02:07 2022] POST /identity/v3/projects => generated 403 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 06:02:07.905409 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4daf3ce-a319-4d23-b728-50c42588b7d0 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:07.915753 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4daf3ce-a319-4d23-b728-50c42588b7d0 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:07.923963 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:02:07.976255 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57373048-3601-491f-bb11-620789a668e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:07.976866 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57373048-3601-491f-bb11-620789a668e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:07.977143 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57373048-3601-491f-bb11-620789a668e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:07.977409 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57373048-3601-491f-bb11-620789a668e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:07.978050 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57373048-3601-491f-bb11-620789a668e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:07.979976 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57373048-3601-491f-bb11-620789a668e6 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:08.002818 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1443/2884] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 06:02:07 2022] POST /identity/v3/users => generated 302 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 06:02:08.007262 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54949e-134d-4953-88c6-a73463c06d7d admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:08.017953 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54949e-134d-4953-88c6-a73463c06d7d admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:08.022835 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5f4a1-6808-48c2-a9ed-90f253aea821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:08.023449 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5f4a1-6808-48c2-a9ed-90f253aea821 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:08.023725 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5f4a1-6808-48c2-a9ed-90f253aea821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:08.024016 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5f4a1-6808-48c2-a9ed-90f253aea821 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:08.024659 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5f4a1-6808-48c2-a9ed-90f253aea821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:08.026288 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5f4a1-6808-48c2-a9ed-90f253aea821 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:08.038886 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1442/2885] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 06:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 06:02:08.044502 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57373048-3601-491f-bb11-620789a668e6 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:08.054956 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57373048-3601-491f-bb11-620789a668e6 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:08.059840 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a638012-7eeb-4394-b7cc-465cf1164496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:08.060432 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a638012-7eeb-4394-b7cc-465cf1164496 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:08.060705 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a638012-7eeb-4394-b7cc-465cf1164496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:08.060971 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a638012-7eeb-4394-b7cc-465cf1164496 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:08.061615 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a638012-7eeb-4394-b7cc-465cf1164496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:08.063182 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a638012-7eeb-4394-b7cc-465cf1164496 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:08.074165 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1444/2886] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 06:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 06:02:08.078549 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5f4a1-6808-48c2-a9ed-90f253aea821 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:08.089262 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5f4a1-6808-48c2-a9ed-90f253aea821 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:08.095233 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb2913-96e0-4b95-bbf2-4be41ef39f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:08.095912 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb2913-96e0-4b95-bbf2-4be41ef39f13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:08.096209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb2913-96e0-4b95-bbf2-4be41ef39f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:08.096480 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb2913-96e0-4b95-bbf2-4be41ef39f13 admin admin] PATH_INFO: `/v3/projects/d7e3b4834b6343aaaa08fd234b214550/users/06565d4e75c04b3293f8f639eafb5da4/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:08.116072 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb2913-96e0-4b95-bbf2-4be41ef39f13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7e3b4834b6343aaaa08fd234b214550, user_id=06565d4e75c04b3293f8f639eafb5da4, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:08.118759 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb2913-96e0-4b95-bbf2-4be41ef39f13 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:08.135090 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1443/2887] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 06:02:08 2022] PUT /identity/v3/projects/d7e3b4834b6343aaaa08fd234b214550/users/06565d4e75c04b3293f8f639eafb5da4/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 06:02:08.142687 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1253e79-22da-44c0-8598-206f43cf563b None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:08.142956 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1253e79-22da-44c0-8598-206f43cf563b None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:08.143359 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1253e79-22da-44c0-8598-206f43cf563b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:08.169258 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-f1253e79-22da-44c0-8598-206f43cf563b None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 06:02:08.170575 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f1253e79-22da-44c0-8598-206f43cf563b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:02:08.235313 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1445/2888] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 06:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 06:02:08.246187 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb2913-96e0-4b95-bbf2-4be41ef39f13 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:08.248184 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-62bb2913-96e0-4b95-bbf2-4be41ef39f13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:02:08.308457 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb2913-96e0-4b95-bbf2-4be41ef39f13 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:08.312400 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f906c-42c1-402b-b080-25682c973f0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:08.313003 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f906c-42c1-402b-b080-25682c973f0d service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:08.313276 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f906c-42c1-402b-b080-25682c973f0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:08.313546 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f906c-42c1-402b-b080-25682c973f0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:08.322835 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f906c-42c1-402b-b080-25682c973f0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:08.324309 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f906c-42c1-402b-b080-25682c973f0d service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:08.333952 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1444/2889] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 06:02:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 06:02:09.010242 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd0661-9694-4da2-ab49-8ead7fab40f1 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:09.010830 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd0661-9694-4da2-ab49-8ead7fab40f1 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:09.010830 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd0661-9694-4da2-ab49-8ead7fab40f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:09.041330 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-c6cd0661-9694-4da2-ab49-8ead7fab40f1 None None] MFA Rules not processed for user `06565d4e75c04b3293f8f639eafb5da4`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 06:02:09.042562 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c6cd0661-9694-4da2-ab49-8ead7fab40f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:02:09.111512 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1446/2890] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 06:02:09 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 06:02:09.116256 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f906c-42c1-402b-b080-25682c973f0d service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:09.126177 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f906c-42c1-402b-b080-25682c973f0d service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:09.130692 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706a2a2-5445-4403-9e15-510873a52aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:09.131297 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706a2a2-5445-4403-9e15-510873a52aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:09.131576 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706a2a2-5445-4403-9e15-510873a52aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:09.131876 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706a2a2-5445-4403-9e15-510873a52aa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:09.132520 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706a2a2-5445-4403-9e15-510873a52aa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:09.134425 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706a2a2-5445-4403-9e15-510873a52aa6 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:09.164097 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1445/2891] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 06:02:09 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 06:02:09.168164 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd0661-9694-4da2-ab49-8ead7fab40f1 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:09.179927 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd0661-9694-4da2-ab49-8ead7fab40f1 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:09.197762 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:02:09.239068 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698630c-480a-47f0-abbc-0b8397986c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:09.239682 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698630c-480a-47f0-abbc-0b8397986c76 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:09.239985 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698630c-480a-47f0-abbc-0b8397986c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:09.240248 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698630c-480a-47f0-abbc-0b8397986c76 admin admin] PATH_INFO: `/v3/users` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:09.240886 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698630c-480a-47f0-abbc-0b8397986c76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:09.242755 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698630c-480a-47f0-abbc-0b8397986c76 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:09.266801 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1447/2892] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 06:02:09 2022] POST /identity/v3/users => generated 309 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 06:02:09.272630 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706a2a2-5445-4403-9e15-510873a52aa6 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:09.284291 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706a2a2-5445-4403-9e15-510873a52aa6 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:09.289918 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5ea00-7bd6-40ba-bf58-57d6384a25a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:09.290533 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5ea00-7bd6-40ba-bf58-57d6384a25a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:09.290801 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5ea00-7bd6-40ba-bf58-57d6384a25a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:09.291072 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5ea00-7bd6-40ba-bf58-57d6384a25a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:09.291707 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5ea00-7bd6-40ba-bf58-57d6384a25a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:09.293350 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5ea00-7bd6-40ba-bf58-57d6384a25a3 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:09.304002 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1446/2893] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 06:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 06:02:09.308502 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698630c-480a-47f0-abbc-0b8397986c76 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:09.319759 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698630c-480a-47f0-abbc-0b8397986c76 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:09.324885 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f02ab-0b3e-4bb3-9535-5d19b1764fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:09.325528 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f02ab-0b3e-4bb3-9535-5d19b1764fe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:09.325782 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f02ab-0b3e-4bb3-9535-5d19b1764fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:09.326070 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f02ab-0b3e-4bb3-9535-5d19b1764fe4 admin admin] PATH_INFO: `/v3/projects/992b8a14023548a6871683f9804bf62c/users/ef27a3d350b046e0bbb3f448f66e5cd4/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:09.342601 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f02ab-0b3e-4bb3-9535-5d19b1764fe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=992b8a14023548a6871683f9804bf62c, user_id=ef27a3d350b046e0bbb3f448f66e5cd4, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:09.345318 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f02ab-0b3e-4bb3-9535-5d19b1764fe4 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:09.359323 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1448/2894] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 06:02:09 2022] PUT /identity/v3/projects/992b8a14023548a6871683f9804bf62c/users/ef27a3d350b046e0bbb3f448f66e5cd4/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 06:02:09.363324 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5ea00-7bd6-40ba-bf58-57d6384a25a3 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:09.373415 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5ea00-7bd6-40ba-bf58-57d6384a25a3 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:09.434725 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee067758-7ac9-493b-938e-4791f7509d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:09.435329 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee067758-7ac9-493b-938e-4791f7509d05 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:09.435604 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee067758-7ac9-493b-938e-4791f7509d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:09.435897 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee067758-7ac9-493b-938e-4791f7509d05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:09.436526 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee067758-7ac9-493b-938e-4791f7509d05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:09.438137 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee067758-7ac9-493b-938e-4791f7509d05 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:09.448478 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1447/2895] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 06:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 06:02:09.454072 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f02ab-0b3e-4bb3-9535-5d19b1764fe4 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:09.470121 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f02ab-0b3e-4bb3-9535-5d19b1764fe4 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:09.475842 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfe6a2-dae9-4d4b-91f3-c60769db440b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:09.476507 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfe6a2-dae9-4d4b-91f3-c60769db440b admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:09.476776 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfe6a2-dae9-4d4b-91f3-c60769db440b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:09.477038 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfe6a2-dae9-4d4b-91f3-c60769db440b admin admin] PATH_INFO: `/v3/projects/992b8a14023548a6871683f9804bf62c/users/ef27a3d350b046e0bbb3f448f66e5cd4/roles/cf58d66369044fb09fa65a4366dc7446` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:09.479235 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bfe6a2-dae9-4d4b-91f3-c60769db440b admin admin] RBAC: Authorizing `identity:create_grant(project_id=992b8a14023548a6871683f9804bf62c, user_id=ef27a3d350b046e0bbb3f448f66e5cd4, role_id=cf58d66369044fb09fa65a4366dc7446)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:09.482141 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bfe6a2-dae9-4d4b-91f3-c60769db440b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:09.494127 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1449/2896] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 06:02:09 2022] PUT /identity/v3/projects/992b8a14023548a6871683f9804bf62c/users/ef27a3d350b046e0bbb3f448f66e5cd4/roles/cf58d66369044fb09fa65a4366dc7446 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 06:02:10.168265 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fe2dd-232b-4597-984b-17e4d83b7b93 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:10.169201 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fe2dd-232b-4597-984b-17e4d83b7b93 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:10.169480 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fe2dd-232b-4597-984b-17e4d83b7b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:10.210791 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-6e0fe2dd-232b-4597-984b-17e4d83b7b93 None None] MFA Rules not processed for user `ef27a3d350b046e0bbb3f448f66e5cd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 06:02:10.212247 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-6e0fe2dd-232b-4597-984b-17e4d83b7b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:02:10.231195 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:02:10.288690 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1448/2897] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 06:02:10 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 06:02:10.755573 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfe6a2-dae9-4d4b-91f3-c60769db440b admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:10.757534 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-80bfe6a2-dae9-4d4b-91f3-c60769db440b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:02:10.835042 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfe6a2-dae9-4d4b-91f3-c60769db440b admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:10.840262 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d8e2c-7e74-4952-a967-0932a7159bd7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895edcfb20484b188a3877c9de8b59c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:10.840872 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d8e2c-7e74-4952-a967-0932a7159bd7 service placement] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:10.841144 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d8e2c-7e74-4952-a967-0932a7159bd7 service placement] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:10.841488 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d8e2c-7e74-4952-a967-0932a7159bd7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:10.843310 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-c99d8e2c-7e74-4952-a967-0932a7159bd7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:02:10.855277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99d8e2c-7e74-4952-a967-0932a7159bd7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:10.856880 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99d8e2c-7e74-4952-a967-0932a7159bd7 service placement] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:10.867884 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1450/2898] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 06:02:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 06:02:11.345628 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0fe2dd-232b-4597-984b-17e4d83b7b93 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:11.414198 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0fe2dd-232b-4597-984b-17e4d83b7b93 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:11.419363 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4b829-4846-4fcb-b9e9-ce49d68dd708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:11.420040 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4b829-4846-4fcb-b9e9-ce49d68dd708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:11.420317 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4b829-4846-4fcb-b9e9-ce49d68dd708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:11.420585 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4b829-4846-4fcb-b9e9-ce49d68dd708 admin admin] PATH_INFO: `/v3/users/06565d4e75c04b3293f8f639eafb5da4` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:11.421716 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf4b829-4846-4fcb-b9e9-ce49d68dd708 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06565d4e75c04b3293f8f639eafb5da4)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:11.423978 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf4b829-4846-4fcb-b9e9-ce49d68dd708 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:11.474791 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-dbf4b829-4846-4fcb-b9e9-ce49d68dd708 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06565d4e75c04b3293f8f639eafb5da4'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:11.482151 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-dbf4b829-4846-4fcb-b9e9-ce49d68dd708 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06565d4e75c04b3293f8f639eafb5da4'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:11.482962 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-dbf4b829-4846-4fcb-b9e9-ce49d68dd708 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06565d4e75c04b3293f8f639eafb5da4'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:11.496249 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-dbf4b829-4846-4fcb-b9e9-ce49d68dd708 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06565d4e75c04b3293f8f639eafb5da4'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:11.503447 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-dbf4b829-4846-4fcb-b9e9-ce49d68dd708 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06565d4e75c04b3293f8f639eafb5da4'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:11.509606 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1449/2899] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 06:02:11 2022] DELETE /identity/v3/users/06565d4e75c04b3293f8f639eafb5da4 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 06:02:11.702880 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d8e2c-7e74-4952-a967-0932a7159bd7 service placement] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:11.717171 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d8e2c-7e74-4952-a967-0932a7159bd7 service placement] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:11.775594 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc96704-1f45-4e96-ae06-2e313381c3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:11.776324 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc96704-1f45-4e96-ae06-2e313381c3b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:11.776523 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc96704-1f45-4e96-ae06-2e313381c3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:11.776789 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc96704-1f45-4e96-ae06-2e313381c3b4 admin admin] PATH_INFO: `/v3/projects/d7e3b4834b6343aaaa08fd234b214550` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:11.778323 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc96704-1f45-4e96-ae06-2e313381c3b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7e3b4834b6343aaaa08fd234b214550)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:11.780410 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc96704-1f45-4e96-ae06-2e313381c3b4 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:11.782755 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:02:11.830968 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-adc96704-1f45-4e96-ae06-2e313381c3b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7e3b4834b6343aaaa08fd234b214550', 'request_id': 'req-adc96704-1f45-4e96-ae06-2e313381c3b4'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:11.839367 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-adc96704-1f45-4e96-ae06-2e313381c3b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7e3b4834b6343aaaa08fd234b214550', 'request_id': 'req-adc96704-1f45-4e96-ae06-2e313381c3b4'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:11.845595 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-adc96704-1f45-4e96-ae06-2e313381c3b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7e3b4834b6343aaaa08fd234b214550', 'request_id': 'req-adc96704-1f45-4e96-ae06-2e313381c3b4'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:11.857040 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-adc96704-1f45-4e96-ae06-2e313381c3b4 admin admin] The token cache is being invalidate because project d7e3b4834b6343aaaa08fd234b214550 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 06:02:11.857323 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-adc96704-1f45-4e96-ae06-2e313381c3b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:11.857988 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-adc96704-1f45-4e96-ae06-2e313381c3b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:11.859517 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1451/2900] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 06:02:11 2022] DELETE /identity/v3/projects/d7e3b4834b6343aaaa08fd234b214550 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 06:02:11.863840 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4b829-4846-4fcb-b9e9-ce49d68dd708 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:11.865549 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-dbf4b829-4846-4fcb-b9e9-ce49d68dd708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:02:11.879666 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4b829-4846-4fcb-b9e9-ce49d68dd708 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:11.913163 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:02:11.950477 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ab5a4-c362-46b5-9840-ecb29eec1676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:11.951011 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ab5a4-c362-46b5-9840-ecb29eec1676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:11.951283 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ab5a4-c362-46b5-9840-ecb29eec1676 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:11.951534 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ab5a4-c362-46b5-9840-ecb29eec1676 admin admin] PATH_INFO: `/v3/users/ef27a3d350b046e0bbb3f448f66e5cd4` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:11.952769 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ab5a4-c362-46b5-9840-ecb29eec1676 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef27a3d350b046e0bbb3f448f66e5cd4)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:11.954665 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292ab5a4-c362-46b5-9840-ecb29eec1676 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:12.005136 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-292ab5a4-c362-46b5-9840-ecb29eec1676 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef27a3d350b046e0bbb3f448f66e5cd4'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:12.013320 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-292ab5a4-c362-46b5-9840-ecb29eec1676 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef27a3d350b046e0bbb3f448f66e5cd4'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:12.014054 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-292ab5a4-c362-46b5-9840-ecb29eec1676 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef27a3d350b046e0bbb3f448f66e5cd4'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:12.025665 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-292ab5a4-c362-46b5-9840-ecb29eec1676 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef27a3d350b046e0bbb3f448f66e5cd4'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:12.032626 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-292ab5a4-c362-46b5-9840-ecb29eec1676 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef27a3d350b046e0bbb3f448f66e5cd4'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:12.038941 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1450/2901] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 06:02:11 2022] DELETE /identity/v3/users/ef27a3d350b046e0bbb3f448f66e5cd4 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 06:02:12.242743 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc96704-1f45-4e96-ae06-2e313381c3b4 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:12.244242 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-adc96704-1f45-4e96-ae06-2e313381c3b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:02:12.263157 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc96704-1f45-4e96-ae06-2e313381c3b4 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:12.326196 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ceb3cf-7ebc-46ed-854b-7e8fcd0123e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:12.326803 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ceb3cf-7ebc-46ed-854b-7e8fcd0123e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:12.327073 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ceb3cf-7ebc-46ed-854b-7e8fcd0123e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:12.327340 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ceb3cf-7ebc-46ed-854b-7e8fcd0123e7 admin admin] PATH_INFO: `/v3/projects/992b8a14023548a6871683f9804bf62c` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:12.328482 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ceb3cf-7ebc-46ed-854b-7e8fcd0123e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=992b8a14023548a6871683f9804bf62c)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:12.330378 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ceb3cf-7ebc-46ed-854b-7e8fcd0123e7 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:12.381967 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-77ceb3cf-7ebc-46ed-854b-7e8fcd0123e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '992b8a14023548a6871683f9804bf62c', 'request_id': 'req-77ceb3cf-7ebc-46ed-854b-7e8fcd0123e7'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:12.390978 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-77ceb3cf-7ebc-46ed-854b-7e8fcd0123e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '992b8a14023548a6871683f9804bf62c', 'request_id': 'req-77ceb3cf-7ebc-46ed-854b-7e8fcd0123e7'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:12.397133 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-77ceb3cf-7ebc-46ed-854b-7e8fcd0123e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '992b8a14023548a6871683f9804bf62c', 'request_id': 'req-77ceb3cf-7ebc-46ed-854b-7e8fcd0123e7'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:12.408994 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-77ceb3cf-7ebc-46ed-854b-7e8fcd0123e7 admin admin] The token cache is being invalidate because project 992b8a14023548a6871683f9804bf62c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 06:02:12.409277 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-77ceb3cf-7ebc-46ed-854b-7e8fcd0123e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:12.409926 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-77ceb3cf-7ebc-46ed-854b-7e8fcd0123e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:12.411538 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1452/2902] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 06:02:12 2022] DELETE /identity/v3/projects/992b8a14023548a6871683f9804bf62c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 06:02:12.416551 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d792dc-cd8b-4540-9ae4-c9248ddfcf3d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:12.417074 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d792dc-cd8b-4540-9ae4-c9248ddfcf3d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:12.417074 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d792dc-cd8b-4540-9ae4-c9248ddfcf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:12.437654 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-84d792dc-cd8b-4540-9ae4-c9248ddfcf3d None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 06:02:12.438856 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-84d792dc-cd8b-4540-9ae4-c9248ddfcf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:02:12.499621 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1451/2903] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 06:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 06:02:12.507602 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7dea1-464b-4347-98aa-b923dfd5f88e None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:12.507956 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7dea1-464b-4347-98aa-b923dfd5f88e None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:12.508230 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7dea1-464b-4347-98aa-b923dfd5f88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:12.529996 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-d3e7dea1-464b-4347-98aa-b923dfd5f88e None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 06:02:12.531259 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-d3e7dea1-464b-4347-98aa-b923dfd5f88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:02:12.542958 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1453/2904] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 06:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 06:02:12.547292 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d792dc-cd8b-4540-9ae4-c9248ddfcf3d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:12.557603 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d792dc-cd8b-4540-9ae4-c9248ddfcf3d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:12.564214 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40248f-40d9-4b79-9e0f-40d6a50cbafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:12.565075 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40248f-40d9-4b79-9e0f-40d6a50cbafd admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:12.565426 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40248f-40d9-4b79-9e0f-40d6a50cbafd admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:12.565760 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40248f-40d9-4b79-9e0f-40d6a50cbafd admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:12.566679 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40248f-40d9-4b79-9e0f-40d6a50cbafd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 06:02:12.567046 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40248f-40d9-4b79-9e0f-40d6a50cbafd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:12.568730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40248f-40d9-4b79-9e0f-40d6a50cbafd admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:12.582937 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1452/2905] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 06:02:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 06:02:12.587803 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7dea1-464b-4347-98aa-b923dfd5f88e None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:12.597610 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7dea1-464b-4347-98aa-b923dfd5f88e None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:12.603692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99607f21-0660-4ad4-8815-ae0a10249629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:12.604413 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99607f21-0660-4ad4-8815-ae0a10249629 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:12.604676 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99607f21-0660-4ad4-8815-ae0a10249629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:12.604961 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99607f21-0660-4ad4-8815-ae0a10249629 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:12.605671 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99607f21-0660-4ad4-8815-ae0a10249629 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:12.607692 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99607f21-0660-4ad4-8815-ae0a10249629 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:12.623667 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:02:12.637605 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1454/2906] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 06:02:12 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 06:02:12.641858 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40248f-40d9-4b79-9e0f-40d6a50cbafd admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:12.652561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40248f-40d9-4b79-9e0f-40d6a50cbafd admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:12.691090 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:02:12.714934 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fadf53-3c89-4a82-8cc8-51df75554d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:12.715546 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fadf53-3c89-4a82-8cc8-51df75554d3e admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:12.715848 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fadf53-3c89-4a82-8cc8-51df75554d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:12.716118 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fadf53-3c89-4a82-8cc8-51df75554d3e admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:12.716793 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fadf53-3c89-4a82-8cc8-51df75554d3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:12.718730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fadf53-3c89-4a82-8cc8-51df75554d3e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:12.742771 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1453/2907] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 06:02:12 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 06:02:12.747028 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99607f21-0660-4ad4-8815-ae0a10249629 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:12.757634 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99607f21-0660-4ad4-8815-ae0a10249629 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:12.763291 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225dccf-4a8e-43e7-aedf-02b3e5012d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:12.763931 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225dccf-4a8e-43e7-aedf-02b3e5012d3b admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:12.764210 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225dccf-4a8e-43e7-aedf-02b3e5012d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:12.764470 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225dccf-4a8e-43e7-aedf-02b3e5012d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:12.765106 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225dccf-4a8e-43e7-aedf-02b3e5012d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:12.766706 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225dccf-4a8e-43e7-aedf-02b3e5012d3b admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:12.777345 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1455/2908] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 06:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 06:02:12.781772 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fadf53-3c89-4a82-8cc8-51df75554d3e admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:12.792089 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fadf53-3c89-4a82-8cc8-51df75554d3e admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:12.796975 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddab05eb-55ff-4333-8d83-fec9d468487b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:12.797572 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab05eb-55ff-4333-8d83-fec9d468487b admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:12.797843 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab05eb-55ff-4333-8d83-fec9d468487b admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:12.798115 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddab05eb-55ff-4333-8d83-fec9d468487b admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:12.798747 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab05eb-55ff-4333-8d83-fec9d468487b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:12.800386 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddab05eb-55ff-4333-8d83-fec9d468487b admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:12.811251 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1454/2909] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 06:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 06:02:12.815760 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225dccf-4a8e-43e7-aedf-02b3e5012d3b admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:12.825996 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225dccf-4a8e-43e7-aedf-02b3e5012d3b admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:12.830984 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4259b-a6da-4fd7-800f-b29aeed12226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:12.831641 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4259b-a6da-4fd7-800f-b29aeed12226 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:12.831954 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4259b-a6da-4fd7-800f-b29aeed12226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:12.832231 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4259b-a6da-4fd7-800f-b29aeed12226 admin admin] PATH_INFO: `/v3/projects/b4da258158e84ac68523ebb5aacb0969/users/465daac7a1574d75a3c1f4041bf49e42/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:12.847836 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b4259b-a6da-4fd7-800f-b29aeed12226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4da258158e84ac68523ebb5aacb0969, user_id=465daac7a1574d75a3c1f4041bf49e42, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:12.850474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b4259b-a6da-4fd7-800f-b29aeed12226 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:12.865774 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1456/2910] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 06:02:12 2022] PUT /identity/v3/projects/b4da258158e84ac68523ebb5aacb0969/users/465daac7a1574d75a3c1f4041bf49e42/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 06:02:12.878529 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc4dc7-eaa1-43bf-a62d-678057faedfe None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:12.879208 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc4dc7-eaa1-43bf-a62d-678057faedfe None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:12.879480 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc4dc7-eaa1-43bf-a62d-678057faedfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:12.912912 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-29cc4dc7-eaa1-43bf-a62d-678057faedfe None None] MFA Rules not processed for user `465daac7a1574d75a3c1f4041bf49e42`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 06:02:12.914162 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-29cc4dc7-eaa1-43bf-a62d-678057faedfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:02:12.983024 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1455/2911] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 06:02:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 06:02:12.995591 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4259b-a6da-4fd7-800f-b29aeed12226 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:12.997495 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-71b4259b-a6da-4fd7-800f-b29aeed12226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:02:13.081670 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4259b-a6da-4fd7-800f-b29aeed12226 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:13.085622 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907dc7ab-2a31-415d-bb73-aaea3faaae07 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '766ad3d6be374fc482a7c0bf6a1e56ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:13.086225 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dc7ab-2a31-415d-bb73-aaea3faaae07 service glance] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:13.086494 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dc7ab-2a31-415d-bb73-aaea3faaae07 service glance] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:13.086765 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dc7ab-2a31-415d-bb73-aaea3faaae07 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:13.095899 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907dc7ab-2a31-415d-bb73-aaea3faaae07 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:13.097316 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907dc7ab-2a31-415d-bb73-aaea3faaae07 service glance] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:13.106304 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1457/2912] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 06:02:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 06:02:22.980004 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=48,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:02:23.102316 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:INSERT=2,keystone:SELECT=52 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:02:31.955178 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc4dc7-eaa1-43bf-a62d-678057faedfe None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:32.062341 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc4dc7-eaa1-43bf-a62d-678057faedfe None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:32.067367 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652613d6-028f-4e21-ac24-985a205f7324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:32.068043 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652613d6-028f-4e21-ac24-985a205f7324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:32.068317 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652613d6-028f-4e21-ac24-985a205f7324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:32.068582 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652613d6-028f-4e21-ac24-985a205f7324 admin admin] PATH_INFO: `/v3/users/465daac7a1574d75a3c1f4041bf49e42` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:32.069734 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652613d6-028f-4e21-ac24-985a205f7324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=465daac7a1574d75a3c1f4041bf49e42)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:32.071681 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652613d6-028f-4e21-ac24-985a205f7324 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:32.130708 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-652613d6-028f-4e21-ac24-985a205f7324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '465daac7a1574d75a3c1f4041bf49e42'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:32.139561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-652613d6-028f-4e21-ac24-985a205f7324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '465daac7a1574d75a3c1f4041bf49e42'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:32.140236 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-652613d6-028f-4e21-ac24-985a205f7324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '465daac7a1574d75a3c1f4041bf49e42'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:32.152585 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-652613d6-028f-4e21-ac24-985a205f7324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '465daac7a1574d75a3c1f4041bf49e42'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:32.160084 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-652613d6-028f-4e21-ac24-985a205f7324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '465daac7a1574d75a3c1f4041bf49e42'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:32.166559 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1456/2913] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 06:02:31 2022] DELETE /identity/v3/users/465daac7a1574d75a3c1f4041bf49e42 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 06:02:32.172275 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7cdf7-dfeb-481e-9c42-23a882e4ca11 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:32.172839 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7cdf7-dfeb-481e-9c42-23a882e4ca11 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:32.172839 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7cdf7-dfeb-481e-9c42-23a882e4ca11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:32.233868 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-38f7cdf7-dfeb-481e-9c42-23a882e4ca11 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 06:02:32.235086 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-38f7cdf7-dfeb-481e-9c42-23a882e4ca11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:02:32.309284 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1458/2914] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 06:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 06:02:32.320817 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652613d6-028f-4e21-ac24-985a205f7324 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:32.322512 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-652613d6-028f-4e21-ac24-985a205f7324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:02:32.372153 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:02:32.409705 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652613d6-028f-4e21-ac24-985a205f7324 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:32.414945 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66eabb-4079-41c5-ab1d-39f40bbd7426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:32.415812 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66eabb-4079-41c5-ab1d-39f40bbd7426 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:32.416142 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66eabb-4079-41c5-ab1d-39f40bbd7426 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:32.416532 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66eabb-4079-41c5-ab1d-39f40bbd7426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:32.428947 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66eabb-4079-41c5-ab1d-39f40bbd7426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:32.430377 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef66eabb-4079-41c5-ab1d-39f40bbd7426 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:32.440730 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1457/2915] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 06:02:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 06:02:32.728407 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7cdf7-dfeb-481e-9c42-23a882e4ca11 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:32.729851 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-38f7cdf7-dfeb-481e-9c42-23a882e4ca11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:02:32.748199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7cdf7-dfeb-481e-9c42-23a882e4ca11 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:32.753199 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf85e03-504e-4c91-90e8-ed0b95195020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:32.753875 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf85e03-504e-4c91-90e8-ed0b95195020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:32.754147 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf85e03-504e-4c91-90e8-ed0b95195020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:32.755281 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf85e03-504e-4c91-90e8-ed0b95195020 admin admin] PATH_INFO: `/v3/projects/b4da258158e84ac68523ebb5aacb0969` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:32.755768 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf85e03-504e-4c91-90e8-ed0b95195020 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4da258158e84ac68523ebb5aacb0969)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:32.757721 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf85e03-504e-4c91-90e8-ed0b95195020 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:32.825436 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-ccf85e03-504e-4c91-90e8-ed0b95195020 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4da258158e84ac68523ebb5aacb0969', 'request_id': 'req-ccf85e03-504e-4c91-90e8-ed0b95195020'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:32.836208 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-ccf85e03-504e-4c91-90e8-ed0b95195020 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4da258158e84ac68523ebb5aacb0969', 'request_id': 'req-ccf85e03-504e-4c91-90e8-ed0b95195020'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:32.844449 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-ccf85e03-504e-4c91-90e8-ed0b95195020 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4da258158e84ac68523ebb5aacb0969', 'request_id': 'req-ccf85e03-504e-4c91-90e8-ed0b95195020'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:32.856810 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-ccf85e03-504e-4c91-90e8-ed0b95195020 admin admin] The token cache is being invalidate because project b4da258158e84ac68523ebb5aacb0969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 06:02:32.857156 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-ccf85e03-504e-4c91-90e8-ed0b95195020 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:32.857869 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-ccf85e03-504e-4c91-90e8-ed0b95195020 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:02:32.859486 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1459/2916] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 06:02:32 2022] DELETE /identity/v3/projects/b4da258158e84ac68523ebb5aacb0969 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 06:02:32.864541 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e85916-568a-45a0-9ccd-19e6cec96bbc None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:32.864825 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e85916-568a-45a0-9ccd-19e6cec96bbc None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:32.865093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e85916-568a-45a0-9ccd-19e6cec96bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:32.913948 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-43e85916-568a-45a0-9ccd-19e6cec96bbc None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 06:02:32.915150 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-43e85916-568a-45a0-9ccd-19e6cec96bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:02:32.975754 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1458/2917] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 06:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 06:02:32.983853 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ccb7b-b557-49f6-945f-7736e48f4502 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:32.984157 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ccb7b-b557-49f6-945f-7736e48f4502 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:32.984420 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615ccb7b-b557-49f6-945f-7736e48f4502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:33.005837 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-615ccb7b-b557-49f6-945f-7736e48f4502 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 06:02:33.007067 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-615ccb7b-b557-49f6-945f-7736e48f4502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:02:33.016111 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1460/2918] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 06:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 06:02:33.021163 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e85916-568a-45a0-9ccd-19e6cec96bbc None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:33.031928 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e85916-568a-45a0-9ccd-19e6cec96bbc None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:33.037765 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e37ab-c2f7-46aa-bf0a-b10d2ebe69f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:33.038366 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e37ab-c2f7-46aa-bf0a-b10d2ebe69f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:33.038641 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e37ab-c2f7-46aa-bf0a-b10d2ebe69f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:33.038907 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e37ab-c2f7-46aa-bf0a-b10d2ebe69f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:33.039586 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e37ab-c2f7-46aa-bf0a-b10d2ebe69f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 06:02:33.039867 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e37ab-c2f7-46aa-bf0a-b10d2ebe69f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:33.041494 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e37ab-c2f7-46aa-bf0a-b10d2ebe69f7 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:33.053869 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1459/2919] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 06:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 06:02:33.058475 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ccb7b-b557-49f6-945f-7736e48f4502 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:33.068174 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615ccb7b-b557-49f6-945f-7736e48f4502 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:33.074247 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfaa4ce-2674-45cc-8b9a-a485eb646a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:33.074878 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfaa4ce-2674-45cc-8b9a-a485eb646a0f admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:33.075152 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfaa4ce-2674-45cc-8b9a-a485eb646a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:33.075394 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfaa4ce-2674-45cc-8b9a-a485eb646a0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:33.076081 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfaa4ce-2674-45cc-8b9a-a485eb646a0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:33.077944 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfaa4ce-2674-45cc-8b9a-a485eb646a0f admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:33.111153 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1461/2920] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 06:02:33 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 06:02:33.115908 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e37ab-c2f7-46aa-bf0a-b10d2ebe69f7 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:33.126342 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e37ab-c2f7-46aa-bf0a-b10d2ebe69f7 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:33.201218 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e69194-2129-48bc-94bc-487945cf2e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:33.201829 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e69194-2129-48bc-94bc-487945cf2e80 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:33.202104 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e69194-2129-48bc-94bc-487945cf2e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:33.202368 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e69194-2129-48bc-94bc-487945cf2e80 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:33.203041 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e69194-2129-48bc-94bc-487945cf2e80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:33.205836 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e69194-2129-48bc-94bc-487945cf2e80 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:33.231118 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1460/2921] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 06:02:33 2022] POST /identity/v3/users => generated 286 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 26 06:02:33.236053 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfaa4ce-2674-45cc-8b9a-a485eb646a0f admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:33.247480 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfaa4ce-2674-45cc-8b9a-a485eb646a0f admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:33.252673 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7356c-32ad-43e3-be3d-0b33abe814be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:33.253263 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7356c-32ad-43e3-be3d-0b33abe814be admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:33.253540 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7356c-32ad-43e3-be3d-0b33abe814be admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:33.253801 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7356c-32ad-43e3-be3d-0b33abe814be admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:33.254434 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb7356c-32ad-43e3-be3d-0b33abe814be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:33.256052 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb7356c-32ad-43e3-be3d-0b33abe814be admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:33.266000 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1462/2922] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 06:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 06:02:33.270305 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e69194-2129-48bc-94bc-487945cf2e80 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:33.280855 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e69194-2129-48bc-94bc-487945cf2e80 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:33.285824 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb117e3-5839-4924-9530-0aa7bb597001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:33.286413 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb117e3-5839-4924-9530-0aa7bb597001 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:33.286700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb117e3-5839-4924-9530-0aa7bb597001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:33.286940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb117e3-5839-4924-9530-0aa7bb597001 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:33.287601 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb117e3-5839-4924-9530-0aa7bb597001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:33.289231 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb117e3-5839-4924-9530-0aa7bb597001 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:33.300102 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1461/2923] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 06:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 06:02:33.305358 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7356c-32ad-43e3-be3d-0b33abe814be admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:33.316156 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7356c-32ad-43e3-be3d-0b33abe814be admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:33.321754 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6633d3-8b10-4e68-b4de-57ff523c5278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:33.322438 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6633d3-8b10-4e68-b4de-57ff523c5278 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:33.322706 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6633d3-8b10-4e68-b4de-57ff523c5278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:33.323193 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6633d3-8b10-4e68-b4de-57ff523c5278 admin admin] PATH_INFO: `/v3/projects/b9ad4c2b9f8c42078d918d44e92cf58d/users/8a0442109ca649eabeab9aaf36cf5144/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:33.339638 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6633d3-8b10-4e68-b4de-57ff523c5278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9ad4c2b9f8c42078d918d44e92cf58d, user_id=8a0442109ca649eabeab9aaf36cf5144, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:33.342290 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6633d3-8b10-4e68-b4de-57ff523c5278 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:33.344583 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:02:33.357132 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1463/2924] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 06:02:33 2022] PUT /identity/v3/projects/b9ad4c2b9f8c42078d918d44e92cf58d/users/8a0442109ca649eabeab9aaf36cf5144/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 06:02:33.368748 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc7539-c924-4986-a861-a4082802d1bd None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:33.368959 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc7539-c924-4986-a861-a4082802d1bd None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:33.369223 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc7539-c924-4986-a861-a4082802d1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:33.382883 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:02:33.399854 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-ddfc7539-c924-4986-a861-a4082802d1bd None None] MFA Rules not processed for user `8a0442109ca649eabeab9aaf36cf5144`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 06:02:33.401064 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-ddfc7539-c924-4986-a861-a4082802d1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:02:33.465705 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1462/2925] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 06:02:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 06:02:33.478329 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6633d3-8b10-4e68-b4de-57ff523c5278 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:02:33.480259 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-ed6633d3-8b10-4e68-b4de-57ff523c5278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:02:33.557787 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6633d3-8b10-4e68-b4de-57ff523c5278 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:02:33.562670 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4299f-0b12-4b5e-8db4-61704b70acad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '766ad3d6be374fc482a7c0bf6a1e56ec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:02:33.563279 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4299f-0b12-4b5e-8db4-61704b70acad service glance] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:02:33.563552 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4299f-0b12-4b5e-8db4-61704b70acad service glance] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:02:33.563822 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4299f-0b12-4b5e-8db4-61704b70acad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:02:33.573901 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4299f-0b12-4b5e-8db4-61704b70acad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:02:33.575383 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4299f-0b12-4b5e-8db4-61704b70acad service glance] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:02:33.586317 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1464/2926] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 06:02:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 06:02:43.462743 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=29 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:02:43.580640 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:INSERT=1,keystone:SELECT=28 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:03:00.765872 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc7539-c924-4986-a861-a4082802d1bd None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:03:00.833395 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc7539-c924-4986-a861-a4082802d1bd None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:03:00.838118 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d459a64-4606-4fe9-aed7-95889c2012c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:03:00.838753 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d459a64-4606-4fe9-aed7-95889c2012c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:03:00.839024 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d459a64-4606-4fe9-aed7-95889c2012c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:03:00.839516 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d459a64-4606-4fe9-aed7-95889c2012c6 admin admin] PATH_INFO: `/v3/users/8a0442109ca649eabeab9aaf36cf5144` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:03:00.840486 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d459a64-4606-4fe9-aed7-95889c2012c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a0442109ca649eabeab9aaf36cf5144)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:03:00.842415 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d459a64-4606-4fe9-aed7-95889c2012c6 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:03:00.897562 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3d459a64-4606-4fe9-aed7-95889c2012c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a0442109ca649eabeab9aaf36cf5144'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:03:00.907446 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3d459a64-4606-4fe9-aed7-95889c2012c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a0442109ca649eabeab9aaf36cf5144'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:03:00.908182 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3d459a64-4606-4fe9-aed7-95889c2012c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a0442109ca649eabeab9aaf36cf5144'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:03:00.921372 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3d459a64-4606-4fe9-aed7-95889c2012c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a0442109ca649eabeab9aaf36cf5144'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:03:00.928487 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-3d459a64-4606-4fe9-aed7-95889c2012c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a0442109ca649eabeab9aaf36cf5144'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:03:00.935008 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1463/2927] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 06:03:00 2022] DELETE /identity/v3/users/8a0442109ca649eabeab9aaf36cf5144 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 06:03:00.940020 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1aafa2-4222-47d6-a5cc-22e452d5e529 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:03:00.940518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1aafa2-4222-47d6-a5cc-22e452d5e529 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:03:00.940518 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1aafa2-4222-47d6-a5cc-22e452d5e529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:03:00.960374 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-fe1aafa2-4222-47d6-a5cc-22e452d5e529 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 06:03:00.961483 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-fe1aafa2-4222-47d6-a5cc-22e452d5e529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:03:01.026802 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1465/2928] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 06:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 06:03:01.041494 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d459a64-4606-4fe9-aed7-95889c2012c6 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:03:01.043580 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-3d459a64-4606-4fe9-aed7-95889c2012c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:03:01.134587 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d459a64-4606-4fe9-aed7-95889c2012c6 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:03:01.139949 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af8fbe-e150-4948-a897-f1ac79c84138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:03:01.140560 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af8fbe-e150-4948-a897-f1ac79c84138 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:03:01.140830 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af8fbe-e150-4948-a897-f1ac79c84138 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:03:01.141090 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af8fbe-e150-4948-a897-f1ac79c84138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:03:01.152786 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af8fbe-e150-4948-a897-f1ac79c84138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:03:01.154233 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af8fbe-e150-4948-a897-f1ac79c84138 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:03:01.164957 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1464/2929] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 06:03:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 06:03:01.451411 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1aafa2-4222-47d6-a5cc-22e452d5e529 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:03:01.453194 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-fe1aafa2-4222-47d6-a5cc-22e452d5e529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:03:01.467790 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1aafa2-4222-47d6-a5cc-22e452d5e529 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:03:01.476748 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db708adc-fe79-4ef4-b325-e77174e14b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:03:01.477604 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db708adc-fe79-4ef4-b325-e77174e14b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:03:01.477875 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db708adc-fe79-4ef4-b325-e77174e14b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:03:01.478137 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db708adc-fe79-4ef4-b325-e77174e14b2a admin admin] PATH_INFO: `/v3/projects/b9ad4c2b9f8c42078d918d44e92cf58d` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:03:01.479549 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db708adc-fe79-4ef4-b325-e77174e14b2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9ad4c2b9f8c42078d918d44e92cf58d)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:03:01.481590 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db708adc-fe79-4ef4-b325-e77174e14b2a admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:03:01.535066 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-db708adc-fe79-4ef4-b325-e77174e14b2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9ad4c2b9f8c42078d918d44e92cf58d', 'request_id': 'req-db708adc-fe79-4ef4-b325-e77174e14b2a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:03:01.547990 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-db708adc-fe79-4ef4-b325-e77174e14b2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9ad4c2b9f8c42078d918d44e92cf58d', 'request_id': 'req-db708adc-fe79-4ef4-b325-e77174e14b2a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:03:01.555082 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-db708adc-fe79-4ef4-b325-e77174e14b2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9ad4c2b9f8c42078d918d44e92cf58d', 'request_id': 'req-db708adc-fe79-4ef4-b325-e77174e14b2a'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:03:01.569978 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-db708adc-fe79-4ef4-b325-e77174e14b2a admin admin] The token cache is being invalidate because project b9ad4c2b9f8c42078d918d44e92cf58d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 06:03:01.570302 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-db708adc-fe79-4ef4-b325-e77174e14b2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:03:01.571163 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-db708adc-fe79-4ef4-b325-e77174e14b2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:03:01.572903 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1466/2930] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 06:03:01 2022] DELETE /identity/v3/projects/b9ad4c2b9f8c42078d918d44e92cf58d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 06:03:01.579146 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3eb6d-d519-4dc5-99c5-f1629a6a2621 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:03:01.579431 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3eb6d-d519-4dc5-99c5-f1629a6a2621 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:03:01.579744 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3eb6d-d519-4dc5-99c5-f1629a6a2621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:03:01.587564 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:03:01.602262 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-aec3eb6d-d519-4dc5-99c5-f1629a6a2621 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 06:03:01.603456 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-aec3eb6d-d519-4dc5-99c5-f1629a6a2621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:03:01.663775 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1465/2931] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 06:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 06:03:01.672019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af7911-1082-42ff-aaa5-608bfc2af88a None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:03:01.672296 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af7911-1082-42ff-aaa5-608bfc2af88a None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:03:01.672564 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af7911-1082-42ff-aaa5-608bfc2af88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:03:01.693428 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-f1af7911-1082-42ff-aaa5-608bfc2af88a None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 06:03:01.694617 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-f1af7911-1082-42ff-aaa5-608bfc2af88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:03:01.703811 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1467/2932] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 06:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 06:03:01.708252 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3eb6d-d519-4dc5-99c5-f1629a6a2621 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:03:01.718322 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3eb6d-d519-4dc5-99c5-f1629a6a2621 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:03:01.723888 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa676f62-6c06-408b-b7b2-04ca73035ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:03:01.724490 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa676f62-6c06-408b-b7b2-04ca73035ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:03:01.724765 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa676f62-6c06-408b-b7b2-04ca73035ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:03:01.725034 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa676f62-6c06-408b-b7b2-04ca73035ca0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:03:01.725674 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa676f62-6c06-408b-b7b2-04ca73035ca0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 06:03:01.725978 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa676f62-6c06-408b-b7b2-04ca73035ca0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:03:01.727594 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa676f62-6c06-408b-b7b2-04ca73035ca0 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:03:01.739496 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1466/2933] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 06:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 06:03:01.744051 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af7911-1082-42ff-aaa5-608bfc2af88a None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:03:01.753990 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af7911-1082-42ff-aaa5-608bfc2af88a None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:03:01.759464 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610baa9-0929-42c8-b7e3-e31140d1189d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:03:01.760104 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610baa9-0929-42c8-b7e3-e31140d1189d admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:03:01.760382 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610baa9-0929-42c8-b7e3-e31140d1189d admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:03:01.760652 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610baa9-0929-42c8-b7e3-e31140d1189d admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:03:01.761386 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610baa9-0929-42c8-b7e3-e31140d1189d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:03:01.763289 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610baa9-0929-42c8-b7e3-e31140d1189d admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:03:01.796016 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1468/2934] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 06:03:01 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 06:03:01.800278 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa676f62-6c06-408b-b7b2-04ca73035ca0 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:03:01.810379 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa676f62-6c06-408b-b7b2-04ca73035ca0 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:03:01.865571 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aed997-36ea-4e05-839a-1101bb3425b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:03:01.866162 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aed997-36ea-4e05-839a-1101bb3425b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:03:01.866435 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aed997-36ea-4e05-839a-1101bb3425b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:03:01.866695 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aed997-36ea-4e05-839a-1101bb3425b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:03:01.867335 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aed997-36ea-4e05-839a-1101bb3425b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:03:01.869246 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aed997-36ea-4e05-839a-1101bb3425b0 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:03:01.891566 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1467/2935] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 06:03:01 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 06:03:01.896547 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610baa9-0929-42c8-b7e3-e31140d1189d admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:03:01.908282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610baa9-0929-42c8-b7e3-e31140d1189d admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:03:01.914019 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a997293-1152-4376-a21f-9332b6eee9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:03:01.914627 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a997293-1152-4376-a21f-9332b6eee9cb admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:03:01.914899 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a997293-1152-4376-a21f-9332b6eee9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:03:01.915166 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a997293-1152-4376-a21f-9332b6eee9cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:03:01.915842 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a997293-1152-4376-a21f-9332b6eee9cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:03:01.917581 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a997293-1152-4376-a21f-9332b6eee9cb admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:03:01.928544 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1469/2936] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 06:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 06:03:01.932887 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aed997-36ea-4e05-839a-1101bb3425b0 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:03:01.943771 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aed997-36ea-4e05-839a-1101bb3425b0 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:03:01.949922 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555520b-51ae-4a54-895a-250ba8a9dc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:03:01.950516 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555520b-51ae-4a54-895a-250ba8a9dc0e admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:03:01.950792 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555520b-51ae-4a54-895a-250ba8a9dc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:03:01.951063 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555520b-51ae-4a54-895a-250ba8a9dc0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:03:01.951700 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555520b-51ae-4a54-895a-250ba8a9dc0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:03:01.953346 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555520b-51ae-4a54-895a-250ba8a9dc0e admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:03:01.964632 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1468/2937] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 06:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 06:03:01.969166 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a997293-1152-4376-a21f-9332b6eee9cb admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:03:01.979936 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a997293-1152-4376-a21f-9332b6eee9cb admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:03:01.985740 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5926a-1288-431d-9853-48547182da46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:03:01.986388 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5926a-1288-431d-9853-48547182da46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:03:01.986654 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5926a-1288-431d-9853-48547182da46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:03:01.986918 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5926a-1288-431d-9853-48547182da46 admin admin] PATH_INFO: `/v3/projects/9ad47db25e214256b5fa0b7eedb80aa1/users/6c4048b6266b4cd7b8c1cab83ad0968a/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:03:02.002668 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5926a-1288-431d-9853-48547182da46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad47db25e214256b5fa0b7eedb80aa1, user_id=6c4048b6266b4cd7b8c1cab83ad0968a, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:03:02.005361 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5926a-1288-431d-9853-48547182da46 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:03:02.020856 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1470/2938] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 06:03:01 2022] PUT /identity/v3/projects/9ad47db25e214256b5fa0b7eedb80aa1/users/6c4048b6266b4cd7b8c1cab83ad0968a/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 06:03:02.031427 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d1b3f-4aab-4cfa-a59c-6ebf45f57974 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:03:02.031706 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d1b3f-4aab-4cfa-a59c-6ebf45f57974 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:03:02.032009 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d1b3f-4aab-4cfa-a59c-6ebf45f57974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:03:02.059890 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-c59d1b3f-4aab-4cfa-a59c-6ebf45f57974 None None] MFA Rules not processed for user `6c4048b6266b4cd7b8c1cab83ad0968a`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 06:03:02.061025 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c59d1b3f-4aab-4cfa-a59c-6ebf45f57974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:03:02.122834 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:03:02.129260 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1469/2939] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 06:03:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 06:03:02.140424 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5926a-1288-431d-9853-48547182da46 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:03:02.142256 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-8de5926a-1288-431d-9853-48547182da46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:03:02.166671 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:03:02.227725 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5926a-1288-431d-9853-48547182da46 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:03:02.231795 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698458b-6f4f-4c1a-888b-ec93ffa1927e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:03:02.232379 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698458b-6f4f-4c1a-888b-ec93ffa1927e service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:03:02.232645 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698458b-6f4f-4c1a-888b-ec93ffa1927e service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:03:02.232912 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698458b-6f4f-4c1a-888b-ec93ffa1927e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:03:02.241821 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698458b-6f4f-4c1a-888b-ec93ffa1927e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:03:02.243245 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698458b-6f4f-4c1a-888b-ec93ffa1927e service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:03:02.252351 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1471/2940] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 06:03:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 06:03:12.130576 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:03:12.248295 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=26 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:03:12.766171 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d1b3f-4aab-4cfa-a59c-6ebf45f57974 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:03:12.835451 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d1b3f-4aab-4cfa-a59c-6ebf45f57974 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:03:12.840459 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c58b8-54d8-45d5-87d3-4923aec0df9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:03:12.841091 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c58b8-54d8-45d5-87d3-4923aec0df9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:03:12.841371 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c58b8-54d8-45d5-87d3-4923aec0df9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:03:12.841633 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c58b8-54d8-45d5-87d3-4923aec0df9f admin admin] PATH_INFO: `/v3/users/6c4048b6266b4cd7b8c1cab83ad0968a` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:03:12.842790 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c58b8-54d8-45d5-87d3-4923aec0df9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c4048b6266b4cd7b8c1cab83ad0968a)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:03:12.844794 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468c58b8-54d8-45d5-87d3-4923aec0df9f admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:03:12.896681 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-468c58b8-54d8-45d5-87d3-4923aec0df9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c4048b6266b4cd7b8c1cab83ad0968a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:03:12.905766 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-468c58b8-54d8-45d5-87d3-4923aec0df9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c4048b6266b4cd7b8c1cab83ad0968a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:03:12.906456 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-468c58b8-54d8-45d5-87d3-4923aec0df9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c4048b6266b4cd7b8c1cab83ad0968a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:03:12.918607 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-468c58b8-54d8-45d5-87d3-4923aec0df9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c4048b6266b4cd7b8c1cab83ad0968a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:03:12.926093 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-468c58b8-54d8-45d5-87d3-4923aec0df9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c4048b6266b4cd7b8c1cab83ad0968a'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:03:12.932239 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1470/2941] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 06:03:12 2022] DELETE /identity/v3/users/6c4048b6266b4cd7b8c1cab83ad0968a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 06:03:12.936848 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67454ef2-451f-4e8d-85af-068f3a27d803 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:03:12.937123 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67454ef2-451f-4e8d-85af-068f3a27d803 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:03:12.937390 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67454ef2-451f-4e8d-85af-068f3a27d803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:03:12.959326 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-67454ef2-451f-4e8d-85af-068f3a27d803 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 06:03:12.960557 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-67454ef2-451f-4e8d-85af-068f3a27d803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:03:13.023304 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1472/2942] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 06:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 06:03:13.033842 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c58b8-54d8-45d5-87d3-4923aec0df9f admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:03:13.035544 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-468c58b8-54d8-45d5-87d3-4923aec0df9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:03:13.103869 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c58b8-54d8-45d5-87d3-4923aec0df9f admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:03:13.110399 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a569c459-7236-4cd1-87af-432b8ff59ce1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:03:13.111241 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569c459-7236-4cd1-87af-432b8ff59ce1 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:03:13.111609 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569c459-7236-4cd1-87af-432b8ff59ce1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:03:13.111970 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a569c459-7236-4cd1-87af-432b8ff59ce1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:03:13.126744 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569c459-7236-4cd1-87af-432b8ff59ce1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:03:13.128223 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a569c459-7236-4cd1-87af-432b8ff59ce1 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:03:13.137748 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1471/2943] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 06:03:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 06:03:13.422602 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67454ef2-451f-4e8d-85af-068f3a27d803 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:03:13.424283 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-67454ef2-451f-4e8d-85af-068f3a27d803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:03:13.440458 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67454ef2-451f-4e8d-85af-068f3a27d803 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:03:13.446008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b028d05-bcd8-40fc-9102-3e80b7a2c08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:03:13.446677 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b028d05-bcd8-40fc-9102-3e80b7a2c08c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:03:13.446956 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b028d05-bcd8-40fc-9102-3e80b7a2c08c admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:03:13.447246 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b028d05-bcd8-40fc-9102-3e80b7a2c08c admin admin] PATH_INFO: `/v3/projects/9ad47db25e214256b5fa0b7eedb80aa1` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:03:13.449137 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b028d05-bcd8-40fc-9102-3e80b7a2c08c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ad47db25e214256b5fa0b7eedb80aa1)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:03:13.451301 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b028d05-bcd8-40fc-9102-3e80b7a2c08c admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:03:13.501796 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8b028d05-bcd8-40fc-9102-3e80b7a2c08c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ad47db25e214256b5fa0b7eedb80aa1', 'request_id': 'req-8b028d05-bcd8-40fc-9102-3e80b7a2c08c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:03:13.511449 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8b028d05-bcd8-40fc-9102-3e80b7a2c08c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ad47db25e214256b5fa0b7eedb80aa1', 'request_id': 'req-8b028d05-bcd8-40fc-9102-3e80b7a2c08c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:03:13.517082 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8b028d05-bcd8-40fc-9102-3e80b7a2c08c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ad47db25e214256b5fa0b7eedb80aa1', 'request_id': 'req-8b028d05-bcd8-40fc-9102-3e80b7a2c08c'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:03:13.528614 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8b028d05-bcd8-40fc-9102-3e80b7a2c08c admin admin] The token cache is being invalidate because project 9ad47db25e214256b5fa0b7eedb80aa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 06:03:13.528896 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8b028d05-bcd8-40fc-9102-3e80b7a2c08c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:03:13.529530 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-8b028d05-bcd8-40fc-9102-3e80b7a2c08c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:03:13.531026 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1473/2944] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 06:03:13 2022] DELETE /identity/v3/projects/9ad47db25e214256b5fa0b7eedb80aa1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 26 06:03:13.535980 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196b9c0-8258-48a4-89eb-022074d0e34d None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:03:13.536259 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196b9c0-8258-48a4-89eb-022074d0e34d None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:03:13.536527 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196b9c0-8258-48a4-89eb-022074d0e34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:03:13.557920 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-4196b9c0-8258-48a4-89eb-022074d0e34d None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 06:03:13.559144 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-4196b9c0-8258-48a4-89eb-022074d0e34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:03:13.576916 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:03:13.620123 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1472/2945] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 06:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 26 06:03:13.628141 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e75ae5-708b-455d-91a7-8bf33da03799 None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:03:13.628415 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e75ae5-708b-455d-91a7-8bf33da03799 None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:03:13.628662 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e75ae5-708b-455d-91a7-8bf33da03799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:03:13.649229 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-85e75ae5-708b-455d-91a7-8bf33da03799 None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 06:03:13.650438 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-85e75ae5-708b-455d-91a7-8bf33da03799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:03:13.659290 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1474/2946] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 06:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 06:03:13.663787 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196b9c0-8258-48a4-89eb-022074d0e34d None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:03:13.673776 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196b9c0-8258-48a4-89eb-022074d0e34d None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:03:13.679096 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fde55c-b23b-4123-8d93-9212ac6b0899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:03:13.679883 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fde55c-b23b-4123-8d93-9212ac6b0899 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:03:13.680209 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fde55c-b23b-4123-8d93-9212ac6b0899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:03:13.680633 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fde55c-b23b-4123-8d93-9212ac6b0899 admin admin] PATH_INFO: `/v3/domains` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:03:13.681493 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fde55c-b23b-4123-8d93-9212ac6b0899 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81683) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 26 06:03:13.681890 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fde55c-b23b-4123-8d93-9212ac6b0899 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:03:13.683612 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fde55c-b23b-4123-8d93-9212ac6b0899 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:03:13.697098 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1473/2947] 10.222.0.66 () {58 vars in 1153 bytes} [Mon Sep 26 06:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 26 06:03:13.702782 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e75ae5-708b-455d-91a7-8bf33da03799 None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:03:13.712935 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e75ae5-708b-455d-91a7-8bf33da03799 None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:03:13.720164 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93f487-de6d-4b58-9017-650f2cbe4091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:03:13.720907 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93f487-de6d-4b58-9017-650f2cbe4091 admin admin] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:03:13.721176 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93f487-de6d-4b58-9017-650f2cbe4091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:03:13.721506 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93f487-de6d-4b58-9017-650f2cbe4091 admin admin] PATH_INFO: `/v3/projects` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:03:13.722418 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93f487-de6d-4b58-9017-650f2cbe4091 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:03:13.725107 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93f487-de6d-4b58-9017-650f2cbe4091 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:03:13.758842 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1475/2948] 10.222.0.66 () {60 vars in 1153 bytes} [Mon Sep 26 06:03:13 2022] POST /identity/v3/projects => generated 399 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 06:03:13.764424 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fde55c-b23b-4123-8d93-9212ac6b0899 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:03:13.775022 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fde55c-b23b-4123-8d93-9212ac6b0899 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:03:13.846947 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0e581-bc74-4e2e-9c6f-c7e110ce2a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:03:13.847562 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0e581-bc74-4e2e-9c6f-c7e110ce2a26 admin admin] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:03:13.847868 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0e581-bc74-4e2e-9c6f-c7e110ce2a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:03:13.848135 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0e581-bc74-4e2e-9c6f-c7e110ce2a26 admin admin] PATH_INFO: `/v3/users` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:03:13.848758 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0e581-bc74-4e2e-9c6f-c7e110ce2a26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:03:13.850704 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f0e581-bc74-4e2e-9c6f-c7e110ce2a26 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:03:13.878235 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1474/2949] 10.222.0.66 () {60 vars in 1144 bytes} [Mon Sep 26 06:03:13 2022] POST /identity/v3/users => generated 300 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 26 06:03:13.883084 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93f487-de6d-4b58-9017-650f2cbe4091 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:03:13.894184 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93f487-de6d-4b58-9017-650f2cbe4091 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:03:13.900000 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42569c32-f755-4743-9412-4ccf792f8ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:03:13.900597 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42569c32-f755-4743-9412-4ccf792f8ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:03:13.901218 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42569c32-f755-4743-9412-4ccf792f8ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:03:13.901474 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42569c32-f755-4743-9412-4ccf792f8ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:03:13.902115 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42569c32-f755-4743-9412-4ccf792f8ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:03:13.903709 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42569c32-f755-4743-9412-4ccf792f8ae0 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:03:13.914243 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1476/2950] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 06:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 06:03:13.919134 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0e581-bc74-4e2e-9c6f-c7e110ce2a26 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:03:13.935673 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f0e581-bc74-4e2e-9c6f-c7e110ce2a26 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:03:13.942811 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74d0ae-59d4-4f48-8405-374a6379e388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:03:13.943409 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74d0ae-59d4-4f48-8405-374a6379e388 admin admin] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:03:13.943679 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74d0ae-59d4-4f48-8405-374a6379e388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:03:13.943973 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74d0ae-59d4-4f48-8405-374a6379e388 admin admin] PATH_INFO: `/v3/roles` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:03:13.944603 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74d0ae-59d4-4f48-8405-374a6379e388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:03:13.946249 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74d0ae-59d4-4f48-8405-374a6379e388 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:03:13.957614 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1475/2951] 10.222.0.66 () {58 vars in 1122 bytes} [Mon Sep 26 06:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 26 06:03:13.962355 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42569c32-f755-4743-9412-4ccf792f8ae0 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:03:13.974082 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42569c32-f755-4743-9412-4ccf792f8ae0 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:03:13.979586 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e6369-18f5-4329-af8a-44698f8f3b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:03:13.980279 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e6369-18f5-4329-af8a-44698f8f3b56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:03:13.980578 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e6369-18f5-4329-af8a-44698f8f3b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:03:13.980850 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e6369-18f5-4329-af8a-44698f8f3b56 admin admin] PATH_INFO: `/v3/projects/b43ee69ca9a846e8a83034d05142a228/users/ce160efa0a404137a37e0897e6b3ed43/roles/c5a02c4618d94f1da7257ef437b8ce9e` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:03:13.996989 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e6369-18f5-4329-af8a-44698f8f3b56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b43ee69ca9a846e8a83034d05142a228, user_id=ce160efa0a404137a37e0897e6b3ed43, role_id=c5a02c4618d94f1da7257ef437b8ce9e)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:03:13.999636 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e6369-18f5-4329-af8a-44698f8f3b56 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:03:14.014688 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1477/2952] 10.222.0.66 () {60 vars in 1483 bytes} [Mon Sep 26 06:03:13 2022] PUT /identity/v3/projects/b43ee69ca9a846e8a83034d05142a228/users/ce160efa0a404137a37e0897e6b3ed43/roles/c5a02c4618d94f1da7257ef437b8ce9e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 06:03:14.025120 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3278c91-32fa-4ef4-85f2-48aa91278ea9 None None] REQUEST_METHOD: `POST` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:03:14.025383 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3278c91-32fa-4ef4-85f2-48aa91278ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:03:14.025648 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3278c91-32fa-4ef4-85f2-48aa91278ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:03:14.057160 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.auth.core [None req-e3278c91-32fa-4ef4-85f2-48aa91278ea9 None None] MFA Rules not processed for user `ce160efa0a404137a37e0897e6b3ed43`. Rule list: `[]` (Enabled: `True`). {{(pid=81683) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 06:03:14.058363 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-e3278c91-32fa-4ef4-85f2-48aa91278ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:03:14.125225 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1476/2953] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 06:03:14 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 06:03:14.137224 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e6369-18f5-4329-af8a-44698f8f3b56 admin admin] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:03:14.139008 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-a28e6369-18f5-4329-af8a-44698f8f3b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:03:14.163405 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:03:14.201683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e6369-18f5-4329-af8a-44698f8f3b56 admin admin] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:03:14.205479 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ca2a7-4655-4b20-a3f5-dc42670fa03f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '842ef2c8cd794023ac29bd03c768986b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:03:14.206265 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ca2a7-4655-4b20-a3f5-dc42670fa03f service cinder] REQUEST_METHOD: `GET` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:03:14.206513 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ca2a7-4655-4b20-a3f5-dc42670fa03f service cinder] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:03:14.206780 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ca2a7-4655-4b20-a3f5-dc42670fa03f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:03:14.217502 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ca2a7-4655-4b20-a3f5-dc42670fa03f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:03:14.218940 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ca2a7-4655-4b20-a3f5-dc42670fa03f service cinder] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:03:14.228683 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1478/2954] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 06:03:14 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 06:03:19.313500 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3278c91-32fa-4ef4-85f2-48aa91278ea9 None None] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:03:19.337074 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:03:19.382788 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3278c91-32fa-4ef4-85f2-48aa91278ea9 None None] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:03:19.388305 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93d81d-76c9-4cc8-8663-0ebeeec19112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:03:19.388940 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93d81d-76c9-4cc8-8663-0ebeeec19112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:03:19.389217 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93d81d-76c9-4cc8-8663-0ebeeec19112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:03:19.389498 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93d81d-76c9-4cc8-8663-0ebeeec19112 admin admin] PATH_INFO: `/v3/users/ce160efa0a404137a37e0897e6b3ed43` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:03:19.390687 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93d81d-76c9-4cc8-8663-0ebeeec19112 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce160efa0a404137a37e0897e6b3ed43)` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:03:19.392641 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93d81d-76c9-4cc8-8663-0ebeeec19112 admin admin] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:03:19.443741 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8b93d81d-76c9-4cc8-8663-0ebeeec19112 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce160efa0a404137a37e0897e6b3ed43'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:03:19.451676 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8b93d81d-76c9-4cc8-8663-0ebeeec19112 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce160efa0a404137a37e0897e6b3ed43'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:03:19.452337 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8b93d81d-76c9-4cc8-8663-0ebeeec19112 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce160efa0a404137a37e0897e6b3ed43'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:03:19.464182 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8b93d81d-76c9-4cc8-8663-0ebeeec19112 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce160efa0a404137a37e0897e6b3ed43'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:03:19.471199 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.notifications [None req-8b93d81d-76c9-4cc8-8663-0ebeeec19112 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce160efa0a404137a37e0897e6b3ed43'} {{(pid=81683) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:03:19.477282 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1477/2955] 10.222.0.66 () {58 vars in 1224 bytes} [Mon Sep 26 06:03:19 2022] DELETE /identity/v3/users/ce160efa0a404137a37e0897e6b3ed43 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 06:03:19.482089 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6ca8a-5b65-4f6d-afc2-c0ca3b6ea1dc None None] REQUEST_METHOD: `POST` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:03:19.482642 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6ca8a-5b65-4f6d-afc2-c0ca3b6ea1dc None None] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:03:19.482642 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf6ca8a-5b65-4f6d-afc2-c0ca3b6ea1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:03:19.503949 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.auth.core [None req-2bf6ca8a-5b65-4f6d-afc2-c0ca3b6ea1dc None None] MFA Rules not processed for user `68623c0b9d92445197ab588b18e08f43`. Rule list: `[]` (Enabled: `True`). {{(pid=81682) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 26 06:03:19.505177 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2bf6ca8a-5b65-4f6d-afc2-c0ca3b6ea1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:03:19.569421 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1479/2956] 10.222.0.66 () {58 vars in 958 bytes} [Mon Sep 26 06:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 26 06:03:19.580955 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93d81d-76c9-4cc8-8663-0ebeeec19112 admin admin] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:03:19.582597 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-8b93d81d-76c9-4cc8-8663-0ebeeec19112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:03:19.641908 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93d81d-76c9-4cc8-8663-0ebeeec19112 admin admin] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:03:19.646078 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e2004-b6b3-4ed9-9d0f-51d411663d39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26b3d51ac6ca41cf9e535e751ac94675', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:03:19.646686 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e2004-b6b3-4ed9-9d0f-51d411663d39 service neutron] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:03:19.646966 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e2004-b6b3-4ed9-9d0f-51d411663d39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:03:19.647230 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e2004-b6b3-4ed9-9d0f-51d411663d39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:03:19.656975 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e2004-b6b3-4ed9-9d0f-51d411663d39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:03:19.658404 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e2004-b6b3-4ed9-9d0f-51d411663d39 service neutron] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:03:19.668077 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1478/2957] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 06:03:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 26 06:03:19.952422 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6ca8a-5b65-4f6d-afc2-c0ca3b6ea1dc None None] Authenticating user token {{(pid=81682) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:03:19.953891 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.fernet_utils [None req-2bf6ca8a-5b65-4f6d-afc2-c0ca3b6ea1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81682) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:03:19.973282 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf6ca8a-5b65-4f6d-afc2-c0ca3b6ea1dc None None] Validating token access rules against request {{(pid=81682) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:03:19.979174 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28fc8ec-491a-413b-8e9c-342f54dc7d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68623c0b9d92445197ab588b18e08f43', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c94348459484274ba0198cbad0a8ffb', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81682) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:03:19.979865 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fc8ec-491a-413b-8e9c-342f54dc7d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:03:19.980139 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fc8ec-491a-413b-8e9c-342f54dc7d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:03:19.980399 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28fc8ec-491a-413b-8e9c-342f54dc7d61 admin admin] PATH_INFO: `/v3/projects/b43ee69ca9a846e8a83034d05142a228` {{(pid=81682) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:03:19.981610 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28fc8ec-491a-413b-8e9c-342f54dc7d61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b43ee69ca9a846e8a83034d05142a228)` {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:03:19.983511 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28fc8ec-491a-413b-8e9c-342f54dc7d61 admin admin] RBAC: Authorization granted {{(pid=81682) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:03:20.037888 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a28fc8ec-491a-413b-8e9c-342f54dc7d61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b43ee69ca9a846e8a83034d05142a228', 'request_id': 'req-a28fc8ec-491a-413b-8e9c-342f54dc7d61'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:03:20.046708 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a28fc8ec-491a-413b-8e9c-342f54dc7d61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b43ee69ca9a846e8a83034d05142a228', 'request_id': 'req-a28fc8ec-491a-413b-8e9c-342f54dc7d61'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:03:20.053061 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a28fc8ec-491a-413b-8e9c-342f54dc7d61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b43ee69ca9a846e8a83034d05142a228', 'request_id': 'req-a28fc8ec-491a-413b-8e9c-342f54dc7d61'} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:03:20.064950 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a28fc8ec-491a-413b-8e9c-342f54dc7d61 admin admin] The token cache is being invalidate because project b43ee69ca9a846e8a83034d05142a228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81682) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 26 06:03:20.065294 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a28fc8ec-491a-413b-8e9c-342f54dc7d61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:03:20.065983 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG keystone.notifications [None req-a28fc8ec-491a-413b-8e9c-342f54dc7d61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81682) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 26 06:03:20.067521 dv-cinder-836083-14-smb devstack@keystone.service[81682]: [pid: 81682|app: 0|req: 1480/2958] 10.222.0.66 () {58 vars in 1233 bytes} [Mon Sep 26 06:03:19 2022] DELETE /identity/v3/projects/b43ee69ca9a846e8a83034d05142a228 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 26 06:03:29.663792 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:03:30.062078 dv-cinder-836083-14-smb devstack@keystone.service[81682]: DEBUG dbcounter [-] [81682] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81682) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 26 06:03:41.326694 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e2004-b6b3-4ed9-9d0f-51d411663d39 service neutron] Authenticating user token {{(pid=81683) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 26 06:03:41.328288 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-c77e2004-b6b3-4ed9-9d0f-51d411663d39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:03:41.422059 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e2004-b6b3-4ed9-9d0f-51d411663d39 service neutron] Validating token access rules against request {{(pid=81683) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 26 06:03:41.482663 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a8f66-0b75-4e51-9d00-62de583fd4ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '895edcfb20484b188a3877c9de8b59c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '953bb95b0ba84d4f99a73afb426bb8c8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81683) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 26 06:03:41.483286 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a8f66-0b75-4e51-9d00-62de583fd4ef service placement] REQUEST_METHOD: `GET` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 26 06:03:41.483561 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a8f66-0b75-4e51-9d00-62de583fd4ef service placement] SCRIPT_NAME: `/identity` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 26 06:03:41.483868 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a8f66-0b75-4e51-9d00-62de583fd4ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81683) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 26 06:03:41.485658 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.fernet_utils [None req-903a8f66-0b75-4e51-9d00-62de583fd4ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81683) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 26 06:03:41.497830 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a8f66-0b75-4e51-9d00-62de583fd4ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 26 06:03:41.499434 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a8f66-0b75-4e51-9d00-62de583fd4ef service placement] RBAC: Authorization granted {{(pid=81683) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 26 06:03:41.509736 dv-cinder-836083-14-smb devstack@keystone.service[81683]: [pid: 81683|app: 0|req: 1479/2959] 10.222.0.66 () {60 vars in 1365 bytes} [Mon Sep 26 06:03:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 26 06:03:51.505456 dv-cinder-836083-14-smb devstack@keystone.service[81683]: DEBUG dbcounter [-] [81683] Writing DB stats keystone:SELECT=67 {{(pid=81683) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}